2023-12-20T04:06:16.477 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-20T04:06:16.478 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi --archive /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369 --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/orig.config.yaml 2023-12-20T04:06:16.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:06:16.599 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369 branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: vshankar@redhat.com first_in_suite: false job_id: '7497369' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 430 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e sleep_before_teardown: 0 subset: 301/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNMeyIaMbRTMJ/GOxgiXdQ9nS8ivj0WJC5O0HokCYz/avMeFbOBU37TcnRVsjcMkgTHNoqC8RWrzDsAH3EJoA4I= smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfb32TMLEklnuYQ6QWhl8UY/5pb5s9SeuUuTQakJjn0vUVGNZ/AZWTyj47fOiAJTRrkSU3v+0RH9aXN5UEx5Q0= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEL68mI9LdfPnXdSy7nEiEfcpEWspR7LoJ2s8SWIBoE6lEtm0Zeh/r/Id0IS/P72TNlz9VheDqrCSO2eS7FsHaY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-20_03:59:06 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-20T04:06:16.599 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa; will attempt to use it 2023-12-20T04:06:16.600 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks 2023-12-20T04:06:16.600 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-20T04:06:16.602 INFO:teuthology.task.internal:Checking packages... 2023-12-20T04:06:16.623 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '568df92b7e50b2108bce4c77c393ff294d6a5e5e' 2023-12-20T04:06:16.624 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-20T04:06:16.624 INFO:teuthology.packaging:ref: None 2023-12-20T04:06:16.624 INFO:teuthology.packaging:tag: None 2023-12-20T04:06:16.624 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-20T04:06:16.624 INFO:teuthology.packaging:sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:06:16.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-20T04:06:16.780 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-132.g568df92b 2023-12-20T04:06:16.781 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-20T04:06:16.788 INFO:teuthology.task.internal:no buildpackages task found 2023-12-20T04:06:16.788 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-20T04:06:16.817 INFO:teuthology.task.internal:Saving configuration 2023-12-20T04:06:16.833 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-20T04:06:16.839 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T04:06:16.865 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:23.381605', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNMeyIaMbRTMJ/GOxgiXdQ9nS8ivj0WJC5O0HokCYz/avMeFbOBU37TcnRVsjcMkgTHNoqC8RWrzDsAH3EJoA4I='} 2023-12-20T04:06:16.887 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:23.378506', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfb32TMLEklnuYQ6QWhl8UY/5pb5s9SeuUuTQakJjn0vUVGNZ/AZWTyj47fOiAJTRrkSU3v+0RH9aXN5UEx5Q0='} 2023-12-20T04:06:16.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:23.379989', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEL68mI9LdfPnXdSy7nEiEfcpEWspR7LoJ2s8SWIBoE6lEtm0Zeh/r/Id0IS/P72TNlz9VheDqrCSO2eS7FsHaY='} 2023-12-20T04:06:16.911 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-20T04:06:16.917 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-12-20T04:06:16.917 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-20T04:06:16.917 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['client.0'] 2023-12-20T04:06:16.917 INFO:teuthology.run_tasks:Running task console_log... 2023-12-20T04:06:17.038 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0e1ecbcdc0>, signals=[15]) 2023-12-20T04:06:17.038 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-20T04:06:17.044 INFO:teuthology.task.internal:Opening connections... 2023-12-20T04:06:17.044 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T04:06:17.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:06:17.145 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T04:06:17.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:06:17.227 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-12-20T04:06:17.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:06:17.311 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-20T04:06:17.318 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-12-20T04:06:17.336 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-12-20T04:06:17.336 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-12-20T04:06:17.393 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-12-20T04:06:17.393 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-12-20T04:06:17.393 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-20T04:06:17.394 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-20T04:06:17.395 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-12-20T04:06:17.416 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-12-20T04:06:17.434 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-12-20T04:06:17.434 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-20T04:06:17.491 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-12-20T04:06:17.491 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-12-20T04:06:17.491 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-12-20T04:06:17.491 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-12-20T04:06:17.491 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-12-20T04:06:17.491 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-12-20T04:06:17.491 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-20T04:06:17.492 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-20T04:06:17.492 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-12-20T04:06:17.492 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-20T04:06:17.492 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-12-20T04:06:17.492 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:06:17.492 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-20T04:06:17.492 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-20T04:06:17.492 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-20T04:06:17.516 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-12-20T04:06:17.534 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-12-20T04:06:17.534 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-12-20T04:06:17.591 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2023-12-20T04:06:17.591 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2023-12-20T04:06:17.591 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2023-12-20T04:06:17.591 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-20T04:06:17.592 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-20T04:06:17.592 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-12-20T04:06:17.616 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-20T04:06:17.625 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-20T04:06:17.642 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-20T04:06:17.642 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-12-20T04:06:17.644 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2023-12-20T04:06:17.647 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-12-20T04:06:17.663 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-20T04:06:17.668 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-20T04:06:17.668 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-12-20T04:06:17.702 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2023-12-20T04:06:17.705 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-12-20T04:06:17.822 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-20T04:06:17.881 INFO:teuthology.run_tasks:Running task kernel... 2023-12-20T04:06:17.895 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-20T04:06:17.896 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-12-20T04:06:17.896 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-12-20T04:06:17.896 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-20T04:06:17.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:06:17.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-20T04:06:18.086 DEBUG:teuthology.task.kernel:sha1 for client.0 is 93572f31db899adbd1540d7954ab247e32731c84 2023-12-20T04:06:18.086 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "93572f31db899adbd1540d7954ab247e32731c84"... 2023-12-20T04:06:18.086 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-12-20T04:06:18.104 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-361.el9.x86_64 2023-12-20T04:06:18.104 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 93572f31db899adbd1540d7954ab247e32731c84 2023-12-20T04:06:18.104 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-20T04:06:18.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum upgrade -y linux-firmware 2023-12-20T04:06:20.182 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-12-20T04:06:21.823 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2023-12-20T04:06:22.814 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-12-20T04:06:25.684 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-12-20T04:06:30.468 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.8 MB 00:01 2023-12-20T04:06:31.991 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-12-20T04:06:36.101 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 20 MB 00:03 2023-12-20T04:06:40.743 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-12-20T04:06:43.073 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-20T04:06:43.081 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-20T04:06:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-12-20T04:06:43.081 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-20T04:06:43.081 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-12-20T04:06:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-20T04:06:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:06:43.082 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-20T04:06:43.082 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-20T04:06:43.082 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 1 Package 2023-12-20T04:06:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:06:43.082 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 328 M 2023-12-20T04:06:43.082 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-12-20T04:06:49.319 INFO:teuthology.orchestra.run.smithi081.stdout:linux-firmware-20231030-141.el9.noarch.rpm 53 MB/s | 328 MB 00:06 2023-12-20T04:06:49.320 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:06:49.320 INFO:teuthology.orchestra.run.smithi081.stdout:Total 53 MB/s | 328 MB 00:06 2023-12-20T04:06:49.320 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-12-20T04:06:49.410 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-12-20T04:06:49.410 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-12-20T04:06:51.560 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-12-20T04:06:51.561 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-12-20T04:06:57.584 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-12-20T04:06:57.943 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-20T04:06:58.017 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-20T04:06:59.058 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-20T04:06:59.059 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-20T04:06:59.455 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-20T04:06:59.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:06:59.455 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-12-20T04:06:59.455 INFO:teuthology.orchestra.run.smithi081.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-20T04:06:59.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:06:59.455 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-20T04:06:59.746 INFO:teuthology.task.kernel:Downloading kernel 93572f31db899adbd1540d7954ab247e32731c84 on client.0... 2023-12-20T04:06:59.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=93572f31db899adbd1540d7954ab247e32731c84 2023-12-20T04:06:59.968 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/93572f31db899adbd1540d7954ab247e32731c84/centos/9/flavors/default/x86_64/ 2023-12-20T04:06:59.968 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g93572f31db89-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/93572f31db899adbd1540d7954ab247e32731c84/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-20T04:06:59.971 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2023-12-20T04:07:10.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-12-20 04:07:10 URL:https://3.chacra.ceph.com/r/kernel/testing/93572f31db899adbd1540d7954ab247e32731c84/centos/9/flavors/default/x86_64/kernel-6.6.0_g93572f31db89-1.x86_64.rpm [320404082/320404082] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-20T04:07:10.860 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2023-12-20 04:07:10-- 2023-12-20T04:07:10.860 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 11s 2023-12-20T04:07:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 306M in 11s (28.9 MB/s) 2023-12-20T04:07:10.863 INFO:teuthology.task.kernel:Installing kernel 93572f31db899adbd1540d7954ab247e32731c84 on client.0... 2023-12-20T04:07:10.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-20T04:07:12.719 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying... ######################################## 2023-12-20T04:07:12.805 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing... ######################################## 2023-12-20T04:07:12.886 INFO:teuthology.orchestra.run.smithi081.stdout:Updating / installing... 2023-12-20T04:07:20.026 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-6.6.0_g93572f31db89-1 ######################################## 2023-12-20T04:07:35.321 INFO:teuthology.orchestra.run.smithi081.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-20T04:07:56.628 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-20T04:07:56.628 DEBUG:teuthology.orchestra.run.smithi081:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-20T04:07:56.702 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/System.map-6.6.0-g93572f31db89 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/config-6.6.0-g93572f31db89 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/boot/vmlinuz-6.6.0-g93572f31db89 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto 2023-12-20T04:07:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-20T04:07:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-20T04:07:56.705 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-20T04:07:56.705 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-20T04:07:56.705 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-20T04:07:56.705 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-20T04:07:56.705 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-20T04:07:56.705 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-20T04:07:56.705 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-20T04:07:56.706 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-20T04:07:56.706 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-20T04:07:56.706 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-20T04:07:56.706 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-20T04:07:56.706 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kernel 2023-12-20T04:07:56.706 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kernel/cpu 2023-12-20T04:07:56.706 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kernel/cpu/mce 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kvm 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/arch/x86/kvm/kvm.ko 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/ansi_cprng.ko 2023-12-20T04:07:56.707 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/anubis.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/arc4.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/async_tx 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/async_tx/async_memcpy.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/async_tx/async_pq.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/async_tx/async_tx.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/async_tx/async_xor.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/async_tx/raid6test.ko 2023-12-20T04:07:56.708 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/authenc.ko 2023-12-20T04:07:56.709 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/authencesn.ko 2023-12-20T04:07:56.709 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/blake2b_generic.ko 2023-12-20T04:07:56.709 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/blowfish_common.ko 2023-12-20T04:07:56.709 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/blowfish_generic.ko 2023-12-20T04:07:56.709 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/camellia_generic.ko 2023-12-20T04:07:56.709 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/cast5_generic.ko 2023-12-20T04:07:56.710 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/cast6_generic.ko 2023-12-20T04:07:56.710 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/cast_common.ko 2023-12-20T04:07:56.710 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/ccm.ko 2023-12-20T04:07:56.710 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/cmac.ko 2023-12-20T04:07:56.710 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/crc32_generic.ko 2023-12-20T04:07:56.710 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/crypto_engine.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/crypto_user.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/cts.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/des_generic.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/dh_generic.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/echainiv.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/essiv.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/fcrypt.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/khazad.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/lz4.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/lz4hc.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/md4.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/michael_mic.ko 2023-12-20T04:07:56.711 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/pcbc.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/pcrypt.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/rmd160.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/seed.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/serpent_generic.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/tcrypt.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/tea.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/twofish_common.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/twofish_generic.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/vmac.ko 2023-12-20T04:07:56.712 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/wp512.ko 2023-12-20T04:07:56.713 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/xcbc.ko 2023-12-20T04:07:56.713 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/xor.ko 2023-12-20T04:07:56.713 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/crypto/xxhash_generic.ko 2023-12-20T04:07:56.713 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers 2023-12-20T04:07:56.713 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi 2023-12-20T04:07:56.713 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-20T04:07:56.713 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/acpi_pad.ko 2023-12-20T04:07:56.714 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/custom_method.ko 2023-12-20T04:07:56.714 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/ec_sys.ko 2023-12-20T04:07:56.714 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/platform_profile.ko 2023-12-20T04:07:56.714 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/sbs.ko 2023-12-20T04:07:56.714 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/sbshc.ko 2023-12-20T04:07:56.714 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/acpi/video.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/acard-ahci.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/ahci_platform.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/ata_generic.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/libahci_platform.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_acpi.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_ali.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_amd.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_artop.ko 2023-12-20T04:07:56.715 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_atiixp.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_atp867x.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_cmd640.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_cmd64x.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_cypress.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_efar.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_hpt366.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_hpt37x.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-20T04:07:56.716 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_it8213.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_it821x.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_jmicron.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_marvell.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_mpiix.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_netcell.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_ninja32.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_ns87410.ko 2023-12-20T04:07:56.717 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_ns87415.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_oldpiix.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_opti.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_optidma.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_pcmcia.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_piccolo.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_rdc.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_sch.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_serverworks.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_sil680.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_sis.ko 2023-12-20T04:07:56.718 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_sl82c105.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_triflex.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pata_via.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/pdc_adma.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_inic162x.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_mv.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_nv.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_promise.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_qstor.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_sil.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_sil24.ko 2023-12-20T04:07:56.719 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_sis.ko 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_svw.ko 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_sx4.ko 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_uli.ko 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_via.ko 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ata/sata_vsc.ko 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/auxdisplay 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/auxdisplay/ks0108.ko 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/base 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/base/regmap 2023-12-20T04:07:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/bcma 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/bcma/bcma.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/aoe 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/aoe/aoe.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/brd.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/drbd 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/drbd/drbd.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/floppy.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/loop.ko 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/mtip32xx 2023-12-20T04:07:56.721 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/nbd.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/null_blk 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/null_blk/null_blk.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/pktcdvd.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/rbd.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/virtio_blk.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/xen-blkback 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/xen-blkfront.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/zram 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/block/zram/zram.ko 2023-12-20T04:07:56.722 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/hangcheck-timer.ko 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/hw_random 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/hw_random/via-rng.ko 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ipmi 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-20T04:07:56.723 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/lp.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/mwave 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/mwave/mwave.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/ppdev.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tlclk.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tpm 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tpm/tpm.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-20T04:07:56.724 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/uv_mmtimer.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/char/virtio_console.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/cpufreq 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/ccp 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-20T04:07:56.725 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/ccp/ccp.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/intel 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/intel/qat 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/intel/qat/qat_common 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/padlock-aes.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/padlock-sha.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/virtio 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/dca 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/dca/dca.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/devfreq 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-20T04:07:56.726 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/dma 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/dma/dw 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/dma/ioat 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/amd64_edac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/e752x_edac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/edac_mce_amd.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/i3000_edac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/i3200_edac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/i5100_edac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/i5400_edac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/i7300_edac.ko 2023-12-20T04:07:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/i7core_edac.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/i82975x_edac.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/ie31200_edac.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/sb_edac.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/edac/x38_edac.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/firmware 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/firmware/edd.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/gpio 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/gpio/gpio-ich.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-20T04:07:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-appleir.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-aureal.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-axff.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-dr.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-elecom.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-elo.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-emsff.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-gaff.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-gt683r.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-gyration.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-20T04:07:56.729 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-holtekff.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-hyperv.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-icade.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-keytouch.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-kye.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-lcpower.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-led.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-lenovo.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-multitouch.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-ortek.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-penmount.ko 2023-12-20T04:07:56.730 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-petalynx.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-picolcd.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-pl.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-plantronics.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-primax.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-rmi.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-common.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-20T04:07:56.731 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-roccat.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-saitek.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-samsung.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-sjoy.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-sony.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-speedlink.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-steelseries.ko 2023-12-20T04:07:56.732 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-sunplus.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-tivo.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-tmff.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-topseed.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-twinhan.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-uclogic.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-waltop.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-wiimote.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-xinmo.ko 2023-12-20T04:07:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-zpff.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/hid-zydacron.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/uhid.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hid/wacom.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hv 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hv/hv_balloon.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hv/hv_utils.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hv/hv_vmbus.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/abituguru.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/abituguru3.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ad7414.ko 2023-12-20T04:07:56.734 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ad7418.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adc128d818.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adm1025.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adm1026.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adm1029.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adm1031.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adm9240.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ads7828.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adt7410.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adt7411.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adt7462.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adt7470.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adt7475.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/adt7x10.ko 2023-12-20T04:07:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/amc6821.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/applesmc.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/asb100.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/asc7621.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/atxp1.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/coretemp.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/dme1737.ko 2023-12-20T04:07:56.736 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ds1621.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ds620.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/emc1403.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/emc6w201.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/f71805f.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/f71882fg.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/f75375s.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/fam15h_power.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/fschmd.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/g760a.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/g762.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/gl518sm.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/gl520sm.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-20T04:07:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/i5500_temp.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/i5k_amb.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ibmaem.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ibmpex.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ina209.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ina2xx.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/it87.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/k10temp.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/k8temp.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lineage-pem.ko 2023-12-20T04:07:56.738 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm63.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm73.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm75.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm77.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm78.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm80.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm83.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm85.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm87.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm90.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm92.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm93.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm95234.ko 2023-12-20T04:07:56.739 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm95241.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/lm95245.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ltc2945.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ltc4151.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ltc4215.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ltc4222.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ltc4245.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ltc4260.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/ltc4261.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/max16065.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/max1619.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/max1668.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/max197.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/max6639.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/max6650.ko 2023-12-20T04:07:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/max6697.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/mcp3021.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/nct6683.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/nct6775-core.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/nct6775.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/nct7802.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pc87360.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pc87427.ko 2023-12-20T04:07:56.741 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pcf8591.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-20T04:07:56.742 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/powr1220.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/sch5627.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/sch5636.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/sht15.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/sht21.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/shtc1.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/sis5595.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/smsc47b397.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/smsc47m1.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/smsc47m192.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/thmc50.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/tmp102.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/tmp103.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/tmp401.ko 2023-12-20T04:07:56.743 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/tmp421.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/via-cputemp.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/via686a.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/vt1211.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/vt8231.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83627ehf.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83627hf.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83781d.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83791d.ko 2023-12-20T04:07:56.744 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83792d.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83793.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83795.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83l785ts.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/hwmon/w83l786ng.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/algos 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-20T04:07:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-20T04:07:56.746 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/i2c-dev.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/i2c-mux.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/i2c-smbus.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/i2c/i2c-stub.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core/ib_core.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-20T04:07:56.747 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/cxgb4 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/mlx4 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/mlx5 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/mthca 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/ipoib 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-20T04:07:56.748 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/iser 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/isert 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/srp 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/srpt 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-20T04:07:56.749 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/gameport 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/gameport/gameport.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/joydev.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/keyboard 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/appletouch.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/bcm5974.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/cyapatp.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/sermouse.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-20T04:07:56.750 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/rmi4 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/serio 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/serio/altera_ps2.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/serio/arc_ps2.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/serio/serio_raw.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/input/sparse-keymap.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/iommu 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/iommu/amd 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-20T04:07:56.751 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/leds-blinkm.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/leds-lm3530.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/leds-lp3944.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/leds-ss4200.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-20T04:07:56.752 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/bcache 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/bcache/bcache.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-bio-prison.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-cache-smq.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-cache.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-crypt.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-delay.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-flakey.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-log-userspace.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-multipath.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-queue-length.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-raid.ko 2023-12-20T04:07:56.753 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-round-robin.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-service-time.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-switch.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-thin-pool.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/dm-verity.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/faulty.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/linear.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/multipath.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/persistent-data 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/raid0.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/raid1.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/raid10.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/md/raid456.ko 2023-12-20T04:07:56.754 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion/mptbase.ko 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion/mptctl.ko 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion/mptfc.ko 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion/mptlan.ko 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion/mptsas.ko 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion/mptscsih.ko 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/message/fusion/mptspi.ko 2023-12-20T04:07:56.755 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd/lpc_ich.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd/lpc_sch.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd/mfd-core.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd/sm501.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd/viperboard.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd/vx855.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/mfd/wl1273-core.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/altera-stapl 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/apds9802als.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/apds990x.ko 2023-12-20T04:07:56.756 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/bh1770glc.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/cb710 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/cb710/cb710.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/eeprom 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/eeprom/at24.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/eeprom/max6875.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/enclosure.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/hpilo.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/isl29003.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/isl29020.ko 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/lis3lv02d 2023-12-20T04:07:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/mei 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/mei/mei-me.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/mei/mei-txe.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/mei/mei.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/sgi-gru 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/sgi-xp 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/tifm_7xx1.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/tifm_core.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/tsl2550.ko 2023-12-20T04:07:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/vmw_balloon.ko 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/vmw_vmci 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/bonding 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/bonding/bonding.ko 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dsa 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dsa/b53 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dsa/mv88e6xxx 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-20T04:07:56.759 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/dummy.ko 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/eql.ko 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/3com 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/8390 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-20T04:07:56.760 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/adaptec 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/agere 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/alteon 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/altera 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-20T04:07:56.761 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/amd 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/alx 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-20T04:07:56.762 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-20T04:07:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/atlx 2023-12-20T04:07:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-20T04:07:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-20T04:07:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom 2023-12-20T04:07:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-20T04:07:56.763 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-20T04:07:56.764 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-20T04:07:56.764 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-20T04:07:56.764 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-20T04:07:56.764 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/genet 2023-12-20T04:07:56.764 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-20T04:07:56.764 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-20T04:07:56.764 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/brocade 2023-12-20T04:07:56.765 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/brocade/bna 2023-12-20T04:07:56.765 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-20T04:07:56.765 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio 2023-12-20T04:07:56.765 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-20T04:07:56.765 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-20T04:07:56.765 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-20T04:07:56.765 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/cisco 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/cisco/enic 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec/tulip 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-20T04:07:56.766 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dlink 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/dnet.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/emulex 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/emulex/benet 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/ethoc.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/fealnx.ko 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel 2023-12-20T04:07:56.767 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/e1000 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/e1000e 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/fm10k 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/i40e 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/iavf 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/igb 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/igbvf 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-20T04:07:56.768 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/jme.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/marvell 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/mellanox 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-20T04:07:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/micrel 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/myricom 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/natsemi 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-20T04:07:56.770 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/neterion 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/nvidia 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/packetengines 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/qlogic 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-20T04:07:56.771 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/rdc 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/realtek 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/rocker 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sfc 2023-12-20T04:07:56.772 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/silan 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sis 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/smsc 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-20T04:07:56.773 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/stmicro 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sun 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/tehuti 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/ti 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-20T04:07:56.774 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/via 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/wiznet 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/xircom 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/geneve.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/hyperv 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ieee802154 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ifb.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ipvlan 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-20T04:07:56.775 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/macvlan.ko 2023-12-20T04:07:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/macvtap.ko 2023-12-20T04:07:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/mdio 2023-12-20T04:07:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/mdio.ko 2023-12-20T04:07:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-20T04:07:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-20T04:07:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-20T04:07:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/mii.ko 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/net_failover.ko 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/netconsole.ko 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/nlmon.ko 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/pcs 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy 2023-12-20T04:07:56.777 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/amd.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/bcm87xx.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/broadcom.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/cicada.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/davicom.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/dp83640.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/et1011c.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/icplus.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/lxt.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/marvell.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/micrel.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/national.ko 2023-12-20T04:07:56.778 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/phylink.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/qsemi.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/realtek.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/smsc.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/ste10Xp.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/phy/vitesse.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/ppp_async.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/pppoe.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/pppox.ko 2023-12-20T04:07:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/ppp/pptp.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/slip 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/slip/slhc.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/slip/slip.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/sungem_phy.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/tap.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/team 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/team/team.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/team/team_mode_random.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/tun.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/veth.ko 2023-12-20T04:07:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/virtio_net.ko 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/vmxnet3 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/vxlan 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/vxlan/vxlan.ko 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/xen-netback 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/net/xen-netfront.ko 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ntb 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ntb/ntb.ko 2023-12-20T04:07:56.781 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/nvme 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/nvme/host 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/nvme/host/nvme-core.ko 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/nvme/host/nvme.ko 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/parport 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/parport/parport.ko 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/parport/parport_cs.ko 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/parport/parport_pc.ko 2023-12-20T04:07:56.782 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/parport/parport_serial.ko 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pci 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pci/hotplug 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pci/pcie 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pci/xen-pcifront.ko 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pcmcia 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pcmcia/i82092.ko 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pcmcia/pd6729.ko 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-20T04:07:56.783 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pinctrl 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pinctrl/intel 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/acerhdf.ko 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-20T04:07:56.784 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-20T04:07:56.785 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/hdaps.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/intel 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/intel_ips.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-20T04:07:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-20T04:07:56.787 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-20T04:07:56.787 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-20T04:07:56.787 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-20T04:07:56.787 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/platform/x86/wmi.ko 2023-12-20T04:07:56.787 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/powercap 2023-12-20T04:07:56.787 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-20T04:07:56.787 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-20T04:07:56.788 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pps 2023-12-20T04:07:56.788 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pps/clients 2023-12-20T04:07:56.788 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-20T04:07:56.788 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-20T04:07:56.788 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pps/clients/pps_parport.ko 2023-12-20T04:07:56.788 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/pps/pps_core.ko 2023-12-20T04:07:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ptp 2023-12-20T04:07:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ptp/ptp.ko 2023-12-20T04:07:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ptp/ptp_kvm.ko 2023-12-20T04:07:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc 2023-12-20T04:07:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-20T04:07:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-20T04:07:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-em3027.ko 2023-12-20T04:07:56.790 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-max6900.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-20T04:07:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-20T04:07:56.792 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-20T04:07:56.792 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-20T04:07:56.792 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-20T04:07:56.792 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-20T04:07:56.792 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-20T04:07:56.792 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-20T04:07:56.792 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-20T04:07:56.793 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-20T04:07:56.793 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-20T04:07:56.793 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-20T04:07:56.793 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/rtc/rtc-x1205.ko 2023-12-20T04:07:56.793 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi 2023-12-20T04:07:56.793 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/3w-9xxx.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/3w-sas.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/3w-xxxx.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/BusLogic.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/a100u2w.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/aacraid 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/advansys.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/aic7xxx 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-20T04:07:56.794 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/am53c974.ko 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/arcmsr 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/atp870u.ko 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/be2iscsi 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/bfa 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/bfa/bfa.ko 2023-12-20T04:07:56.795 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/bnx2fc 2023-12-20T04:07:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-20T04:07:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/bnx2i 2023-12-20T04:07:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-20T04:07:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/ch.ko 2023-12-20T04:07:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/csiostor 2023-12-20T04:07:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-20T04:07:56.796 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/cxgbi 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/dc395x.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/device_handler 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/dmx3191d.ko 2023-12-20T04:07:56.797 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/esas2r 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/esp_scsi.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/fcoe 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/fnic 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/fnic/fnic.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/hpsa.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/hptiop.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/hv_storvsc.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/initio.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/ipr.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/ips.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/isci 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/isci/isci.ko 2023-12-20T04:07:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/libfc 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/libfc/libfc.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/libiscsi.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/libsas 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/libsas/libsas.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/lpfc 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/megaraid 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/megaraid.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-20T04:07:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/mpt3sas 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/mvsas 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/mvumi.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/pm8001 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/pmcraid.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/qla1280.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/qla2xxx 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/qla4xxx 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/raid_class.ko 2023-12-20T04:07:56.800 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/scsi_debug.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/ses.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/st.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/stex.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/sym53c8xx_2 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/virtio_scsi.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/scsi/wd719x.ko 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ssb 2023-12-20T04:07:56.801 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ssb/ssb.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/iscsi 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/loopback 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/target_core_file.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/target_core_iblock.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/target_core_mod.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/target_core_pscsi.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/target_core_user.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/tcm_fc 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel 2023-12-20T04:07:56.802 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-20T04:07:56.803 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/ipwireless 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/n_gsm.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/n_hdlc.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/nozomi.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/serial 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/serial/8250 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/serial/arc_uart.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/serial/jsm 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ufs 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ufs/core 2023-12-20T04:07:56.804 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ufs/host 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/uio 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/uio/uio.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/uio/uio_aec.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/uio/uio_cif.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/uio/uio_pci_generic.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/uio/uio_sercos3.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/class 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/class/cdc-acm.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/class/usblp.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/class/usbtmc.ko 2023-12-20T04:07:56.805 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/host 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/image 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/image/mdc800.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/image/microtek.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/adutux.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/appledisplay.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/emi26.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/emi62.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/ezusb.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/idmouse.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/iowarrior.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/ldusb.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/legousbtower.ko 2023-12-20T04:07:56.806 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/sisusbvga 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/usb3503.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/usblcd.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/uss720.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/misc/yurex.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/phy 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/phy/phy-generic.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/aircable.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ark3116.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ch341.ko 2023-12-20T04:07:56.807 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/cp210x.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/cyberjack.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/empeg.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/io_ti.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ipaq.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ipw.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ir-usb.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/keyspan.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-20T04:07:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/mct_u232.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/mos7720.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/mos7840.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/navman.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/omninet.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/opticon.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/option.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/oti6858.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/pl2303.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/qcaux.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/qcserial.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/quatech2.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/safe_serial.ko 2023-12-20T04:07:56.809 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/sierra.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ssu100.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/symbolserial.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/usb_debug.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/visor.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/whiteheat.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/uas.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-20T04:07:56.810 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-karma.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/storage/usb-storage.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/usbip 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-20T04:07:56.811 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vfio 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vfio/pci 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vfio/vfio.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vhost 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vhost/vhost.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vhost/vhost_net.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/vhost/vhost_scsi.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/video 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/video/backlight 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/video/backlight/apple_bl.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/video/backlight/lcd.ko 2023-12-20T04:07:56.812 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio/virtio.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio/virtio_balloon.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio/virtio_mmio.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio/virtio_pci.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/virtio/virtio_ring.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/masters 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/masters/ds2482.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/masters/ds2490.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-20T04:07:56.813 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/w1/wire.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/hpwdt.ko 2023-12-20T04:07:56.814 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/i6300esb.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/ib700wdt.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/ibmasr.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/it87_wdt.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/machzwd.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/nv_tco.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/softdog.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-20T04:07:56.815 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/via_wdt.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/wdt_pci.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/watchdog/xen_wdt.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xen-evtchn.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xen-gntalloc.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xen-gntdev.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xen-pciback 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xen-privcmd.ko 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xenfs 2023-12-20T04:07:56.816 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/9p 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/9p/9p.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/affs 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/affs/affs.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/befs 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/befs/befs.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/binfmt_misc.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/btrfs 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/btrfs/btrfs.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/cachefiles 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/cachefiles/cachefiles.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ceph 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ceph/ceph.ko 2023-12-20T04:07:56.817 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/coda 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/coda/coda.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/cramfs 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/cramfs/cramfs.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/dlm 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/dlm/dlm.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ecryptfs 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/f2fs 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/f2fs/f2fs.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fat 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fat/fat.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fat/msdos.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fat/vfat.ko 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fscache 2023-12-20T04:07:56.818 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fscache/fscache.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fuse 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fuse/cuse.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/fuse/fuse.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/gfs2 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/gfs2/gfs2.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/hfs 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/hfs/hfs.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/hfsplus 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/hfsplus/hfsplus.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/isofs 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/isofs/isofs.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/jfs 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/jfs/jfs.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/lockd 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/lockd/lockd.ko 2023-12-20T04:07:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/minix 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/minix/minix.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/netfs 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/netfs/netfs.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/blocklayout 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/filelayout 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/flexfilelayout 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/nfs.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/nfsv3.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs/nfsv4.ko 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs_common 2023-12-20T04:07:56.820 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs_common/grace.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfs_common/nfs_acl.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfsd 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nfsd/nfsd.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nilfs2 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nilfs2/nilfs2.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-celtic.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-centeuro.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-croatian.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-cyrillic.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-gaelic.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-greek.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-iceland.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-inuit.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-roman.ko 2023-12-20T04:07:56.821 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-romanian.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/mac-turkish.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp1250.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp1251.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp1255.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp737.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp775.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp850.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp852.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp855.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp857.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp860.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp861.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp862.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp863.ko 2023-12-20T04:07:56.822 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp864.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp865.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp866.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp869.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp874.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp932.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp936.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp949.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_cp950.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_euc-jp.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-1.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-13.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-14.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-15.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-2.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-3.ko 2023-12-20T04:07:56.823 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-4.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-5.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-6.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-7.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_iso8859-9.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_koi8-r.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_koi8-ru.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_koi8-u.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/nls/nls_utf8.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/cluster 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/dlm 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/dlmfs 2023-12-20T04:07:56.824 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/ocfs2.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/overlayfs 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/overlayfs/overlay.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/pstore 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/pstore/ramoops.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/reiserfs 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/reiserfs/reiserfs.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/romfs 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/romfs/romfs.ko 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/smb 2023-12-20T04:07:56.825 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/smb/client 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/smb/client/cifs.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/smb/common 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/smb/common/cifs_arc4.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/smb/common/cifs_md4.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/squashfs 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/squashfs/squashfs.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/sysv 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/sysv/sysv.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/udf 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/udf/udf.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ufs 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/ufs/ufs.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/xfs 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/fs/xfs/xfs.ko 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/kernel 2023-12-20T04:07:56.826 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/kernel/rcu 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/kernel/rcu/rcutorture.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/kernel/torture.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/kernel/trace 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/asn1_encoder.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/crc-itu-t.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/crc8.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/crypto 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/crypto/libarc4.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/crypto/libdes.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/libcrc32c.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/lru_cache.ko 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/lz4 2023-12-20T04:07:56.827 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/lz4/lz4_compress.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/lz4/lz4hc_compress.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/math 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/math/cordic.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/raid6 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/raid6/raid6_pq.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/reed_solomon 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/ts_bm.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/ts_fsm.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/ts_kmp.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/zstd 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/lib/zstd/zstd_compress.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/mm 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/mm/hwpoison-inject.ko 2023-12-20T04:07:56.828 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/6lowpan.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/nhc_dest.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/nhc_fragment.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/nhc_hop.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/nhc_mobility.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/nhc_routing.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/6lowpan/nhc_udp.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/802 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/802/garp.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/802/mrp.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/802/p8022.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/802/psnap.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/802/stp.ko 2023-12-20T04:07:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/8021q 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/8021q/8021q.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/9p 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/9p/9pnet.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/9p/9pnet_fd.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/9p/9pnet_rdma.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/9p/9pnet_virtio.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/batman-adv 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/batman-adv/batman-adv.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/br_netfilter.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/bridge.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-20T04:07:56.830 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-20T04:07:56.831 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/ebtables.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ceph 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ceph/libceph.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/core 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/core/failover.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/core/pktgen.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dccp 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dccp/dccp.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dccp/dccp_diag.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dccp/dccp_ipv4.ko 2023-12-20T04:07:56.832 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dccp/dccp_ipv6.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dns_resolver 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dns_resolver/dns_resolver.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dsa 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dsa/dsa_core.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dsa/tag_brcm.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dsa/tag_dsa.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dsa/tag_none.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/dsa/tag_trailer.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ieee802154 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ieee802154/6lowpan 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ieee802154/ieee802154.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4 2023-12-20T04:07:56.833 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/ah4.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/esp4.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/fou.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/gre.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/inet_diag.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/ip_gre.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/ip_tunnel.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/ip_vti.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/ipcomp.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/ipip.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-20T04:07:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-20T04:07:56.835 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_bic.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_dctcp.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_diag.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_highspeed.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_htcp.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_hybla.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_illinois.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_lp.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_scalable.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_vegas.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_veno.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_westwood.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tcp_yeah.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/tunnel4.ko 2023-12-20T04:07:56.836 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/udp_diag.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/udp_tunnel.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/ah6.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/esp6.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/fou6.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/ip6_tunnel.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/ip6_vti.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/ipcomp6.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-20T04:07:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-20T04:07:56.838 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/sit.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/tunnel6.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/key 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/key/af_key.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp/l2tp_core.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp/l2tp_eth.ko 2023-12-20T04:07:56.839 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp/l2tp_ip.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp/l2tp_ip6.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp/l2tp_netlink.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/l2tp/l2tp_ppp.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/llc 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/llc/llc.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/mac802154 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/mac802154/mac802154.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/mpls 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/mpls/mpls_gso.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-20T04:07:56.840 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-20T04:07:56.841 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conncount.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-20T04:07:56.842 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_flow_table.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_log_syslog.ko 2023-12-20T04:07:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_nat.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_nat_irc.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_nat_sip.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nf_tables.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nfnetlink.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nfnetlink_log.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_chain_nat.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_compat.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_ct.ko 2023-12-20T04:07:56.844 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_fib.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_hash.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_limit.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_log.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_masq.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_nat.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_numgen.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_queue.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_quota.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_redir.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_reject.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_reject_inet.ko 2023-12-20T04:07:56.845 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_socket.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/nft_tunnel.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_AUDIT.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_CT.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_DSCP.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_HL.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_HMARK.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_LED.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_LOG.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_NETMAP.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_NFLOG.ko 2023-12-20T04:07:56.846 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_RATEEST.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_SECMARK.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_TEE.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_TPROXY.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_TRACE.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_addrtype.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_bpf.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_cgroup.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_cluster.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_comment.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_connbytes.ko 2023-12-20T04:07:56.847 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_connlabel.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_connlimit.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_connmark.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_conntrack.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_cpu.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_dccp.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_devgroup.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_dscp.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_ecn.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_esp.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_hashlimit.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_helper.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_hl.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_ipcomp.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_iprange.ko 2023-12-20T04:07:56.848 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_ipvs.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_l2tp.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_length.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_limit.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_mac.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_mark.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_multiport.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_nat.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_nfacct.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_osf.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_owner.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_physdev.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_pkttype.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_policy.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_quota.ko 2023-12-20T04:07:56.849 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_rateest.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_realm.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_recent.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_sctp.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_set.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_socket.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_state.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_statistic.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_string.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_tcpmss.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_time.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netfilter/xt_u32.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netlink 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/netlink/netlink_diag.ko 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/nsh 2023-12-20T04:07:56.850 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/nsh/nsh.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/openvswitch 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/openvswitch/openvswitch.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/openvswitch/vport-geneve.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/openvswitch/vport-gre.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/openvswitch/vport-vxlan.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/packet 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/packet/af_packet_diag.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/rds 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/rds/rds.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/rds/rds_rdma.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/rds/rds_tcp.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_csum.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_gact.ko 2023-12-20T04:07:56.851 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_ipt.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_mirred.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_nat.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_pedit.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_police.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_simple.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_skbedit.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/act_vlan.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/cls_basic.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/cls_bpf.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/cls_flow.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/cls_fw.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/cls_route.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/cls_u32.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/em_cmp.ko 2023-12-20T04:07:56.852 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/em_ipset.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/em_meta.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/em_nbyte.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/em_text.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/em_u32.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_choke.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_codel.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_drr.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_fq.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_gred.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_hfsc.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_hhf.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_htb.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_ingress.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_mqprio.ko 2023-12-20T04:07:56.853 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_mqprio_lib.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_multiq.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_netem.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_pie.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_plug.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_prio.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_qfq.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_red.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_sfb.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_sfq.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_tbf.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sched/sch_teql.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sctp 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sctp/sctp.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sctp/sctp_diag.ko 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sunrpc 2023-12-20T04:07:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sunrpc/auth_gss 2023-12-20T04:07:56.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-20T04:07:56.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-20T04:07:56.855 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sunrpc/sunrpc.ko 2023-12-20T04:07:56.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sunrpc/xprtrdma 2023-12-20T04:07:56.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-20T04:07:56.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/tipc 2023-12-20T04:07:56.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/tipc/diag.ko 2023-12-20T04:07:56.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/tipc/tipc.ko 2023-12-20T04:07:56.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/unix 2023-12-20T04:07:56.856 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/unix/unix_diag.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/vmw_vsock 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/vmw_vsock/vsock.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/xfrm 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/security 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/security/keys 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/security/keys/encrypted-keys 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/security/keys/trusted-keys 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/security/keys/trusted-keys/trusted.ko 2023-12-20T04:07:56.857 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/virt 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/virt/lib 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/kernel/virt/lib/irqbypass.ko 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.alias 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.alias.bin 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.builtin 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.builtin.alias.bin 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.builtin.bin 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.builtin.modinfo 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.dep 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.dep.bin 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.devname 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.order 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.softdep 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.symbols 2023-12-20T04:07:56.858 INFO:teuthology.orchestra.run.smithi081.stdout:/lib/modules/6.6.0-g93572f31db89/modules.symbols.bin 2023-12-20T04:07:56.859 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g93572f31db89 2023-12-20T04:07:56.859 DEBUG:teuthology.orchestra.run.smithi081:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-20T04:07:56.882 INFO:teuthology.orchestra.run.smithi081.stdout:postinstall scriptlet (using /bin/sh): 2023-12-20T04:07:56.882 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g93572f31db89 -a -r /boot/System.map-6.6.0-g93572f31db89 ]; then 2023-12-20T04:07:56.882 INFO:teuthology.orchestra.run.smithi081.stdout:cp /boot/vmlinuz-6.6.0-g93572f31db89 /boot/.vmlinuz-6.6.0-g93572f31db89-rpm 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:cp /boot/System.map-6.6.0-g93572f31db89 /boot/.System.map-6.6.0-g93572f31db89-rpm 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:rm -f /boot/vmlinuz-6.6.0-g93572f31db89 /boot/System.map-6.6.0-g93572f31db89 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/installkernel 6.6.0-g93572f31db89 /boot/.vmlinuz-6.6.0-g93572f31db89-rpm /boot/.System.map-6.6.0-g93572f31db89-rpm 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:rm -f /boot/.vmlinuz-6.6.0-g93572f31db89-rpm /boot/.System.map-6.6.0-g93572f31db89-rpm 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:new-kernel-pkg --remove 6.6.0-g93572f31db89 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g93572f31db89.img 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-install remove 6.6.0-g93572f31db89 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/update-bootloader --remove 6.6.0-g93572f31db89 2023-12-20T04:07:56.883 INFO:teuthology.orchestra.run.smithi081.stdout:fi 2023-12-20T04:07:56.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2023-12-20T04:07:56.971 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2023-12-20T04:07:56.971 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2023-12-20T04:07:56.971 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 68.el9 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8264254 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2023-12-20T04:07:56.972 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2023-12-20T04:07:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:07:56.973 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-20T04:07:56.973 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-20T04:07:56.973 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-20T04:07:56.973 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2023-12-20T04:07:56.973 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:07:56.973 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2023-12-20T04:07:56.974 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-20T04:07:56.974 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 6.6.0-g93572f31db89 2023-12-20T04:07:56.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-20T04:07:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2023-12-20T04:07:58.977 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-20T04:07:59.017 INFO:teuthology.orchestra.run.smithi081.stderr:done 2023-12-20T04:07:59.020 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-12-20T04:07:59.035 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.eEKoqBJjDW 2023-12-20T04:07:59.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eEKoqBJjDW 2023-12-20T04:07:59.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.eEKoqBJjDW 2023-12-20T04:07:59.241 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.eEKoqBJjDW is 6KB 2023-12-20T04:07:59.292 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.eEKoqBJjDW 2023-12-20T04:07:59.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2023-12-20T04:07:59.370 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-20T04:07:59.370 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-20T04:07:59.370 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-20T04:07:59.370 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g93572f31db89.conf 2023-12-20T04:07:59.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g93572f31db89 2023-12-20T04:07:59.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2023-12-20T04:08:29.534 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-20T04:08:29.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-20T04:08:29.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:09:04.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-20T04:09:13.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-20T04:09:13.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:09:31.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-20T04:09:43.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-20T04:09:43.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:09:46.481 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-12-20T04:10:01.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-20T04:10:01.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:10:01.957 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-12-20T04:10:02.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-20T04:10:02.752 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g93572f31db89"... 2023-12-20T04:10:02.752 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-12-20T04:10:02.790 INFO:teuthology.orchestra.run.smithi081.stdout:6.6.0-g93572f31db89 2023-12-20T04:10:02.791 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g93572f31db89 vs 6.6.0-g93572f31db89 2023-12-20T04:10:02.791 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-20T04:10:02.791 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-20T04:10:03.791 DEBUG:teuthology.parallel:result is None 2023-12-20T04:10:03.792 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-20T04:10:03.803 INFO:teuthology.task.internal:Creating test directory... 2023-12-20T04:10:03.804 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-20T04:10:03.806 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-20T04:10:03.809 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-20T04:10:03.899 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-20T04:10:03.910 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-20T04:10:03.935 INFO:teuthology.task.internal:Creating archive directory... 2023-12-20T04:10:03.935 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-20T04:10:03.938 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-20T04:10:03.940 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-20T04:10:04.042 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-20T04:10:04.053 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-20T04:10:04.053 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-20T04:10:04.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:10:04.071 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-20T04:10:04.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:10:04.088 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-20T04:10:04.113 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-20T04:10:04.131 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-20T04:10:04.154 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:10:04.182 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:10:04.188 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:10:04.210 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:10:04.335 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:10:04.415 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:10:04.420 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-20T04:10:04.429 INFO:teuthology.task.internal:Configuring sudo... 2023-12-20T04:10:04.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-20T04:10:04.432 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-20T04:10:04.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-20T04:10:04.570 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-20T04:10:04.585 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-20T04:10:04.585 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-20T04:10:04.588 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-20T04:10:04.590 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-20T04:10:04.672 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:10:04.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:10:04.779 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:10:04.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:10:04.871 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:10:04.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-20T04:10:04.945 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:10:04.984 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:10:05.044 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:10:05.128 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:10:05.174 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:10:05.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-20T04:10:05.242 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:10:05.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:10:05.416 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:10:05.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:10:05.585 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:10:05.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-20T04:10:05.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-12-20T04:10:05.660 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2023-12-20T04:10:05.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-12-20T04:10:05.701 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T04:10:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T04:10:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T04:10:06.115 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-20T04:10:06.125 INFO:teuthology.task.internal:Starting timer... 2023-12-20T04:10:06.125 INFO:teuthology.run_tasks:Running task pcp... 2023-12-20T04:10:06.179 INFO:teuthology.run_tasks:Running task selinux... 2023-12-20T04:10:06.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2023-12-20T04:10:06.275 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2023-12-20T04:10:06.277 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2023-12-20T04:10:06.348 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2023-12-20T04:10:06.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2023-12-20T04:10:06.471 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2023-12-20T04:10:06.475 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-20T04:10:06.475 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2023-12-20T04:10:06.498 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2023-12-20T04:10:06.499 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2023-12-20T04:10:06.519 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2023-12-20T04:10:06.520 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2023-12-20T04:10:06.822 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2023-12-20T04:10:06.823 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi081.front.sepia.ceph.com': 'permissive'} 2023-12-20T04:10:06.823 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T04:10:06.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:10:06.855 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T04:10:06.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:10:06.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T04:10:06.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:10:06.975 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-20T04:10:06.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2023-12-20T04:10:07.015 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2023-12-20T04:10:07.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2023-12-20T04:10:07.179 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-20T04:10:07.190 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-20T04:10:07.197 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-20T04:10:07.328 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-20T04:10:07.350 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-20T04:10:07.351 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi069.front.sepia.ceph.com,smithi081.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-20T04:20:25.569 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com')] 2023-12-20T04:20:25.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-20T04:20:25.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:20:25.670 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-12-20T04:20:25.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-12-20T04:20:25.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-20T04:20:25.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:20:25.824 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-12-20T04:20:25.897 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-20T04:20:25.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-20T04:20:25.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:20:26.039 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-12-20T04:20:26.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-12-20T04:20:26.199 INFO:teuthology.run_tasks:Running task clock... 2023-12-20T04:20:26.212 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-20T04:20:26.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-20T04:20:26.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T04:20:26.215 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-20T04:20:26.215 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T04:20:26.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-20T04:20:26.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T04:20:26.250 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-20T04:20:26.252 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-20T04:20:26.267 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-20T04:20:26.273 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-20T04:20:26.299 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2023-12-20T04:20:26.312 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2023-12-20T04:20:26.312 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2023-12-20T04:20:26.318 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-20T04:20:26.329 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2023-12-20T04:20:26.330 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-20T04:20:26.346 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-20T04:20:26.350 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-20T04:20:26.370 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-20T04:20:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-20T04:20:26.390 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2023-12-20T04:20:26.393 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T04:20:26.393 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-20T04:20:26.393 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.393 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.393 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.393 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2023-12-20T04:20:26.422 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T04:20:26.422 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-12-20T04:20:26.422 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.422 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.422 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.422 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2023-12-20T04:20:26.507 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2023-12-20T04:20:26.559 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-20T04:20:26.611 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-20T04:20:26.733 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2023-12-20T04:20:26.742 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T04:20:26.742 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-12-20T04:20:26.743 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.743 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.743 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.743 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:20:26.744 INFO:teuthology.run_tasks:Running task install... 2023-12-20T04:20:26.754 DEBUG:teuthology.task.install:project ceph 2023-12-20T04:20:26.754 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}} 2023-12-20T04:20:26.754 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'} 2023-12-20T04:20:26.754 INFO:teuthology.task.install:Using flavor: default 2023-12-20T04:20:26.760 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-20T04:20:26.760 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-20T04:20:26.760 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-20T04:20:26.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:20:26.762 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-20T04:20:26.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:20:26.763 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-20T04:20:26.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:20:26.929 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-20T04:20:26.929 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-20T04:20:26.954 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-20T04:20:26.954 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-20T04:20:27.016 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-20T04:20:27.016 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-20T04:20:27.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-20T04:20:27.120 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:20:27.120 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-20T04:20:27.134 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-20T04:20:27.134 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:20:27.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-20T04:20:27.150 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-20T04:20:27.151 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-20T04:20:27.197 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-20T04:20:27.197 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:20:27.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-20T04:20:27.222 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-20T04:20:27.234 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-20T04:20:27.234 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-20T04:20:27.240 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-20T04:20:27.241 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-20T04:20:27.306 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-20T04:20:27.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-20T04:20:27.374 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2023-12-20T04:20:27.376 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2023-12-20T04:20:27.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-20T04:20:27.402 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-20T04:20:27.434 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-12-20T04:20:27.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-12-20T04:20:27.517 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-20T04:20:27.610 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2023-12-20T04:20:27.610 INFO:teuthology.orchestra.run.smithi069.stdout:73 files removed 2023-12-20T04:20:27.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2023-12-20T04:20:27.637 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-20T04:20:27.684 INFO:teuthology.orchestra.run.smithi040.stdout:73 files removed 2023-12-20T04:20:27.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-20T04:20:27.973 INFO:teuthology.orchestra.run.smithi081.stdout:73 files removed 2023-12-20T04:20:28.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-20T04:20:28.306 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 204 kB/s | 77 kB 00:00 2023-12-20T04:20:28.337 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 246 kB/s | 77 kB 00:00 2023-12-20T04:20:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-12-20T04:20:28.773 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2023-12-20T04:20:29.010 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 159 kB/s | 77 kB 00:00 2023-12-20T04:20:29.180 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2023-12-20T04:20:29.182 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2023-12-20T04:20:29.660 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 17 kB/s | 9.5 kB 00:00 2023-12-20T04:20:29.675 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-12-20T04:20:29.685 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-20T04:20:30.169 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2023-12-20T04:20:30.831 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-20T04:20:31.152 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2023-12-20T04:20:31.166 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-12-20T04:20:32.557 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2023-12-20T04:20:32.780 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 7.9 MB 00:01 2023-12-20T04:20:33.220 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 7.9 MB 00:01 2023-12-20T04:20:33.984 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 7.9 MB 00:01 2023-12-20T04:20:36.059 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 18 MB 00:02 2023-12-20T04:20:36.960 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 18 MB 00:02 2023-12-20T04:20:37.170 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 18 MB 00:01 2023-12-20T04:20:41.486 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 5.8 MB 00:01 2023-12-20T04:20:41.609 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 5.8 MB 00:02 2023-12-20T04:20:42.288 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.8 MB 00:01 2023-12-20T04:20:43.309 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2023-12-20T04:20:43.787 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 15 kB 00:01 2023-12-20T04:20:43.939 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2023-12-20T04:20:45.750 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 20 MB 00:02 2023-12-20T04:20:46.338 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 20 MB 00:02 2023-12-20T04:20:47.405 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 5.6 MB/s | 20 MB 00:03 2023-12-20T04:20:50.755 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-20T04:20:51.907 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-20T04:20:52.138 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2023-12-20T04:20:53.216 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:20:53.216 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:20:53.228 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-20T04:20:53.229 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-20T04:20:53.230 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-20T04:20:53.231 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-20T04:20:53.233 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-20T04:20:53.236 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-20T04:20:53.236 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:20:53.315 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-12-20T04:20:53.330 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-20T04:20:53.331 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-20T04:20:53.332 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-20T04:20:53.333 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-20T04:20:53.334 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:20:53.335 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-20T04:20:53.336 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-20T04:20:53.337 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-20T04:20:53.338 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-20T04:20:53.339 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-20T04:20:53.340 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-20T04:20:53.341 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-20T04:20:53.342 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:20:53.343 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-12-20T04:20:53.344 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================== 2023-12-20T04:20:53.344 INFO:teuthology.orchestra.run.smithi040.stdout:Install 139 Packages 2023-12-20T04:20:53.344 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 15 Packages 2023-12-20T04:20:53.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:20:53.344 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 200 M 2023-12-20T04:20:53.344 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-12-20T04:20:54.256 INFO:teuthology.orchestra.run.smithi040.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2023-12-20T04:20:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:20:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:20:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-20T04:20:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-20T04:20:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-20T04:20:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-20T04:20:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-20T04:20:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-20T04:20:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:20:54.600 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-12-20T04:20:54.614 INFO:teuthology.orchestra.run.smithi040.stdout:(2/154): ceph-base-18.2.1-132.g568df92b.el9.x86 8.8 MB/s | 5.2 MB 00:00 2023-12-20T04:20:54.621 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================== 2023-12-20T04:20:54.621 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-12-20T04:20:54.621 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================== 2023-12-20T04:20:54.621 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-12-20T04:20:54.621 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-20T04:20:54.621 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-20T04:20:54.622 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-20T04:20:54.623 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-20T04:20:54.624 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-20T04:20:54.625 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-20T04:20:54.626 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-20T04:20:54.627 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-20T04:20:54.628 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-20T04:20:54.629 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-20T04:20:54.630 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-20T04:20:54.631 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-20T04:20:54.632 INFO:teuthology.orchestra.run.smithi069.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout:=========================================================================================== 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout:Install 139 Packages 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 15 Packages 2023-12-20T04:20:54.633 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:20:54.634 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:20:54.634 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:20:54.634 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 200 M 2023-12-20T04:20:54.634 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-12-20T04:20:54.647 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-20T04:20:54.648 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-20T04:20:54.650 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-20T04:20:54.651 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-20T04:20:54.654 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-20T04:20:54.658 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-20T04:20:54.659 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:20:54.681 INFO:teuthology.orchestra.run.smithi040.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 2.1 MB/s | 142 kB 00:00 2023-12-20T04:20:54.741 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================== 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================== 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-20T04:20:54.773 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-20T04:20:54.774 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-20T04:20:54.775 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-20T04:20:54.776 INFO:teuthology.orchestra.run.smithi081.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-20T04:20:54.777 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-20T04:20:54.778 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-20T04:20:54.779 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-20T04:20:54.780 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-20T04:20:54.781 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-20T04:20:54.782 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-20T04:20:54.783 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-20T04:20:54.784 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:20:54.785 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-20T04:20:54.785 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================== 2023-12-20T04:20:54.785 INFO:teuthology.orchestra.run.smithi081.stdout:Install 139 Packages 2023-12-20T04:20:54.785 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 15 Packages 2023-12-20T04:20:54.785 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:20:54.785 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 200 M 2023-12-20T04:20:54.785 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-12-20T04:20:54.907 INFO:teuthology.orchestra.run.smithi040.stdout:(4/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 9.4 MB/s | 2.1 MB 00:00 2023-12-20T04:20:55.057 INFO:teuthology.orchestra.run.smithi040.stdout:(5/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 9.7 MB/s | 1.4 MB 00:00 2023-12-20T04:20:55.082 INFO:teuthology.orchestra.run.smithi040.stdout:(6/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 1.0 MB/s | 840 kB 00:00 2023-12-20T04:20:55.424 INFO:teuthology.orchestra.run.smithi040.stdout:(7/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 12 MB/s | 4.4 MB 00:00 2023-12-20T04:20:55.457 INFO:teuthology.orchestra.run.smithi069.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 18 kB/s | 6.5 kB 00:00 2023-12-20T04:20:55.650 INFO:teuthology.orchestra.run.smithi040.stdout:(8/154): ceph-common-18.2.1-132.g568df92b.el9.x 11 MB/s | 18 MB 00:01 2023-12-20T04:20:55.716 INFO:teuthology.orchestra.run.smithi040.stdout:(9/154): ceph-selinux-18.2.1-132.g568df92b.el9. 363 kB/s | 24 kB 00:00 2023-12-20T04:20:55.985 INFO:teuthology.orchestra.run.smithi040.stdout:(10/154): ceph-radosgw-18.2.1-132.g568df92b.el9 14 MB/s | 7.7 MB 00:00 2023-12-20T04:20:56.058 INFO:teuthology.orchestra.run.smithi040.stdout:(11/154): cephfs-mirror-18.2.1-132.g568df92b.el 2.9 MB/s | 219 kB 00:00 2023-12-20T04:20:56.125 INFO:teuthology.orchestra.run.smithi040.stdout:(12/154): cephfs-shell-18.2.1-132.g568df92b.el9 406 kB/s | 27 kB 00:00 2023-12-20T04:20:56.159 INFO:teuthology.orchestra.run.smithi081.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 19 kB/s | 6.5 kB 00:00 2023-12-20T04:20:56.192 INFO:teuthology.orchestra.run.smithi040.stdout:(13/154): libcephfs-devel-18.2.1-132.g568df92b. 467 kB/s | 31 kB 00:00 2023-12-20T04:20:56.206 INFO:teuthology.orchestra.run.smithi069.stdout:(2/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 1.1 MB/s | 840 kB 00:00 2023-12-20T04:20:56.284 INFO:teuthology.orchestra.run.smithi040.stdout:(14/154): libcephfs2-18.2.1-132.g568df92b.el9.x 7.0 MB/s | 658 kB 00:00 2023-12-20T04:20:56.368 INFO:teuthology.orchestra.run.smithi040.stdout:(15/154): libcephsqlite-18.2.1-132.g568df92b.el 1.9 MB/s | 166 kB 00:00 2023-12-20T04:20:56.380 INFO:teuthology.orchestra.run.smithi069.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 815 kB/s | 142 kB 00:00 2023-12-20T04:20:56.443 INFO:teuthology.orchestra.run.smithi040.stdout:(16/154): librados-devel-18.2.1-132.g568df92b.e 1.7 MB/s | 126 kB 00:00 2023-12-20T04:20:56.543 INFO:teuthology.orchestra.run.smithi040.stdout:(17/154): libradosstriper1-18.2.1-132.g568df92b 4.6 MB/s | 475 kB 00:00 2023-12-20T04:20:57.111 INFO:teuthology.orchestra.run.smithi040.stdout:(18/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 7.9 MB/s | 4.5 MB 00:00 2023-12-20T04:20:57.186 INFO:teuthology.orchestra.run.smithi040.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 602 kB/s | 45 kB 00:00 2023-12-20T04:20:57.226 INFO:teuthology.orchestra.run.smithi081.stdout:(2/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 788 kB/s | 840 kB 00:01 2023-12-20T04:20:57.261 INFO:teuthology.orchestra.run.smithi040.stdout:(20/154): python3-ceph-common-18.2.1-132.g568df 1.6 MB/s | 124 kB 00:00 2023-12-20T04:20:57.344 INFO:teuthology.orchestra.run.smithi040.stdout:(21/154): python3-cephfs-18.2.1-132.g568df92b.e 1.9 MB/s | 161 kB 00:00 2023-12-20T04:20:57.409 INFO:teuthology.orchestra.run.smithi081.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 781 kB/s | 142 kB 00:00 2023-12-20T04:20:57.429 INFO:teuthology.orchestra.run.smithi040.stdout:(22/154): python3-rados-18.2.1-132.g568df92b.el 3.8 MB/s | 321 kB 00:00 2023-12-20T04:20:57.520 INFO:teuthology.orchestra.run.smithi040.stdout:(23/154): python3-rbd-18.2.1-132.g568df92b.el9. 3.2 MB/s | 298 kB 00:00 2023-12-20T04:20:57.604 INFO:teuthology.orchestra.run.smithi040.stdout:(24/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.2 MB/s | 99 kB 00:00 2023-12-20T04:20:57.679 INFO:teuthology.orchestra.run.smithi040.stdout:(25/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 1.1 MB/s | 86 kB 00:00 2023-12-20T04:20:57.848 INFO:teuthology.orchestra.run.smithi069.stdout:(4/154): ceph-base-18.2.1-132.g568df92b.el9.x86 1.9 MB/s | 5.2 MB 00:02 2023-12-20T04:20:58.048 INFO:teuthology.orchestra.run.smithi069.stdout:(5/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 1.3 MB/s | 2.1 MB 00:01 2023-12-20T04:20:58.096 INFO:teuthology.orchestra.run.smithi040.stdout:(26/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 7.2 MB/s | 3.0 MB 00:00 2023-12-20T04:20:58.163 INFO:teuthology.orchestra.run.smithi040.stdout:(27/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 2.5 MB/s | 171 kB 00:00 2023-12-20T04:20:58.247 INFO:teuthology.orchestra.run.smithi040.stdout:(28/154): ceph-grafana-dashboards-18.2.1-132.g5 279 kB/s | 23 kB 00:00 2023-12-20T04:20:58.314 INFO:teuthology.orchestra.run.smithi040.stdout:(29/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 1.9 MB/s | 132 kB 00:00 2023-12-20T04:20:58.323 INFO:teuthology.orchestra.run.smithi069.stdout:(6/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 3.0 MB/s | 1.4 MB 00:00 2023-12-20T04:20:58.614 INFO:teuthology.orchestra.run.smithi040.stdout:(30/154): ceph-mgr-dashboard-18.2.1-132.g568df9 5.9 MB/s | 1.8 MB 00:00 2023-12-20T04:20:59.168 INFO:teuthology.orchestra.run.smithi081.stdout:(4/154): ceph-base-18.2.1-132.g568df92b.el9.x86 1.5 MB/s | 5.2 MB 00:03 2023-12-20T04:20:59.460 INFO:teuthology.orchestra.run.smithi081.stdout:(5/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 1.0 MB/s | 2.1 MB 00:02 2023-12-20T04:20:59.689 INFO:teuthology.orchestra.run.smithi040.stdout:(31/154): ceph-mgr-diskprediction-local-18.2.1- 6.9 MB/s | 7.4 MB 00:01 2023-12-20T04:20:59.860 INFO:teuthology.orchestra.run.smithi081.stdout:(6/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 2.1 MB/s | 1.4 MB 00:00 2023-12-20T04:21:00.048 INFO:teuthology.orchestra.run.smithi040.stdout:(32/154): ceph-test-18.2.1-132.g568df92b.el9.x8 9.1 MB/s | 40 MB 00:04 2023-12-20T04:21:00.073 INFO:teuthology.orchestra.run.smithi040.stdout:(33/154): ceph-mgr-modules-core-18.2.1-132.g568 631 kB/s | 242 kB 00:00 2023-12-20T04:21:00.123 INFO:teuthology.orchestra.run.smithi040.stdout:(34/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 669 kB/s | 50 kB 00:00 2023-12-20T04:21:00.148 INFO:teuthology.orchestra.run.smithi040.stdout:(35/154): ceph-prometheus-alerts-18.2.1-132.g56 195 kB/s | 15 kB 00:00 2023-12-20T04:21:00.240 INFO:teuthology.orchestra.run.smithi040.stdout:(36/154): cephadm-18.2.1-132.g568df92b.el9.noar 2.4 MB/s | 221 kB 00:00 2023-12-20T04:21:00.274 INFO:teuthology.orchestra.run.smithi040.stdout:(37/154): ceph-volume-18.2.1-132.g568df92b.el9. 1.7 MB/s | 262 kB 00:00 2023-12-20T04:21:00.324 INFO:teuthology.orchestra.run.smithi040.stdout:(38/154): cephfs-top-18.2.1-132.g568df92b.el9.n 216 kB/s | 18 kB 00:00 2023-12-20T04:21:00.433 INFO:teuthology.orchestra.run.smithi040.stdout:(39/154): bison-3.7.4-5.el9.x86_64.rpm 8.4 MB/s | 920 kB 00:00 2023-12-20T04:21:00.466 INFO:teuthology.orchestra.run.smithi040.stdout:(40/154): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2023-12-20T04:21:00.492 INFO:teuthology.orchestra.run.smithi040.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-12-20T04:21:00.517 INFO:teuthology.orchestra.run.smithi040.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 431 kB/s | 21 kB 00:00 2023-12-20T04:21:00.542 INFO:teuthology.orchestra.run.smithi040.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-12-20T04:21:00.567 INFO:teuthology.orchestra.run.smithi040.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 639 kB/s | 32 kB 00:00 2023-12-20T04:21:00.640 INFO:teuthology.orchestra.run.smithi069.stdout:(7/154): ceph-osd-18.2.1-132.g568df92b.el9.x86_ 7.6 MB/s | 18 MB 00:02 2023-12-20T04:21:00.643 INFO:teuthology.orchestra.run.smithi040.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2023-12-20T04:21:00.668 INFO:teuthology.orchestra.run.smithi040.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 174 kB/s | 17 kB 00:00 2023-12-20T04:21:00.694 INFO:teuthology.orchestra.run.smithi040.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-20T04:21:00.699 INFO:teuthology.orchestra.run.smithi069.stdout:(8/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 1.7 MB/s | 4.4 MB 00:02 2023-12-20T04:21:00.719 INFO:teuthology.orchestra.run.smithi040.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2023-12-20T04:21:00.744 INFO:teuthology.orchestra.run.smithi040.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-20T04:21:00.769 INFO:teuthology.orchestra.run.smithi040.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 883 kB/s | 44 kB 00:00 2023-12-20T04:21:00.782 INFO:teuthology.orchestra.run.smithi069.stdout:(9/154): ceph-selinux-18.2.1-132.g568df92b.el9. 289 kB/s | 24 kB 00:00 2023-12-20T04:21:00.803 INFO:teuthology.orchestra.run.smithi040.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-20T04:21:00.828 INFO:teuthology.orchestra.run.smithi040.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 578 kB 00:00 2023-12-20T04:21:00.854 INFO:teuthology.orchestra.run.smithi040.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 498 kB/s | 24 kB 00:00 2023-12-20T04:21:00.879 INFO:teuthology.orchestra.run.smithi040.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 923 kB/s | 46 kB 00:00 2023-12-20T04:21:00.904 INFO:teuthology.orchestra.run.smithi040.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-20T04:21:00.929 INFO:teuthology.orchestra.run.smithi040.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-12-20T04:21:00.955 INFO:teuthology.orchestra.run.smithi040.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 688 kB/s | 34 kB 00:00 2023-12-20T04:21:01.064 INFO:teuthology.orchestra.run.smithi040.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 35 MB/s | 4.7 MB 00:00 2023-12-20T04:21:01.105 INFO:teuthology.orchestra.run.smithi040.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 10 MB/s | 1.5 MB 00:00 2023-12-20T04:21:01.147 INFO:teuthology.orchestra.run.smithi040.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 9.8 MB/s | 811 kB 00:00 2023-12-20T04:21:01.172 INFO:teuthology.orchestra.run.smithi040.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 2.0 MB/s | 134 kB 00:00 2023-12-20T04:21:01.299 INFO:teuthology.orchestra.run.smithi069.stdout:(10/154): ceph-radosgw-18.2.1-132.g568df92b.el9 12 MB/s | 7.7 MB 00:00 2023-12-20T04:21:01.356 INFO:teuthology.orchestra.run.smithi040.stdout:(62/154): ceph-osd-18.2.1-132.g568df92b.el9.x86 2.8 MB/s | 18 MB 00:06 2023-12-20T04:21:01.366 INFO:teuthology.orchestra.run.smithi069.stdout:(11/154): cephfs-mirror-18.2.1-132.g568df92b.el 3.2 MB/s | 219 kB 00:00 2023-12-20T04:21:01.410 INFO:teuthology.orchestra.run.smithi081.stdout:(7/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 2.3 MB/s | 4.4 MB 00:01 2023-12-20T04:21:01.433 INFO:teuthology.orchestra.run.smithi069.stdout:(12/154): cephfs-shell-18.2.1-132.g568df92b.el9 405 kB/s | 27 kB 00:00 2023-12-20T04:21:01.500 INFO:teuthology.orchestra.run.smithi069.stdout:(13/154): libcephfs-devel-18.2.1-132.g568df92b. 466 kB/s | 31 kB 00:00 2023-12-20T04:21:01.550 INFO:teuthology.orchestra.run.smithi040.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 14 MB/s | 5.7 MB 00:00 2023-12-20T04:21:01.582 INFO:teuthology.orchestra.run.smithi040.stdout:(64/154): python3-attrs-20.3.0-7.el9.noarch.rpm 190 kB/s | 78 kB 00:00 2023-12-20T04:21:01.600 INFO:teuthology.orchestra.run.smithi069.stdout:(14/154): libcephfs2-18.2.1-132.g568df92b.el9.x 6.4 MB/s | 658 kB 00:00 2023-12-20T04:21:01.675 INFO:teuthology.orchestra.run.smithi069.stdout:(15/154): libcephsqlite-18.2.1-132.g568df92b.el 2.2 MB/s | 166 kB 00:00 2023-12-20T04:21:01.691 INFO:teuthology.orchestra.run.smithi040.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-12-20T04:21:01.716 INFO:teuthology.orchestra.run.smithi040.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-12-20T04:21:01.733 INFO:teuthology.orchestra.run.smithi040.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 166 kB/s | 24 kB 00:00 2023-12-20T04:21:01.751 INFO:teuthology.orchestra.run.smithi069.stdout:(16/154): librados-devel-18.2.1-132.g568df92b.e 1.6 MB/s | 126 kB 00:00 2023-12-20T04:21:01.758 INFO:teuthology.orchestra.run.smithi040.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 273 kB/s | 18 kB 00:00 2023-12-20T04:21:01.783 INFO:teuthology.orchestra.run.smithi040.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2023-12-20T04:21:01.808 INFO:teuthology.orchestra.run.smithi040.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-20T04:21:01.859 INFO:teuthology.orchestra.run.smithi069.stdout:(17/154): libradosstriper1-18.2.1-132.g568df92b 4.3 MB/s | 475 kB 00:00 2023-12-20T04:21:01.975 INFO:teuthology.orchestra.run.smithi040.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2023-12-20T04:21:02.001 INFO:teuthology.orchestra.run.smithi040.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2023-12-20T04:21:02.026 INFO:teuthology.orchestra.run.smithi040.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 815 kB/s | 174 kB 00:00 2023-12-20T04:21:02.059 INFO:teuthology.orchestra.run.smithi040.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2023-12-20T04:21:02.085 INFO:teuthology.orchestra.run.smithi040.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-12-20T04:21:02.110 INFO:teuthology.orchestra.run.smithi040.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-12-20T04:21:02.135 INFO:teuthology.orchestra.run.smithi040.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 631 kB/s | 47 kB 00:00 2023-12-20T04:21:02.160 INFO:teuthology.orchestra.run.smithi040.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 851 kB/s | 43 kB 00:00 2023-12-20T04:21:02.226 INFO:teuthology.orchestra.run.smithi069.stdout:(18/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 12 MB/s | 4.5 MB 00:00 2023-12-20T04:21:02.335 INFO:teuthology.orchestra.run.smithi069.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 415 kB/s | 45 kB 00:00 2023-12-20T04:21:02.410 INFO:teuthology.orchestra.run.smithi069.stdout:(20/154): python3-ceph-common-18.2.1-132.g568df 1.6 MB/s | 124 kB 00:00 2023-12-20T04:21:02.494 INFO:teuthology.orchestra.run.smithi069.stdout:(21/154): python3-cephfs-18.2.1-132.g568df92b.e 1.9 MB/s | 161 kB 00:00 2023-12-20T04:21:02.494 INFO:teuthology.orchestra.run.smithi040.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 108 kB/s | 39 kB 00:00 2023-12-20T04:21:02.560 INFO:teuthology.orchestra.run.smithi069.stdout:(22/154): python3-rados-18.2.1-132.g568df92b.el 4.7 MB/s | 321 kB 00:00 2023-12-20T04:21:02.636 INFO:teuthology.orchestra.run.smithi069.stdout:(23/154): python3-rbd-18.2.1-132.g568df92b.el9. 3.9 MB/s | 298 kB 00:00 2023-12-20T04:21:02.661 INFO:teuthology.orchestra.run.smithi040.stdout:(80/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2023-12-20T04:21:02.678 INFO:teuthology.orchestra.run.smithi040.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 80 kB/s | 41 kB 00:00 2023-12-20T04:21:02.703 INFO:teuthology.orchestra.run.smithi069.stdout:(24/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.5 MB/s | 99 kB 00:00 2023-12-20T04:21:02.703 INFO:teuthology.orchestra.run.smithi040.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2023-12-20T04:21:02.720 INFO:teuthology.orchestra.run.smithi040.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 975 kB/s | 56 kB 00:00 2023-12-20T04:21:02.746 INFO:teuthology.orchestra.run.smithi040.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.0 MB/s | 85 kB 00:00 2023-12-20T04:21:02.762 INFO:teuthology.orchestra.run.smithi040.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2023-12-20T04:21:02.770 INFO:teuthology.orchestra.run.smithi069.stdout:(25/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 1.3 MB/s | 86 kB 00:00 2023-12-20T04:21:02.779 INFO:teuthology.orchestra.run.smithi040.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 754 kB/s | 44 kB 00:00 2023-12-20T04:21:02.804 INFO:teuthology.orchestra.run.smithi040.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2023-12-20T04:21:02.838 INFO:teuthology.orchestra.run.smithi040.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-12-20T04:21:02.863 INFO:teuthology.orchestra.run.smithi040.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-12-20T04:21:02.888 INFO:teuthology.orchestra.run.smithi040.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2023-12-20T04:21:02.905 INFO:teuthology.orchestra.run.smithi040.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 103 kB 00:00 2023-12-20T04:21:02.956 INFO:teuthology.orchestra.run.smithi040.stdout:(92/154): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-12-20T04:21:02.981 INFO:teuthology.orchestra.run.smithi040.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2023-12-20T04:21:03.006 INFO:teuthology.orchestra.run.smithi040.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-12-20T04:21:03.011 INFO:teuthology.orchestra.run.smithi069.stdout:(26/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 12 MB/s | 3.0 MB 00:00 2023-12-20T04:21:03.031 INFO:teuthology.orchestra.run.smithi040.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-12-20T04:21:03.052 INFO:teuthology.orchestra.run.smithi081.stdout:(8/154): ceph-radosgw-18.2.1-132.g568df92b.el9. 4.7 MB/s | 7.7 MB 00:01 2023-12-20T04:21:03.079 INFO:teuthology.orchestra.run.smithi069.stdout:(27/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 2.5 MB/s | 171 kB 00:00 2023-12-20T04:21:03.094 INFO:teuthology.orchestra.run.smithi081.stdout:(9/154): ceph-selinux-18.2.1-132.g568df92b.el9. 590 kB/s | 24 kB 00:00 2023-12-20T04:21:03.173 INFO:teuthology.orchestra.run.smithi040.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 781 kB/s | 111 kB 00:00 2023-12-20T04:21:03.179 INFO:teuthology.orchestra.run.smithi069.stdout:(28/154): ceph-grafana-dashboards-18.2.1-132.g5 232 kB/s | 23 kB 00:00 2023-12-20T04:21:03.248 INFO:teuthology.orchestra.run.smithi040.stdout:(97/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 4.0 MB/s | 309 kB 00:00 2023-12-20T04:21:03.282 INFO:teuthology.orchestra.run.smithi040.stdout:(98/154): python3-devel-3.9.17-2.el9.x86_64.rpm 892 kB/s | 245 kB 00:00 2023-12-20T04:21:03.374 INFO:teuthology.orchestra.run.smithi040.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2023-12-20T04:21:03.396 INFO:teuthology.orchestra.run.smithi069.stdout:(29/154): ceph-common-18.2.1-132.g568df92b.el9. 2.2 MB/s | 18 MB 00:08 2023-12-20T04:21:03.421 INFO:teuthology.orchestra.run.smithi069.stdout:(30/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 545 kB/s | 132 kB 00:00 2023-12-20T04:21:03.466 INFO:teuthology.orchestra.run.smithi040.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2023-12-20T04:21:03.533 INFO:teuthology.orchestra.run.smithi040.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-12-20T04:21:03.600 INFO:teuthology.orchestra.run.smithi040.stdout:(102/154): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2023-12-20T04:21:03.658 INFO:teuthology.orchestra.run.smithi040.stdout:(103/154): python3-asyncssh-2.13.2-3.el9.noarch 9.2 MB/s | 548 kB 00:00 2023-12-20T04:21:03.700 INFO:teuthology.orchestra.run.smithi040.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2023-12-20T04:21:03.759 INFO:teuthology.orchestra.run.smithi040.stdout:(105/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2023-12-20T04:21:03.776 INFO:teuthology.orchestra.run.smithi040.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2023-12-20T04:21:03.801 INFO:teuthology.orchestra.run.smithi040.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 358 kB/s | 15 kB 00:00 2023-12-20T04:21:03.826 INFO:teuthology.orchestra.run.smithi040.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2023-12-20T04:21:03.886 INFO:teuthology.orchestra.run.smithi040.stdout:(109/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2023-12-20T04:21:03.921 INFO:teuthology.orchestra.run.smithi069.stdout:(31/154): ceph-mgr-diskprediction-local-18.2.1- 15 MB/s | 7.4 MB 00:00 2023-12-20T04:21:03.927 INFO:teuthology.orchestra.run.smithi040.stdout:(110/154): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-12-20T04:21:03.944 INFO:teuthology.orchestra.run.smithi040.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 602 kB/s | 35 kB 00:00 2023-12-20T04:21:03.986 INFO:teuthology.orchestra.run.smithi040.stdout:(112/154): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2023-12-20T04:21:03.997 INFO:teuthology.orchestra.run.smithi069.stdout:(32/154): ceph-mgr-modules-core-18.2.1-132.g568 3.1 MB/s | 242 kB 00:00 2023-12-20T04:21:04.012 INFO:teuthology.orchestra.run.smithi040.stdout:(113/154): python3-google-auth-2.23.4-1.el9.noa 2.3 MB/s | 197 kB 00:00 2023-12-20T04:21:04.028 INFO:teuthology.orchestra.run.smithi040.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2023-12-20T04:21:04.080 INFO:teuthology.orchestra.run.smithi069.stdout:(33/154): ceph-mgr-dashboard-18.2.1-132.g568df9 2.6 MB/s | 1.8 MB 00:00 2023-12-20T04:21:04.087 INFO:teuthology.orchestra.run.smithi040.stdout:(115/154): openssl-devel-3.0.7-25.el9.x86_64.rp 3.8 MB/s | 4.1 MB 00:01 2023-12-20T04:21:04.104 INFO:teuthology.orchestra.run.smithi040.stdout:(116/154): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2023-12-20T04:21:04.105 INFO:teuthology.orchestra.run.smithi069.stdout:(34/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 463 kB/s | 50 kB 00:00 2023-12-20T04:21:04.121 INFO:teuthology.orchestra.run.smithi040.stdout:(117/154): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2023-12-20T04:21:04.163 INFO:teuthology.orchestra.run.smithi040.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 218 kB/s | 9.0 kB 00:00 2023-12-20T04:21:04.164 INFO:teuthology.orchestra.run.smithi069.stdout:(35/154): ceph-prometheus-alerts-18.2.1-132.g56 175 kB/s | 15 kB 00:00 2023-12-20T04:21:04.179 INFO:teuthology.orchestra.run.smithi040.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 702 kB/s | 41 kB 00:00 2023-12-20T04:21:04.189 INFO:teuthology.orchestra.run.smithi069.stdout:(36/154): ceph-volume-18.2.1-132.g568df92b.el9. 3.1 MB/s | 262 kB 00:00 2023-12-20T04:21:04.205 INFO:teuthology.orchestra.run.smithi040.stdout:(120/154): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2023-12-20T04:21:04.230 INFO:teuthology.orchestra.run.smithi040.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 922 kB/s | 46 kB 00:00 2023-12-20T04:21:04.264 INFO:teuthology.orchestra.run.smithi040.stdout:(122/154): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2023-12-20T04:21:04.265 INFO:teuthology.orchestra.run.smithi069.stdout:(37/154): cephfs-top-18.2.1-132.g568df92b.el9.n 240 kB/s | 18 kB 00:00 2023-12-20T04:21:04.281 INFO:teuthology.orchestra.run.smithi040.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2023-12-20T04:21:04.290 INFO:teuthology.orchestra.run.smithi069.stdout:(38/154): cephadm-18.2.1-132.g568df92b.el9.noar 1.7 MB/s | 221 kB 00:00 2023-12-20T04:21:04.314 INFO:teuthology.orchestra.run.smithi040.stdout:(124/154): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2023-12-20T04:21:04.339 INFO:teuthology.orchestra.run.smithi040.stdout:(125/154): python3-more-itertools-8.12.0-2.el9. 587 kB/s | 79 kB 00:00 2023-12-20T04:21:04.356 INFO:teuthology.orchestra.run.smithi040.stdout:(126/154): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2023-12-20T04:21:04.382 INFO:teuthology.orchestra.run.smithi040.stdout:(127/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-12-20T04:21:04.402 INFO:teuthology.orchestra.run.smithi040.stdout:(128/154): python3-pyperclip-1.8.2-2.el9.noarch 480 kB/s | 28 kB 00:00 2023-12-20T04:21:04.415 INFO:teuthology.orchestra.run.smithi040.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2023-12-20T04:21:04.441 INFO:teuthology.orchestra.run.smithi040.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2023-12-20T04:21:04.474 INFO:teuthology.orchestra.run.smithi040.stdout:(131/154): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-20T04:21:04.500 INFO:teuthology.orchestra.run.smithi040.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2023-12-20T04:21:04.507 INFO:teuthology.orchestra.run.smithi069.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 662 kB 00:00 2023-12-20T04:21:04.525 INFO:teuthology.orchestra.run.smithi040.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 608 kB/s | 51 kB 00:00 2023-12-20T04:21:04.541 INFO:teuthology.orchestra.run.smithi069.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 920 kB 00:00 2023-12-20T04:21:04.550 INFO:teuthology.orchestra.run.smithi040.stdout:(134/154): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-12-20T04:21:04.557 INFO:teuthology.orchestra.run.smithi069.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2023-12-20T04:21:04.576 INFO:teuthology.orchestra.run.smithi040.stdout:(135/154): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-12-20T04:21:04.583 INFO:teuthology.orchestra.run.smithi069.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 514 kB/s | 21 kB 00:00 2023-12-20T04:21:04.610 INFO:teuthology.orchestra.run.smithi069.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2023-12-20T04:21:04.626 INFO:teuthology.orchestra.run.smithi040.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 266 kB/s | 20 kB 00:00 2023-12-20T04:21:04.633 INFO:teuthology.orchestra.run.smithi069.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 634 kB/s | 32 kB 00:00 2023-12-20T04:21:04.651 INFO:teuthology.orchestra.run.smithi040.stdout:(137/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-12-20T04:21:04.676 INFO:teuthology.orchestra.run.smithi040.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-20T04:21:04.734 INFO:teuthology.orchestra.run.smithi069.stdout:(45/154): flexiblas-openblas-openmp-3.0.4-8.el9 172 kB/s | 17 kB 00:00 2023-12-20T04:21:04.784 INFO:teuthology.orchestra.run.smithi069.stdout:(46/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2023-12-20T04:21:04.809 INFO:teuthology.orchestra.run.smithi069.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2023-12-20T04:21:04.834 INFO:teuthology.orchestra.run.smithi069.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2023-12-20T04:21:04.851 INFO:teuthology.orchestra.run.smithi069.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-20T04:21:04.877 INFO:teuthology.orchestra.run.smithi069.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-20T04:21:04.886 INFO:teuthology.orchestra.run.smithi081.stdout:(10/154): ceph-osd-18.2.1-132.g568df92b.el9.x86 3.5 MB/s | 18 MB 00:05 2023-12-20T04:21:04.893 INFO:teuthology.orchestra.run.smithi040.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2023-12-20T04:21:04.902 INFO:teuthology.orchestra.run.smithi069.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-20T04:21:04.927 INFO:teuthology.orchestra.run.smithi069.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-12-20T04:21:04.935 INFO:teuthology.orchestra.run.smithi040.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-20T04:21:04.953 INFO:teuthology.orchestra.run.smithi069.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 493 kB/s | 24 kB 00:00 2023-12-20T04:21:04.978 INFO:teuthology.orchestra.run.smithi069.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 921 kB/s | 46 kB 00:00 2023-12-20T04:21:05.003 INFO:teuthology.orchestra.run.smithi069.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-12-20T04:21:05.011 INFO:teuthology.orchestra.run.smithi040.stdout:(141/154): librbd1-18.2.1-132.g568df92b.el9.x86 9.0 MB/s | 3.0 MB 00:00 2023-12-20T04:21:05.019 INFO:teuthology.orchestra.run.smithi081.stdout:(11/154): cephfs-mirror-18.2.1-132.g568df92b.el 1.6 MB/s | 219 kB 00:00 2023-12-20T04:21:05.028 INFO:teuthology.orchestra.run.smithi069.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2023-12-20T04:21:05.036 INFO:teuthology.orchestra.run.smithi040.stdout:(142/154): acl-2.3.1-4.el9.x86_64.rpm 686 kB/s | 69 kB 00:00 2023-12-20T04:21:05.054 INFO:teuthology.orchestra.run.smithi069.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 682 kB/s | 34 kB 00:00 2023-12-20T04:21:05.061 INFO:teuthology.orchestra.run.smithi040.stdout:(143/154): elfutils-debuginfod-client-0.190-1.e 730 kB/s | 36 kB 00:00 2023-12-20T04:21:05.095 INFO:teuthology.orchestra.run.smithi040.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2023-12-20T04:21:05.096 INFO:teuthology.orchestra.run.smithi081.stdout:(12/154): cephfs-shell-18.2.1-132.g568df92b.el9 363 kB/s | 27 kB 00:00 2023-12-20T04:21:05.128 INFO:teuthology.orchestra.run.smithi040.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 3.7 MB/s | 255 kB 00:00 2023-12-20T04:21:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 328 kB/s | 22 kB 00:00 2023-12-20T04:21:05.187 INFO:teuthology.orchestra.run.smithi081.stdout:(13/154): libcephfs-devel-18.2.1-132.g568df92b. 342 kB/s | 31 kB 00:00 2023-12-20T04:21:05.196 INFO:teuthology.orchestra.run.smithi040.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 321 kB 00:00 2023-12-20T04:21:05.262 INFO:teuthology.orchestra.run.smithi069.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2023-12-20T04:21:05.304 INFO:teuthology.orchestra.run.smithi069.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 6.1 MB/s | 1.5 MB 00:00 2023-12-20T04:21:05.346 INFO:teuthology.orchestra.run.smithi069.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 9.6 MB/s | 811 kB 00:00 2023-12-20T04:21:05.363 INFO:teuthology.orchestra.run.smithi069.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2023-12-20T04:21:05.404 INFO:teuthology.orchestra.run.smithi081.stdout:(14/154): libcephfs2-18.2.1-132.g568df92b.el9.x 3.0 MB/s | 658 kB 00:00 2023-12-20T04:21:05.504 INFO:teuthology.orchestra.run.smithi081.stdout:(15/154): libcephsqlite-18.2.1-132.g568df92b.el 1.6 MB/s | 166 kB 00:00 2023-12-20T04:21:05.605 INFO:teuthology.orchestra.run.smithi081.stdout:(16/154): librados-devel-18.2.1-132.g568df92b.e 1.2 MB/s | 126 kB 00:00 2023-12-20T04:21:05.654 INFO:teuthology.orchestra.run.smithi040.stdout:(148/154): NetworkManager-1.45.7-1.el9.x86_64.r 4.6 MB/s | 2.3 MB 00:00 2023-12-20T04:21:05.663 INFO:teuthology.orchestra.run.smithi069.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 18 MB/s | 5.7 MB 00:00 2023-12-20T04:21:05.696 INFO:teuthology.orchestra.run.smithi040.stdout:(149/154): NetworkManager-libnm-1.45.7-1.el9.x8 3.6 MB/s | 1.8 MB 00:00 2023-12-20T04:21:05.713 INFO:teuthology.orchestra.run.smithi040.stdout:(150/154): NetworkManager-team-1.45.7-1.el9.x86 740 kB/s | 43 kB 00:00 2023-12-20T04:21:05.755 INFO:teuthology.orchestra.run.smithi081.stdout:(17/154): libradosstriper1-18.2.1-132.g568df92b 3.1 MB/s | 475 kB 00:00 2023-12-20T04:21:05.772 INFO:teuthology.orchestra.run.smithi040.stdout:(151/154): librados2-18.2.1-132.g568df92b.el9.x 2.9 MB/s | 3.3 MB 00:01 2023-12-20T04:21:05.772 INFO:teuthology.orchestra.run.smithi069.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 190 kB/s | 78 kB 00:00 2023-12-20T04:21:05.797 INFO:teuthology.orchestra.run.smithi040.stdout:(152/154): NetworkManager-tui-1.45.7-1.el9.x86_ 2.4 MB/s | 246 kB 00:00 2023-12-20T04:21:05.814 INFO:teuthology.orchestra.run.smithi069.stdout:(64/154): python3-jinja2-2.11.3-4.el9.noarch.rp 5.4 MB/s | 228 kB 00:00 2023-12-20T04:21:05.856 INFO:teuthology.orchestra.run.smithi040.stdout:(153/154): openssl-3.0.7-25.el9.x86_64.rpm 8.5 MB/s | 1.2 MB 00:00 2023-12-20T04:21:06.042 INFO:teuthology.orchestra.run.smithi069.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-12-20T04:21:06.065 INFO:teuthology.orchestra.run.smithi069.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 98 kB/s | 24 kB 00:00 2023-12-20T04:21:06.092 INFO:teuthology.orchestra.run.smithi069.stdout:(67/154): python3-jsonpointer-2.0-4.el9.noarch. 345 kB/s | 18 kB 00:00 2023-12-20T04:21:06.117 INFO:teuthology.orchestra.run.smithi069.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.7 MB/s | 144 kB 00:00 2023-12-20T04:21:06.122 INFO:teuthology.orchestra.run.smithi040.stdout:(154/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 6.2 MB/s | 2.2 MB 00:00 2023-12-20T04:21:06.127 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:21:06.127 INFO:teuthology.orchestra.run.smithi040.stdout:Total 16 MB/s | 200 MB 00:12 2023-12-20T04:21:06.143 INFO:teuthology.orchestra.run.smithi069.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2023-12-20T04:21:06.303 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-12-20T04:21:06.326 INFO:teuthology.orchestra.run.smithi069.stdout:(70/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-12-20T04:21:06.352 INFO:teuthology.orchestra.run.smithi069.stdout:(71/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2023-12-20T04:21:06.376 INFO:teuthology.orchestra.run.smithi069.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-12-20T04:21:06.402 INFO:teuthology.orchestra.run.smithi069.stdout:(73/154): python3-prettytable-0.7.2-27.el9.noar 821 kB/s | 41 kB 00:00 2023-12-20T04:21:06.419 INFO:teuthology.orchestra.run.smithi069.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-12-20T04:21:06.444 INFO:teuthology.orchestra.run.smithi069.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2023-12-20T04:21:06.469 INFO:teuthology.orchestra.run.smithi069.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 950 kB/s | 47 kB 00:00 2023-12-20T04:21:06.495 INFO:teuthology.orchestra.run.smithi069.stdout:(77/154): python3-requests-oauthlib-1.3.0-12.el 853 kB/s | 43 kB 00:00 2023-12-20T04:21:06.508 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-12-20T04:21:06.508 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-12-20T04:21:06.703 INFO:teuthology.orchestra.run.smithi069.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 186 kB/s | 39 kB 00:00 2023-12-20T04:21:06.713 INFO:teuthology.orchestra.run.smithi081.stdout:(18/154): ceph-common-18.2.1-132.g568df92b.el9. 1.7 MB/s | 18 MB 00:10 2023-12-20T04:21:06.780 INFO:teuthology.orchestra.run.smithi081.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 685 kB/s | 45 kB 00:00 2023-12-20T04:21:06.897 INFO:teuthology.orchestra.run.smithi081.stdout:(20/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 3.9 MB/s | 4.5 MB 00:01 2023-12-20T04:21:06.931 INFO:teuthology.orchestra.run.smithi081.stdout:(21/154): python3-ceph-common-18.2.1-132.g568df 834 kB/s | 124 kB 00:00 2023-12-20T04:21:07.006 INFO:teuthology.orchestra.run.smithi081.stdout:(22/154): python3-cephfs-18.2.1-132.g568df92b.e 1.5 MB/s | 161 kB 00:00 2023-12-20T04:21:07.012 INFO:teuthology.orchestra.run.smithi069.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2023-12-20T04:21:07.037 INFO:teuthology.orchestra.run.smithi069.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 123 kB/s | 41 kB 00:00 2023-12-20T04:21:07.040 INFO:teuthology.orchestra.run.smithi081.stdout:(23/154): python3-rados-18.2.1-132.g568df92b.el 2.9 MB/s | 321 kB 00:00 2023-12-20T04:21:07.062 INFO:teuthology.orchestra.run.smithi069.stdout:(81/154): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-12-20T04:21:07.088 INFO:teuthology.orchestra.run.smithi069.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-20T04:21:07.107 INFO:teuthology.orchestra.run.smithi081.stdout:(24/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.5 MB/s | 99 kB 00:00 2023-12-20T04:21:07.113 INFO:teuthology.orchestra.run.smithi069.stdout:(83/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-12-20T04:21:07.138 INFO:teuthology.orchestra.run.smithi069.stdout:(84/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-20T04:21:07.163 INFO:teuthology.orchestra.run.smithi069.stdout:(85/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 877 kB/s | 44 kB 00:00 2023-12-20T04:21:07.174 INFO:teuthology.orchestra.run.smithi081.stdout:(25/154): python3-rbd-18.2.1-132.g568df92b.el9. 1.8 MB/s | 298 kB 00:00 2023-12-20T04:21:07.189 INFO:teuthology.orchestra.run.smithi069.stdout:(86/154): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-20T04:21:07.228 INFO:teuthology.orchestra.run.smithi081.stdout:(26/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 718 kB/s | 86 kB 00:00 2023-12-20T04:21:07.251 INFO:teuthology.orchestra.run.smithi069.stdout:(87/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.0 MB/s | 803 kB 00:00 2023-12-20T04:21:07.273 INFO:teuthology.orchestra.run.smithi069.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-12-20T04:21:07.298 INFO:teuthology.orchestra.run.smithi069.stdout:(89/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 241 kB 00:00 2023-12-20T04:21:07.308 INFO:teuthology.orchestra.run.smithi081.stdout:(27/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 2.1 MB/s | 171 kB 00:00 2023-12-20T04:21:07.340 INFO:teuthology.orchestra.run.smithi069.stdout:(90/154): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2023-12-20T04:21:07.365 INFO:teuthology.orchestra.run.smithi069.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-12-20T04:21:07.375 INFO:teuthology.orchestra.run.smithi081.stdout:(28/154): ceph-grafana-dashboards-18.2.1-132.g5 352 kB/s | 23 kB 00:00 2023-12-20T04:21:07.390 INFO:teuthology.orchestra.run.smithi069.stdout:(92/154): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-12-20T04:21:07.416 INFO:teuthology.orchestra.run.smithi069.stdout:(93/154): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-20T04:21:07.441 INFO:teuthology.orchestra.run.smithi069.stdout:(94/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-12-20T04:21:07.441 INFO:teuthology.orchestra.run.smithi081.stdout:(29/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 2.0 MB/s | 132 kB 00:00 2023-12-20T04:21:07.716 INFO:teuthology.orchestra.run.smithi069.stdout:(95/154): python3-devel-3.9.17-2.el9.x86_64.rpm 892 kB/s | 245 kB 00:00 2023-12-20T04:21:07.817 INFO:teuthology.orchestra.run.smithi069.stdout:(96/154): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2023-12-20T04:21:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:(30/154): ceph-mgr-dashboard-18.2.1-132.g568df9 4.6 MB/s | 1.8 MB 00:00 2023-12-20T04:21:07.875 INFO:teuthology.orchestra.run.smithi069.stdout:(97/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 9.0 MB/s | 4.1 MB 00:00 2023-12-20T04:21:07.926 INFO:teuthology.orchestra.run.smithi069.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.8 MB/s | 309 kB 00:00 2023-12-20T04:21:07.968 INFO:teuthology.orchestra.run.smithi069.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2023-12-20T04:21:08.034 INFO:teuthology.orchestra.run.smithi069.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 728 kB/s | 49 kB 00:00 2023-12-20T04:21:08.076 INFO:teuthology.orchestra.run.smithi069.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2023-12-20T04:21:08.124 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-12-20T04:21:08.125 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-12-20T04:21:08.168 INFO:teuthology.orchestra.run.smithi069.stdout:(102/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.9 MB/s | 838 kB 00:00 2023-12-20T04:21:08.235 INFO:teuthology.orchestra.run.smithi069.stdout:(103/154): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2023-12-20T04:21:08.286 INFO:teuthology.orchestra.run.smithi069.stdout:(104/154): python3-asyncssh-2.13.2-3.el9.noarch 4.6 MB/s | 548 kB 00:00 2023-12-20T04:21:08.311 INFO:teuthology.orchestra.run.smithi069.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2023-12-20T04:21:08.336 INFO:teuthology.orchestra.run.smithi069.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2023-12-20T04:21:08.361 INFO:teuthology.orchestra.run.smithi069.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2023-12-20T04:21:08.387 INFO:teuthology.orchestra.run.smithi069.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2023-12-20T04:21:08.437 INFO:teuthology.orchestra.run.smithi069.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2023-12-20T04:21:08.501 INFO:teuthology.orchestra.run.smithi081.stdout:(31/154): ceph-test-18.2.1-132.g568df92b.el9.x8 7.3 MB/s | 40 MB 00:05 2023-12-20T04:21:08.593 INFO:teuthology.orchestra.run.smithi081.stdout:(32/154): ceph-mgr-modules-core-18.2.1-132.g568 2.6 MB/s | 242 kB 00:00 2023-12-20T04:21:08.634 INFO:teuthology.orchestra.run.smithi081.stdout:(33/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 1.2 MB/s | 50 kB 00:00 2023-12-20T04:21:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:(34/154): ceph-prometheus-alerts-18.2.1-132.g56 355 kB/s | 15 kB 00:00 2023-12-20T04:21:08.752 INFO:teuthology.orchestra.run.smithi081.stdout:(35/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 1.9 MB/s | 3.0 MB 00:01 2023-12-20T04:21:08.754 INFO:teuthology.orchestra.run.smithi069.stdout:(110/154): python3-colorama-0.4.4-12.el9.noarch 111 kB/s | 35 kB 00:00 2023-12-20T04:21:08.796 INFO:teuthology.orchestra.run.smithi069.stdout:(111/154): python3-google-auth-2.23.4-1.el9.noa 4.6 MB/s | 197 kB 00:00 2023-12-20T04:21:08.811 INFO:teuthology.orchestra.run.smithi081.stdout:(36/154): ceph-volume-18.2.1-132.g568df92b.el9. 1.9 MB/s | 262 kB 00:00 2023-12-20T04:21:08.821 INFO:teuthology.orchestra.run.smithi069.stdout:(112/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 698 kB/s | 303 kB 00:00 2023-12-20T04:21:08.838 INFO:teuthology.orchestra.run.smithi069.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2023-12-20T04:21:08.853 INFO:teuthology.orchestra.run.smithi081.stdout:(37/154): cephadm-18.2.1-132.g568df92b.el9.noar 2.2 MB/s | 221 kB 00:00 2023-12-20T04:21:08.870 INFO:teuthology.orchestra.run.smithi081.stdout:(38/154): cephfs-top-18.2.1-132.g568df92b.el9.n 313 kB/s | 18 kB 00:00 2023-12-20T04:21:08.880 INFO:teuthology.orchestra.run.smithi069.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2023-12-20T04:21:08.897 INFO:teuthology.orchestra.run.smithi069.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2023-12-20T04:21:08.917 INFO:teuthology.orchestra.run.smithi069.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 582 kB/s | 19 kB 00:00 2023-12-20T04:21:08.931 INFO:teuthology.orchestra.run.smithi069.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 588 kB/s | 20 kB 00:00 2023-12-20T04:21:08.965 INFO:teuthology.orchestra.run.smithi069.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2023-12-20T04:21:08.981 INFO:teuthology.orchestra.run.smithi069.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 815 kB/s | 41 kB 00:00 2023-12-20T04:21:09.023 INFO:teuthology.orchestra.run.smithi069.stdout:(120/154): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2023-12-20T04:21:09.040 INFO:teuthology.orchestra.run.smithi069.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 792 kB/s | 46 kB 00:00 2023-12-20T04:21:09.066 INFO:teuthology.orchestra.run.smithi069.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2023-12-20T04:21:09.083 INFO:teuthology.orchestra.run.smithi069.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2023-12-20T04:21:09.103 INFO:teuthology.orchestra.run.smithi081.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2023-12-20T04:21:09.108 INFO:teuthology.orchestra.run.smithi069.stdout:(124/154): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2023-12-20T04:21:09.125 INFO:teuthology.orchestra.run.smithi069.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 391 kB/s | 16 kB 00:00 2023-12-20T04:21:09.159 INFO:teuthology.orchestra.run.smithi069.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2023-12-20T04:21:09.176 INFO:teuthology.orchestra.run.smithi069.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 559 kB/s | 28 kB 00:00 2023-12-20T04:21:09.189 INFO:teuthology.orchestra.run.smithi081.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 920 kB 00:00 2023-12-20T04:21:09.193 INFO:teuthology.orchestra.run.smithi069.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 922 kB/s | 31 kB 00:00 2023-12-20T04:21:09.218 INFO:teuthology.orchestra.run.smithi069.stdout:(129/154): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2023-12-20T04:21:09.220 INFO:teuthology.orchestra.run.smithi081.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 944 kB/s | 106 kB 00:00 2023-12-20T04:21:09.235 INFO:teuthology.orchestra.run.smithi069.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2023-12-20T04:21:09.237 INFO:teuthology.orchestra.run.smithi081.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 457 kB/s | 21 kB 00:00 2023-12-20T04:21:09.252 INFO:teuthology.orchestra.run.smithi069.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2023-12-20T04:21:09.269 INFO:teuthology.orchestra.run.smithi069.stdout:(132/154): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2023-12-20T04:21:09.271 INFO:teuthology.orchestra.run.smithi081.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2023-12-20T04:21:09.288 INFO:teuthology.orchestra.run.smithi081.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 685 kB/s | 32 kB 00:00 2023-12-20T04:21:09.294 INFO:teuthology.orchestra.run.smithi069.stdout:(133/154): python3-webob-1.8.7-6.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2023-12-20T04:21:09.321 INFO:teuthology.orchestra.run.smithi069.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2023-12-20T04:21:09.353 INFO:teuthology.orchestra.run.smithi069.stdout:(135/154): python3-werkzeug-2.0.3-3.el9.1.noarc 7.2 MB/s | 427 kB 00:00 2023-12-20T04:21:09.378 INFO:teuthology.orchestra.run.smithi069.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2023-12-20T04:21:09.403 INFO:teuthology.orchestra.run.smithi069.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-12-20T04:21:09.413 INFO:teuthology.orchestra.run.smithi081.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2023-12-20T04:21:09.445 INFO:teuthology.orchestra.run.smithi069.stdout:(138/154): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2023-12-20T04:21:09.447 INFO:teuthology.orchestra.run.smithi081.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 112 kB/s | 17 kB 00:00 2023-12-20T04:21:09.480 INFO:teuthology.orchestra.run.smithi081.stdout:(47/154): libaio-devel-0.3.111-13.el9.x86_64.rp 315 kB/s | 10 kB 00:00 2023-12-20T04:21:09.514 INFO:teuthology.orchestra.run.smithi081.stdout:(48/154): jq-1.6-16.el9.x86_64.rpm 2.8 MB/s | 186 kB 00:00 2023-12-20T04:21:09.539 INFO:teuthology.orchestra.run.smithi081.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.8 MB/s | 159 kB 00:00 2023-12-20T04:21:09.590 INFO:teuthology.orchestra.run.smithi081.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 44 kB 00:00 2023-12-20T04:21:09.632 INFO:teuthology.orchestra.run.smithi081.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 661 kB 00:00 2023-12-20T04:21:09.674 INFO:teuthology.orchestra.run.smithi081.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2023-12-20T04:21:09.699 INFO:teuthology.orchestra.run.smithi081.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 399 kB/s | 24 kB 00:00 2023-12-20T04:21:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 46 kB 00:00 2023-12-20T04:21:09.766 INFO:teuthology.orchestra.run.smithi081.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2023-12-20T04:21:09.800 INFO:teuthology.orchestra.run.smithi081.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2023-12-20T04:21:09.825 INFO:teuthology.orchestra.run.smithi081.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 612 kB/s | 34 kB 00:00 2023-12-20T04:21:09.837 INFO:teuthology.orchestra.run.smithi069.stdout:(139/154): librados2-18.2.1-132.g568df92b.el9.x 7.5 MB/s | 3.3 MB 00:00 2023-12-20T04:21:09.887 INFO:teuthology.orchestra.run.smithi069.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-12-20T04:21:09.954 INFO:teuthology.orchestra.run.smithi069.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2023-12-20T04:21:09.988 INFO:teuthology.orchestra.run.smithi069.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-20T04:21:10.000 INFO:teuthology.orchestra.run.smithi081.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2023-12-20T04:21:10.030 INFO:teuthology.orchestra.run.smithi069.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 4.5 MB/s | 192 kB 00:00 2023-12-20T04:21:10.059 INFO:teuthology.orchestra.run.smithi081.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 6.9 MB/s | 1.5 MB 00:00 2023-12-20T04:21:10.072 INFO:teuthology.orchestra.run.smithi069.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 6.0 MB/s | 255 kB 00:00 2023-12-20T04:21:10.101 INFO:teuthology.orchestra.run.smithi081.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 9.1 MB/s | 811 kB 00:00 2023-12-20T04:21:10.106 INFO:teuthology.orchestra.run.smithi069.stdout:(145/154): libacl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 22 kB 00:00 2023-12-20T04:21:10.126 INFO:teuthology.orchestra.run.smithi081.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2023-12-20T04:21:10.173 INFO:teuthology.orchestra.run.smithi069.stdout:(146/154): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 321 kB 00:00 2023-12-20T04:21:10.286 INFO:teuthology.orchestra.run.smithi081.stdout:(62/154): ceph-mgr-diskprediction-local-18.2.1- 3.0 MB/s | 7.4 MB 00:02 2023-12-20T04:21:10.407 INFO:teuthology.orchestra.run.smithi069.stdout:(147/154): librbd1-18.2.1-132.g568df92b.el9.x86 3.1 MB/s | 3.0 MB 00:00 2023-12-20T04:21:10.419 INFO:teuthology.orchestra.run.smithi081.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 18 MB/s | 5.7 MB 00:00 2023-12-20T04:21:10.452 INFO:teuthology.orchestra.run.smithi081.stdout:(64/154): python3-attrs-20.3.0-7.el9.noarch.rpm 251 kB/s | 78 kB 00:00 2023-12-20T04:21:10.619 INFO:teuthology.orchestra.run.smithi081.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-12-20T04:21:10.645 INFO:teuthology.orchestra.run.smithi081.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 137 kB/s | 24 kB 00:00 2023-12-20T04:21:10.678 INFO:teuthology.orchestra.run.smithi081.stdout:(67/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.1 MB/s | 228 kB 00:00 2023-12-20T04:21:10.703 INFO:teuthology.orchestra.run.smithi081.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 219 kB/s | 18 kB 00:00 2023-12-20T04:21:10.762 INFO:teuthology.orchestra.run.smithi081.stdout:(69/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 144 kB 00:00 2023-12-20T04:21:10.782 INFO:teuthology.orchestra.run.smithi069.stdout:(148/154): NetworkManager-1.45.7-1.el9.x86_64.r 3.7 MB/s | 2.3 MB 00:00 2023-12-20T04:21:10.804 INFO:teuthology.orchestra.run.smithi081.stdout:(70/154): python3-markupsafe-1.1.1-12.el9.x86_6 322 kB/s | 32 kB 00:00 2023-12-20T04:21:10.907 INFO:teuthology.orchestra.run.smithi069.stdout:(149/154): NetworkManager-libnm-1.45.7-1.el9.x8 3.6 MB/s | 1.8 MB 00:00 2023-12-20T04:21:10.921 INFO:teuthology.orchestra.run.smithi081.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2023-12-20T04:21:10.946 INFO:teuthology.orchestra.run.smithi081.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2023-12-20T04:21:10.980 INFO:teuthology.orchestra.run.smithi081.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-12-20T04:21:10.982 INFO:teuthology.orchestra.run.smithi069.stdout:(150/154): NetworkManager-team-1.45.7-1.el9.x86 216 kB/s | 43 kB 00:00 2023-12-20T04:21:11.005 INFO:teuthology.orchestra.run.smithi081.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 737 kB/s | 41 kB 00:00 2023-12-20T04:21:11.016 INFO:teuthology.orchestra.run.smithi069.stdout:(151/154): NetworkManager-tui-1.45.7-1.el9.x86_ 2.2 MB/s | 246 kB 00:00 2023-12-20T04:21:11.030 INFO:teuthology.orchestra.run.smithi081.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2023-12-20T04:21:11.063 INFO:teuthology.orchestra.run.smithi081.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-12-20T04:21:11.089 INFO:teuthology.orchestra.run.smithi081.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 849 kB/s | 47 kB 00:00 2023-12-20T04:21:11.107 INFO:teuthology.orchestra.run.smithi069.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2023-12-20T04:21:11.114 INFO:teuthology.orchestra.run.smithi081.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 530 kB/s | 43 kB 00:00 2023-12-20T04:21:11.440 INFO:teuthology.orchestra.run.smithi081.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 124 kB/s | 39 kB 00:00 2023-12-20T04:21:11.465 INFO:teuthology.orchestra.run.smithi081.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 122 kB/s | 41 kB 00:00 2023-12-20T04:21:11.483 INFO:teuthology.orchestra.run.smithi069.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.6 MB/s | 2.2 MB 00:00 2023-12-20T04:21:11.682 INFO:teuthology.orchestra.run.smithi081.stdout:(81/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2023-12-20T04:21:11.707 INFO:teuthology.orchestra.run.smithi081.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 247 kB/s | 56 kB 00:00 2023-12-20T04:21:11.741 INFO:teuthology.orchestra.run.smithi081.stdout:(83/154): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2023-12-20T04:21:11.766 INFO:teuthology.orchestra.run.smithi081.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.0 MB/s | 85 kB 00:00 2023-12-20T04:21:11.799 INFO:teuthology.orchestra.run.smithi081.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 708 kB/s | 63 kB 00:00 2023-12-20T04:21:11.825 INFO:teuthology.orchestra.run.smithi081.stdout:(86/154): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-12-20T04:21:11.850 INFO:teuthology.orchestra.run.smithi081.stdout:(87/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 534 kB/s | 44 kB 00:00 2023-12-20T04:21:11.892 INFO:teuthology.orchestra.run.smithi081.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.6 MB/s | 803 kB 00:00 2023-12-20T04:21:11.942 INFO:teuthology.orchestra.run.smithi081.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2023-12-20T04:21:11.984 INFO:teuthology.orchestra.run.smithi081.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2023-12-20T04:21:12.010 INFO:teuthology.orchestra.run.smithi081.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-20T04:21:12.068 INFO:teuthology.orchestra.run.smithi081.stdout:(92/154): python3-cryptography-36.0.1-4.el9.x86 9.3 MB/s | 1.1 MB 00:00 2023-12-20T04:21:12.093 INFO:teuthology.orchestra.run.smithi081.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2023-12-20T04:21:12.119 INFO:teuthology.orchestra.run.smithi081.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-12-20T04:21:12.161 INFO:teuthology.orchestra.run.smithi081.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 2.8 MB/s | 187 kB 00:00 2023-12-20T04:21:12.369 INFO:teuthology.orchestra.run.smithi081.stdout:(96/154): python3-devel-3.9.17-2.el9.x86_64.rpm 990 kB/s | 245 kB 00:00 2023-12-20T04:21:12.736 INFO:teuthology.orchestra.run.smithi081.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 193 kB/s | 111 kB 00:00 2023-12-20T04:21:12.828 INFO:teuthology.orchestra.run.smithi081.stdout:(98/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 5.6 MB/s | 4.1 MB 00:00 2023-12-20T04:21:13.104 INFO:teuthology.orchestra.run.smithi081.stdout:(99/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 421 kB/s | 309 kB 00:00 2023-12-20T04:21:13.212 INFO:teuthology.orchestra.run.smithi081.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 452 kB/s | 49 kB 00:00 2023-12-20T04:21:13.238 INFO:teuthology.orchestra.run.smithi081.stdout:(101/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 64 kB/s | 26 kB 00:00 2023-12-20T04:21:13.329 INFO:teuthology.orchestra.run.smithi081.stdout:(102/154): libunwind-1.6.2-1.el9.x86_64.rpm 580 kB/s | 67 kB 00:00 2023-12-20T04:21:13.421 INFO:teuthology.orchestra.run.smithi081.stdout:(103/154): libarrow-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2023-12-20T04:21:13.622 INFO:teuthology.orchestra.run.smithi081.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 218 kB/s | 43 kB 00:00 2023-12-20T04:21:13.672 INFO:teuthology.orchestra.run.smithi081.stdout:(105/154): python3-asyncssh-2.13.2-3.el9.noarch 1.6 MB/s | 548 kB 00:00 2023-12-20T04:21:13.714 INFO:teuthology.orchestra.run.smithi081.stdout:(106/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.7 MB/s | 838 kB 00:00 2023-12-20T04:21:13.756 INFO:teuthology.orchestra.run.smithi081.stdout:(107/154): python3-cachetools-4.2.4-1.el9.noarc 242 kB/s | 32 kB 00:00 2023-12-20T04:21:13.798 INFO:teuthology.orchestra.run.smithi081.stdout:(108/154): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2023-12-20T04:21:13.832 INFO:teuthology.orchestra.run.smithi081.stdout:(109/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2023-12-20T04:21:13.874 INFO:teuthology.orchestra.run.smithi081.stdout:(110/154): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2023-12-20T04:21:14.017 INFO:teuthology.orchestra.run.smithi081.stdout:(111/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.4 MB/s | 303 kB 00:00 2023-12-20T04:21:14.216 INFO:teuthology.orchestra.run.smithi081.stdout:(112/154): python3-colorama-0.4.4-12.el9.noarch 92 kB/s | 35 kB 00:00 2023-12-20T04:21:14.241 INFO:teuthology.orchestra.run.smithi081.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 48 kB/s | 11 kB 00:00 2023-12-20T04:21:14.284 INFO:teuthology.orchestra.run.smithi081.stdout:(114/154): python3-google-auth-2.23.4-1.el9.noa 483 kB/s | 197 kB 00:00 2023-12-20T04:21:14.342 INFO:teuthology.orchestra.run.smithi081.stdout:(115/154): python3-jaraco-classes-3.2.1-5.el9.n 142 kB/s | 18 kB 00:00 2023-12-20T04:21:14.362 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-12-20T04:21:14.367 INFO:teuthology.orchestra.run.smithi081.stdout:(116/154): python3-jaraco-collections-3.0.0-8.e 185 kB/s | 23 kB 00:00 2023-12-20T04:21:14.392 INFO:teuthology.orchestra.run.smithi081.stdout:(117/154): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2023-12-20T04:21:14.443 INFO:teuthology.orchestra.run.smithi081.stdout:(118/154): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2023-12-20T04:21:14.484 INFO:teuthology.orchestra.run.smithi081.stdout:(119/154): python3-jwt+crypto-2.4.0-1.el9.noarc 78 kB/s | 9.0 kB 00:00 2023-12-20T04:21:14.510 INFO:teuthology.orchestra.run.smithi081.stdout:(120/154): python3-jwt-2.4.0-1.el9.noarch.rpm 350 kB/s | 41 kB 00:00 2023-12-20T04:21:14.535 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-20T04:21:14.568 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-20T04:21:14.607 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-20T04:21:14.618 INFO:teuthology.orchestra.run.smithi081.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 348 kB/s | 46 kB 00:00 2023-12-20T04:21:14.644 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-20T04:21:14.652 INFO:teuthology.orchestra.run.smithi081.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 556 kB/s | 79 kB 00:00 2023-12-20T04:21:14.669 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-20T04:21:14.721 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-20T04:21:14.736 INFO:teuthology.orchestra.run.smithi081.stdout:(123/154): python3-kubernetes-26.1.0-2.el9.noar 3.5 MB/s | 1.0 MB 00:00 2023-12-20T04:21:14.752 INFO:teuthology.orchestra.run.smithi081.stdout:(124/154): python3-natsort-7.1.1-5.el9.noarch.r 433 kB/s | 58 kB 00:00 2023-12-20T04:21:14.794 INFO:teuthology.orchestra.run.smithi081.stdout:(125/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2023-12-20T04:21:14.836 INFO:teuthology.orchestra.run.smithi081.stdout:(126/154): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-12-20T04:21:14.870 INFO:teuthology.orchestra.run.smithi081.stdout:(127/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 770 kB/s | 90 kB 00:00 2023-12-20T04:21:14.912 INFO:teuthology.orchestra.run.smithi081.stdout:(128/154): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2023-12-20T04:21:14.971 INFO:teuthology.orchestra.run.smithi081.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 230 kB/s | 31 kB 00:00 2023-12-20T04:21:15.004 INFO:teuthology.orchestra.run.smithi081.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-12-20T04:21:15.029 INFO:teuthology.orchestra.run.smithi081.stdout:(131/154): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2023-12-20T04:21:15.054 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-20T04:21:15.071 INFO:teuthology.orchestra.run.smithi081.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 359 kB/s | 36 kB 00:00 2023-12-20T04:21:15.112 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:21:15.141 INFO:teuthology.orchestra.run.smithi069.stdout:(154/154): ceph-test-18.2.1-132.g568df92b.el9.x 2.8 MB/s | 40 MB 00:14 2023-12-20T04:21:15.146 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:21:15.146 INFO:teuthology.orchestra.run.smithi069.stdout:Total 9.8 MB/s | 200 MB 00:20 2023-12-20T04:21:15.155 INFO:teuthology.orchestra.run.smithi081.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 340 kB/s | 51 kB 00:00 2023-12-20T04:21:15.189 INFO:teuthology.orchestra.run.smithi081.stdout:(134/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2023-12-20T04:21:15.214 INFO:teuthology.orchestra.run.smithi081.stdout:(135/154): python3-websocket-client-1.2.3-2.el9 633 kB/s | 90 kB 00:00 2023-12-20T04:21:15.229 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:21:15.254 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:21:15.289 INFO:teuthology.orchestra.run.smithi081.stdout:(136/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2023-12-20T04:21:15.314 INFO:teuthology.orchestra.run.smithi081.stdout:(137/154): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2023-12-20T04:21:15.321 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-12-20T04:21:15.330 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:21:15.348 INFO:teuthology.orchestra.run.smithi081.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-12-20T04:21:15.359 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:21:15.402 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-20T04:21:15.510 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-12-20T04:21:15.510 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-12-20T04:21:15.549 INFO:teuthology.orchestra.run.smithi081.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2023-12-20T04:21:15.590 INFO:teuthology.orchestra.run.smithi081.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-20T04:21:15.592 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-20T04:21:15.632 INFO:teuthology.orchestra.run.smithi081.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-20T04:21:15.642 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-20T04:21:15.666 INFO:teuthology.orchestra.run.smithi081.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-20T04:21:15.669 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:21:15.708 INFO:teuthology.orchestra.run.smithi081.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-20T04:21:15.750 INFO:teuthology.orchestra.run.smithi081.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-20T04:21:15.763 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:21:15.783 INFO:teuthology.orchestra.run.smithi081.stdout:(145/154): libacl-2.3.1-4.el9.x86_64.rpm 671 kB/s | 22 kB 00:00 2023-12-20T04:21:15.795 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:21:15.859 INFO:teuthology.orchestra.run.smithi081.stdout:(146/154): librados2-18.2.1-132.g568df92b.el9.x 6.0 MB/s | 3.3 MB 00:00 2023-12-20T04:21:15.912 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:21:15.917 INFO:teuthology.orchestra.run.smithi081.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 2.4 MB/s | 321 kB 00:00 2023-12-20T04:21:16.016 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:21:16.059 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:21:16.121 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:16.176 INFO:teuthology.orchestra.run.smithi081.stdout:(148/154): librbd1-18.2.1-132.g568df92b.el9.x86 3.6 MB/s | 3.0 MB 00:00 2023-12-20T04:21:16.177 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:16.384 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:16.508 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-20T04:21:16.543 INFO:teuthology.orchestra.run.smithi081.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 119 kB/s | 43 kB 00:00 2023-12-20T04:21:16.548 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-20T04:21:16.622 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-20T04:21:16.673 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-20T04:21:16.702 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-20T04:21:16.746 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-20T04:21:16.787 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-20T04:21:16.861 INFO:teuthology.orchestra.run.smithi081.stdout:(150/154): NetworkManager-libnm-1.45.7-1.el9.x8 1.9 MB/s | 1.8 MB 00:00 2023-12-20T04:21:16.871 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-20T04:21:16.910 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-20T04:21:16.927 INFO:teuthology.orchestra.run.smithi081.stdout:(151/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2023-12-20T04:21:16.938 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-20T04:21:16.961 INFO:teuthology.orchestra.run.smithi081.stdout:(152/154): NetworkManager-tui-1.45.7-1.el9.x86_ 593 kB/s | 246 kB 00:00 2023-12-20T04:21:17.009 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-20T04:21:17.032 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-12-20T04:21:17.032 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-12-20T04:21:17.052 INFO:teuthology.orchestra.run.smithi081.stdout:(153/154): openssl-3.0.7-25.el9.x86_64.rpm 6.5 MB/s | 1.2 MB 00:00 2023-12-20T04:21:17.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-20T04:21:17.103 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-20T04:21:17.161 INFO:teuthology.orchestra.run.smithi081.stdout:(154/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2023-12-20T04:21:17.179 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-20T04:21:17.182 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:21:17.182 INFO:teuthology.orchestra.run.smithi081.stdout:Total 8.9 MB/s | 200 MB 00:22 2023-12-20T04:21:17.318 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-20T04:21:17.373 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-20T04:21:17.599 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-12-20T04:21:17.880 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-12-20T04:21:17.881 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-12-20T04:21:17.929 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-20T04:21:18.020 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-20T04:21:18.056 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-20T04:21:18.097 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-20T04:21:18.135 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-20T04:21:18.178 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-20T04:21:18.315 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-20T04:21:18.360 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-20T04:21:18.471 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-20T04:21:18.506 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-20T04:21:18.563 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-20T04:21:18.637 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-20T04:21:18.672 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-20T04:21:18.710 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-20T04:21:18.757 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-20T04:21:18.792 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-20T04:21:18.836 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-20T04:21:18.878 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-20T04:21:19.020 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-20T04:21:19.083 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-20T04:21:19.113 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-20T04:21:19.155 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-20T04:21:19.252 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-20T04:21:19.296 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-20T04:21:19.337 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-20T04:21:19.370 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-20T04:21:19.397 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-20T04:21:19.502 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-20T04:21:19.540 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-20T04:21:19.598 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-20T04:21:19.662 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-20T04:21:19.864 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-20T04:21:19.911 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-20T04:21:20.056 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-20T04:21:20.097 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-20T04:21:20.134 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-20T04:21:20.158 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-12-20T04:21:20.158 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-12-20T04:21:20.167 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-20T04:21:20.200 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-20T04:21:20.230 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-20T04:21:20.258 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-20T04:21:20.293 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-20T04:21:20.333 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-20T04:21:20.372 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-20T04:21:20.402 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-20T04:21:20.482 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-20T04:21:20.520 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-20T04:21:20.554 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-20T04:21:20.596 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-20T04:21:20.630 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-20T04:21:20.724 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-20T04:21:20.766 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-20T04:21:20.875 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-20T04:21:20.934 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-20T04:21:21.712 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-20T04:21:21.755 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-20T04:21:21.789 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-20T04:21:21.839 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-20T04:21:21.929 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-20T04:21:22.173 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-20T04:21:22.369 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-20T04:21:22.404 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-20T04:21:22.483 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-20T04:21:23.034 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-12-20T04:21:23.165 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-20T04:21:23.185 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-20T04:21:23.212 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-20T04:21:23.250 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-20T04:21:23.280 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-20T04:21:23.295 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-20T04:21:23.321 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-20T04:21:23.363 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-20T04:21:23.683 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-20T04:21:23.747 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:21:23.861 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:21:23.889 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:21:23.981 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:21:24.010 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:21:24.051 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-20T04:21:24.220 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-20T04:21:24.276 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-20T04:21:24.312 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:21:24.413 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:21:24.438 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:21:24.562 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-20T04:21:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:21:24.638 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-20T04:21:24.658 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:21:24.669 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-20T04:21:24.700 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-20T04:21:24.719 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:21:24.729 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-20T04:21:24.754 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-20T04:21:24.786 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:24.845 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:25.050 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:25.068 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-20T04:21:25.092 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:21:25.152 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-20T04:21:25.182 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-20T04:21:25.183 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:21:25.213 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-20T04:21:25.242 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-20T04:21:25.249 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-20T04:21:25.296 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-20T04:21:25.327 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-20T04:21:25.362 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-20T04:21:25.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-20T04:21:25.466 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-20T04:21:25.502 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-20T04:21:25.530 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-20T04:21:25.599 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-20T04:21:25.635 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-20T04:21:25.670 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-20T04:21:25.678 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-20T04:21:25.695 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:21:25.749 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:21:25.750 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-20T04:21:25.779 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-20T04:21:25.892 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-20T04:21:25.946 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-20T04:21:26.469 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-20T04:21:26.541 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-20T04:21:26.573 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-20T04:21:26.622 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-20T04:21:26.660 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-20T04:21:26.755 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-12-20T04:21:26.755 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-20T04:21:26.924 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-20T04:21:26.961 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-20T04:21:27.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-20T04:21:27.095 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-20T04:21:27.117 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-20T04:21:27.128 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-20T04:21:27.222 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-20T04:21:27.227 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-20T04:21:27.335 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-20T04:21:27.372 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-20T04:21:27.427 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-20T04:21:27.499 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-20T04:21:27.539 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-20T04:21:27.576 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-20T04:21:27.623 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-20T04:21:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-20T04:21:27.659 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-20T04:21:27.702 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-20T04:21:27.744 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-20T04:21:27.843 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:27.876 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:27.877 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-20T04:21:27.910 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:21:27.925 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-20T04:21:27.946 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-20T04:21:27.988 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-20T04:21:28.081 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-20T04:21:28.112 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:21:28.121 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-20T04:21:28.144 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:21:28.161 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-20T04:21:28.187 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-20T04:21:28.214 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-20T04:21:28.252 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:21:28.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:21:28.309 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-20T04:21:28.348 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-20T04:21:28.356 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-20T04:21:28.388 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-20T04:21:28.441 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:28.444 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-20T04:21:28.480 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:21:28.557 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:21:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-20T04:21:28.557 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-20T04:21:28.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:28.589 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:21:28.626 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-20T04:21:28.677 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-20T04:21:28.679 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-20T04:21:28.741 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-20T04:21:28.782 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:21:28.816 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-20T04:21:28.863 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-20T04:21:28.893 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-20T04:21:28.926 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-20T04:21:28.933 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:21:28.958 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-20T04:21:28.960 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:21:28.998 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-20T04:21:29.025 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-20T04:21:29.060 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-20T04:21:29.099 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-20T04:21:29.130 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-20T04:21:29.160 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-20T04:21:29.237 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-20T04:21:29.271 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-20T04:21:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-20T04:21:29.323 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:21:29.346 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-20T04:21:29.380 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-20T04:21:29.468 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-20T04:21:29.499 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-20T04:21:29.538 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:21:29.610 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-20T04:21:29.629 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:21:29.659 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-20T04:21:29.830 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:29.885 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:30.202 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:21:30.360 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-20T04:21:30.386 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-20T04:21:30.407 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-20T04:21:30.431 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-20T04:21:30.464 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-20T04:21:30.512 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-20T04:21:30.526 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-20T04:21:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-20T04:21:30.599 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-20T04:21:30.628 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-20T04:21:30.640 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-20T04:21:30.694 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-20T04:21:30.756 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-20T04:21:30.818 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-20T04:21:30.846 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-20T04:21:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-20T04:21:30.905 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-20T04:21:30.924 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-20T04:21:30.938 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-20T04:21:31.050 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-20T04:21:31.110 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-20T04:21:31.163 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-20T04:21:31.269 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-20T04:21:31.445 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-20T04:21:31.520 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-20T04:21:31.558 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-20T04:21:31.676 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-20T04:21:32.207 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-20T04:21:32.333 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-20T04:21:32.390 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-20T04:21:32.446 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-20T04:21:32.493 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-20T04:21:32.563 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-20T04:21:32.785 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-20T04:21:32.829 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-20T04:21:32.893 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-20T04:21:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-20T04:21:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-20T04:21:33.010 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-20T04:21:33.040 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-20T04:21:33.042 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-20T04:21:33.070 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-20T04:21:33.103 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-20T04:21:33.110 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-20T04:21:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-20T04:21:33.250 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-20T04:21:33.289 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-20T04:21:33.357 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-20T04:21:33.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-20T04:21:33.430 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-20T04:21:33.433 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:21:33.497 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-20T04:21:33.505 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:21:33.538 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-20T04:21:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-20T04:21:33.574 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-20T04:21:33.760 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-20T04:21:33.820 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-20T04:21:33.857 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-20T04:21:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-20T04:21:33.977 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-20T04:21:34.003 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:21:34.042 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-20T04:21:34.073 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:21:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-20T04:21:34.096 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-20T04:21:34.132 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-20T04:21:34.180 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-20T04:21:34.220 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-20T04:21:34.385 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-20T04:21:34.445 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-20T04:21:34.516 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-20T04:21:34.612 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-20T04:21:34.882 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-20T04:21:34.957 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-20T04:21:35.118 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-20T04:21:35.168 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-20T04:21:35.192 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-20T04:21:35.231 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-20T04:21:35.273 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-20T04:21:35.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-20T04:21:35.389 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-20T04:21:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-20T04:21:35.527 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-20T04:21:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-20T04:21:35.630 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-20T04:21:35.745 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-20T04:21:35.792 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-20T04:21:35.835 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-20T04:21:35.891 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-20T04:21:35.930 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-20T04:21:36.073 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-20T04:21:36.119 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-20T04:21:36.140 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:36.167 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:36.260 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-20T04:21:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-20T04:21:36.701 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:36.737 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:21:36.827 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:21:36.827 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-20T04:21:36.827 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-20T04:21:36.827 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:36.855 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:21:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-20T04:21:37.358 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-20T04:21:37.391 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-20T04:21:37.450 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-20T04:21:37.560 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-20T04:21:37.628 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-20T04:21:37.861 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-20T04:21:37.889 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-20T04:21:37.992 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-20T04:21:38.789 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-20T04:21:38.918 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-20T04:21:40.415 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:21:40.415 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2023-12-20T04:21:40.415 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2023-12-20T04:21:40.416 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2023-12-20T04:21:40.416 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2023-12-20T04:21:40.416 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2023-12-20T04:21:40.416 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2023-12-20T04:21:40.416 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2023-12-20T04:21:40.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:40.487 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-20T04:21:40.593 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:21:40.595 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-20T04:21:40.611 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:21:40.611 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:40.612 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-20T04:21:40.612 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:40.633 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-20T04:21:40.663 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-20T04:21:40.733 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-20T04:21:40.776 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-20T04:21:41.150 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-20T04:21:41.185 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:21:41.287 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:21:41.315 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-20T04:21:41.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-20T04:21:41.826 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-20T04:21:41.871 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:21:41.962 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:21:41.990 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-20T04:21:42.221 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:21:42.249 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:21:42.249 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:42.249 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-20T04:21:42.249 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:21:42.249 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:21:42.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:42.480 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:21:42.505 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:21:42.505 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:42.505 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-20T04:21:42.505 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:21:42.505 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:21:42.505 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:42.973 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:21:42.996 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:21:42.997 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:42.997 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-20T04:21:42.997 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:21:42.997 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:21:42.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:43.092 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-20T04:21:43.470 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:21:43.498 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:21:43.535 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-20T04:21:43.599 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-20T04:21:43.631 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:21:43.865 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:21:43.890 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:21:44.330 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:44.361 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:44.905 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:21:44.941 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:21:44.981 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:21:45.032 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:21:45.046 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:21:45.196 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:21:45.196 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-20T04:21:45.196 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-20T04:21:45.196 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:21:45.203 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-20T04:21:45.232 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:21:45.234 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:21:45.258 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:21:45.258 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:45.258 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-20T04:21:45.258 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:21:45.258 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:21:45.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:45.302 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:21:45.313 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:21:45.361 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-20T04:21:46.100 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-20T04:21:46.129 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:21:46.152 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:21:46.152 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:46.152 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-20T04:21:46.153 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:21:46.153 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:21:46.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:46.196 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:21:46.219 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:21:46.220 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:46.220 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-20T04:21:46.220 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:46.263 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:21:46.288 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:21:46.288 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:46.288 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-20T04:21:46.288 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:21:46.288 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:21:46.288 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:46.606 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:21:46.630 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:21:46.630 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:46.630 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-20T04:21:46.631 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:21:46.631 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:21:46.631 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:21:47.951 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:21:47.951 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2023-12-20T04:21:47.951 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2023-12-20T04:21:47.952 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2023-12-20T04:21:47.952 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2023-12-20T04:21:47.952 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2023-12-20T04:21:47.952 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /root 2023-12-20T04:21:47.952 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2023-12-20T04:21:47.952 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:48.117 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:21:48.133 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:21:48.133 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:48.133 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-20T04:21:48.133 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:49.654 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:21:49.679 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:21:49.679 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:49.680 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-20T04:21:49.680 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:21:49.680 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:21:49.680 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:49.879 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:21:49.902 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:21:49.902 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:49.902 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-20T04:21:49.902 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:21:49.902 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:21:49.902 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:50.355 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:21:50.377 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:21:50.378 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:50.378 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-20T04:21:50.378 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:21:50.378 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:21:50.378 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:50.465 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-20T04:21:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-20T04:21:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-20T04:21:50.601 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-20T04:21:50.632 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-20T04:21:50.659 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-20T04:21:50.844 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:21:50.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-20T04:21:50.863 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:21:50.892 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-20T04:21:50.954 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-20T04:21:50.967 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-20T04:21:50.978 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:21:50.998 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-20T04:21:51.030 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-20T04:21:51.084 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-20T04:21:51.129 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:21:51.165 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-20T04:21:51.202 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:21:51.203 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-20T04:21:51.229 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:21:51.240 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-20T04:21:51.821 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:21:51.865 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:21:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:21:52.202 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:21:52.229 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:21:52.329 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:21:52.477 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-20T04:21:52.506 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:21:52.529 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:21:52.529 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:52.530 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-20T04:21:52.530 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:21:52.530 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:21:52.530 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:52.573 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:21:52.584 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:21:52.620 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-20T04:21:52.793 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-20T04:21:52.887 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-20T04:21:52.943 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-20T04:21:52.986 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-20T04:21:53.069 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-20T04:21:53.098 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-20T04:21:53.123 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-20T04:21:53.148 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-20T04:21:53.175 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-20T04:21:53.175 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:21:53.243 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:21:53.271 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-20T04:21:53.301 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-20T04:21:53.326 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-20T04:21:53.326 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:21:53.334 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-20T04:21:53.375 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:21:53.398 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:21:53.398 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:53.398 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-20T04:21:53.398 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:21:53.398 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:21:53.398 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:53.411 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:21:53.435 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:21:53.442 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:21:53.442 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:21:53.443 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:21:53.465 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:21:53.465 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:53.465 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-20T04:21:53.465 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:53.510 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:21:53.533 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:21:53.533 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:53.533 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-20T04:21:53.533 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:21:53.533 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:21:53.533 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:53.630 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:21:53.630 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:21:53.705 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:21:53.729 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-20T04:21:53.755 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-20T04:21:53.780 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-20T04:21:53.828 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:21:53.846 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:21:53.850 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:21:53.850 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:53.851 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-20T04:21:53.851 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:21:53.851 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:21:53.851 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:21:57.523 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-20T04:21:57.563 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-20T04:21:57.627 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-20T04:21:57.661 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-20T04:21:57.688 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-20T04:21:57.873 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-20T04:21:57.965 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2023-12-20T04:21:57.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:21:57.984 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-20T04:21:58.010 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-20T04:21:58.026 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-20T04:21:58.084 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-20T04:21:58.134 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:21:58.179 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-20T04:21:58.202 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:21:58.209 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-20T04:21:58.246 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-20T04:21:58.253 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:21:58.253 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:21:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-20T04:21:58.254 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:21:58.286 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:21:58.286 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-20T04:21:58.286 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-20T04:21:58.287 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-20T04:21:58.288 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-20T04:21:58.289 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-20T04:21:58.290 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-20T04:21:58.291 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-20T04:21:58.292 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-20T04:21:58.293 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-20T04:21:58.294 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-20T04:21:58.295 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-20T04:21:58.296 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:21:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-20T04:21:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-20T04:21:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-20T04:21:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-20T04:21:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-20T04:21:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-20T04:21:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-20T04:21:58.298 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-20T04:21:58.299 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:21:58.299 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-20T04:21:58.299 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:21:58.299 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-20T04:21:58.299 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-20T04:21:58.299 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-20T04:21:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:21:58.871 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:21:58.891 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:21:59.708 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-20T04:21:59.809 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-20T04:21:59.850 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-20T04:21:59.890 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-20T04:21:59.968 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:21:59.970 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-20T04:22:00.004 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-20T04:22:00.037 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-20T04:22:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:22:00.062 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:00.062 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-20T04:22:00.062 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:22:00.062 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:22:00.062 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:00.062 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-20T04:22:00.089 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-20T04:22:00.089 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:22:00.165 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:22:00.193 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-20T04:22:00.223 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-20T04:22:00.249 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-20T04:22:00.249 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:22:00.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:22:00.333 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:22:00.358 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:22:00.365 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:22:00.365 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:22:00.371 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:22:00.371 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:00.371 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-20T04:22:00.371 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:22:00.371 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:22:00.371 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:00.544 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:22:00.545 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:22:00.628 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:22:00.652 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-20T04:22:00.672 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-20T04:22:00.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:00.672 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-12-20T04:22:00.672 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:00.672 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:00.672 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:00.672 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: acl-2.3.1-4.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-12-20T04:22:00.673 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.674 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2023-12-20T04:22:00.675 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-16.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-20T04:22:00.676 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-20T04:22:00.677 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.11-1.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.678 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-20T04:22:00.679 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-20T04:22:00.680 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-20T04:22:00.681 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-20T04:22:00.682 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-3.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-20T04:22:00.683 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-20T04:22:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-20T04:22:00.684 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-20T04:22:00.684 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:00.684 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-12-20T04:22:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-20T04:22:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:22:00.860 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:22:00.942 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:22:00.942 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:00.942 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-20T04:22:00.942 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:22:00.942 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:22:00.942 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:01.062 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-20T04:22:01.199 DEBUG:teuthology.parallel:result is None 2023-12-20T04:22:01.663 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:22:01.706 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:22:01.752 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-20T04:22:01.857 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-20T04:22:01.884 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:22:02.202 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:22:02.243 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:22:03.371 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:22:03.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:22:03.544 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:22:03.709 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-20T04:22:03.745 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:22:03.836 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:22:03.837 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:03.837 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-20T04:22:03.837 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:22:03.837 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:22:03.837 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:03.897 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:22:03.937 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:22:04.033 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-20T04:22:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-20T04:22:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:22:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:22:04.969 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:04.969 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-20T04:22:04.970 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:22:04.970 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:22:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-20T04:22:05.027 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-20T04:22:05.028 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-20T04:22:05.029 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-20T04:22:05.029 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-20T04:22:05.029 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-20T04:22:05.029 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-20T04:22:05.029 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-20T04:22:05.029 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-20T04:22:05.043 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-20T04:22:05.043 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-20T04:22:05.043 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-20T04:22:05.044 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-20T04:22:05.045 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-20T04:22:05.046 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-20T04:22:05.047 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-20T04:22:05.048 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-20T04:22:05.049 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-20T04:22:05.050 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-20T04:22:05.052 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-20T04:22:05.052 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-20T04:22:05.052 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-20T04:22:05.052 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-20T04:22:05.053 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-20T04:22:05.054 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-20T04:22:05.055 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-20T04:22:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:22:05.092 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:05.093 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-20T04:22:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:22:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:22:05.284 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-20T04:22:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:22:05.285 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:22:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:05.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:22:05.756 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:22:05.756 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:22:05.756 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-20T04:22:05.756 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:22:05.756 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:22:05.756 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:07.510 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: acl-2.3.1-4.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.511 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.2-8.el9.noarch 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.7.4-5.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.512 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.513 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.4-9.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: jq-1.6-16.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-20T04:22:07.514 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-20T04:22:07.515 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-13.11-1.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-20T04:22:07.516 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-20T04:22:07.517 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-20T04:22:07.518 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply-3.11-14.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-20T04:22:07.519 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-20T04:22:07.520 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: re2-1:20211101-3.el9.x86_64 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-20T04:22:07.521 INFO:teuthology.orchestra.run.smithi069.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-20T04:22:07.522 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-20T04:22:07.522 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-20T04:22:07.522 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-20T04:22:07.522 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:07.523 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-12-20T04:22:08.062 DEBUG:teuthology.parallel:result is None 2023-12-20T04:22:09.714 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-20T04:22:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-20T04:22:09.837 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-20T04:22:09.871 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-20T04:22:09.910 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-20T04:22:10.195 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-20T04:22:10.320 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-20T04:22:10.351 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-20T04:22:10.393 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-20T04:22:10.491 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-20T04:22:10.600 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:22:10.663 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-20T04:22:10.717 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-20T04:22:10.796 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-20T04:22:11.802 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:22:11.852 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:22:11.917 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:22:13.234 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-20T04:22:13.564 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-20T04:22:13.951 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-20T04:22:14.056 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-20T04:22:14.228 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-20T04:22:14.270 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-20T04:22:14.303 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-20T04:22:14.337 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-20T04:22:14.380 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-20T04:22:14.380 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:22:14.546 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:22:14.603 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-20T04:22:14.649 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-20T04:22:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-20T04:22:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:22:14.828 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:22:14.859 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:22:14.898 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:22:14.899 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:22:15.233 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:22:15.234 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:22:15.400 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:22:15.436 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-20T04:22:15.473 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-20T04:22:15.505 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-20T04:22:15.631 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:22:15.911 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:22:15.912 INFO:teuthology.orchestra.run.smithi081.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-20T04:22:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:20.325 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-20T04:22:20.325 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-20T04:22:20.325 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-20T04:22:20.325 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-20T04:22:20.325 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-20T04:22:20.325 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-20T04:22:20.326 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-20T04:22:20.327 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-20T04:22:20.343 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-20T04:22:20.344 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-20T04:22:20.344 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-20T04:22:20.344 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-20T04:22:20.344 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-20T04:22:20.344 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-20T04:22:20.344 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-20T04:22:20.344 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-20T04:22:20.345 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-20T04:22:20.345 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-20T04:22:20.345 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-20T04:22:20.345 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-20T04:22:20.345 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-20T04:22:20.345 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-20T04:22:20.346 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-20T04:22:20.346 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-20T04:22:20.346 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-20T04:22:20.346 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-20T04:22:20.346 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-20T04:22:20.346 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-20T04:22:20.346 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-20T04:22:20.347 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-20T04:22:20.348 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-20T04:22:20.349 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-20T04:22:20.349 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-20T04:22:20.349 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-20T04:22:20.349 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-20T04:22:20.349 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-20T04:22:20.349 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-20T04:22:20.349 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-20T04:22:20.350 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-20T04:22:20.351 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-20T04:22:20.352 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-20T04:22:20.353 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-20T04:22:20.354 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-20T04:22:20.355 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-20T04:22:20.356 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:22:20.357 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-20T04:22:20.358 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-20T04:22:20.358 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-20T04:22:22.618 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-20T04:22:22.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:22.618 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: acl-2.3.1-4.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-20T04:22:22.619 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-20T04:22:22.620 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.621 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-20T04:22:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.6-16.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-20T04:22:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-20T04:22:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.11-1.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-20T04:22:22.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-20T04:22:22.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-20T04:22:22.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-20T04:22:22.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-20T04:22:22.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-20T04:22:22.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-20T04:22:22.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-20T04:22:22.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-20T04:22:22.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-20T04:22:22.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-20T04:22:22.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-3.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-20T04:22:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-20T04:22:22.633 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-20T04:22:22.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:22.633 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-20T04:22:23.200 DEBUG:teuthology.parallel:result is None 2023-12-20T04:22:23.201 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:22:23.427 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-20T04:22:23.453 INFO:teuthology.orchestra.run.smithi040.stdout:18.2.1-132.g568df92b.el9 2023-12-20T04:22:23.457 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-20T04:22:23.458 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-20T04:22:23.460 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:22:23.603 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-20T04:22:23.628 INFO:teuthology.orchestra.run.smithi069.stdout:18.2.1-132.g568df92b.el9 2023-12-20T04:22:23.629 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-20T04:22:23.629 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-20T04:22:23.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:22:23.854 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-20T04:22:23.913 INFO:teuthology.orchestra.run.smithi081.stdout:18.2.1-132.g568df92b.el9 2023-12-20T04:22:23.913 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-20T04:22:23.913 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-20T04:22:23.915 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-20T04:22:23.915 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:23.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-20T04:22:23.955 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:23.955 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-20T04:22:23.990 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:22:23.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-20T04:22:24.069 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-20T04:22:24.069 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:24.069 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-12-20T04:22:24.103 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-20T04:22:24.177 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:24.177 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2023-12-20T04:22:24.210 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-20T04:22:24.280 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:22:24.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-12-20T04:22:24.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-20T04:22:24.442 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-20T04:22:24.442 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:24.442 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-20T04:22:24.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-20T04:22:24.545 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:24.546 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-20T04:22:24.577 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-20T04:22:24.647 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:22:24.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-20T04:22:24.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-20T04:22:24.853 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-20T04:22:24.853 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:24.853 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-12-20T04:22:24.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-20T04:22:24.954 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:24.955 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2023-12-20T04:22:24.986 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-20T04:22:25.057 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:22:25.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-12-20T04:22:25.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-20T04:22:25.248 INFO:teuthology.run_tasks:Running task ceph... 2023-12-20T04:22:25.332 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-20T04:22:25.332 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-12-20T04:22:25.334 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /var/log/ceph 2023-12-20T04:22:25.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-12-20T04:22:25.409 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-20T04:22:25.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-20T04:22:25.412 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-20T04:22:25.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-20T04:22:25.490 INFO:tasks.ceph:Creating extra log directories... 2023-12-20T04:22:25.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-20T04:22:25.493 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-20T04:22:25.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-20T04:22:25.572 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-20T04:22:25.573 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-20T04:22:25.573 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-20T04:22:25.573 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:25.573 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-20T04:22:25.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:25.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:25.748 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:25.748 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-20T04:22:25.767 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:25.888 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:25.917 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:22:25.917 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-20T04:22:25.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:26.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:26.250 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-20T04:22:26.250 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-20T04:22:26.250 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369', 'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7497369', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 430, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'sleep_before_teardown': 0, 'subset': '301/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNMeyIaMbRTMJ/GOxgiXdQ9nS8ivj0WJC5O0HokCYz/avMeFbOBU37TcnRVsjcMkgTHNoqC8RWrzDsAH3EJoA4I=', 'smithi069.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfb32TMLEklnuYQ6QWhl8UY/5pb5s9SeuUuTQakJjn0vUVGNZ/AZWTyj47fOiAJTRrkSU3v+0RH9aXN5UEx5Q0=', 'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEL68mI9LdfPnXdSy7nEiEfcpEWspR7LoJ2s8SWIBoE6lEtm0Zeh/r/Id0IS/P72TNlz9VheDqrCSO2eS7FsHaY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-20_03:59:06', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-20T04:22:26.251 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-20T04:22:26.253 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-20T04:22:26.255 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-20T04:22:26.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-12-20T04:22:26.310 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/run/ceph 2023-12-20T04:22:26.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-12-20T04:22:26.423 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:26.424 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-12-20T04:22:26.440 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-20T04:22:26.440 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-12-20T04:22:26.496 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 661 Links: 1 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-20 04:21:54.179671945 +0000 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-20 04:16:10.055130406 +0000 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-20 04:16:10.055130406 +0000 2023-12-20T04:22:26.497 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-20 04:16:10.055130406 +0000 2023-12-20T04:22:26.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-20T04:22:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-20T04:22:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-20T04:22:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000211133 s, 2.4 MB/s 2023-12-20T04:22:26.567 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-20T04:22:26.624 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-20 04:21:54.179671945 +0000 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-20 04:16:10.646122594 +0000 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-20 04:16:10.646122594 +0000 2023-12-20T04:22:26.680 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-20 04:16:10.646122594 +0000 2023-12-20T04:22:26.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-20T04:22:26.749 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-20T04:22:26.749 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-20T04:22:26.749 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000192155 s, 2.7 MB/s 2023-12-20T04:22:26.750 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-20T04:22:26.807 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-12-20T04:22:26.862 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-20T04:22:26.862 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:26.863 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-20T04:22:26.863 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:26.863 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:26.863 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-20 04:21:54.180671932 +0000 2023-12-20T04:22:26.863 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-20 04:16:11.179115566 +0000 2023-12-20T04:22:26.863 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-20 04:16:11.179115566 +0000 2023-12-20T04:22:26.863 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-20 04:16:11.179115566 +0000 2023-12-20T04:22:26.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-20T04:22:26.931 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-20T04:22:26.931 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-20T04:22:26.932 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000246224 s, 2.1 MB/s 2023-12-20T04:22:26.933 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-20T04:22:26.989 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-12-20T04:22:27.044 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-20T04:22:27.044 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:27.044 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 718 Links: 1 2023-12-20T04:22:27.044 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:27.044 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:27.044 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-12-20 04:21:54.180671932 +0000 2023-12-20T04:22:27.044 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-12-20 04:16:11.708108591 +0000 2023-12-20T04:22:27.045 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-12-20 04:16:11.708108591 +0000 2023-12-20T04:22:27.045 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-12-20 04:16:11.708108591 +0000 2023-12-20T04:22:27.045 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-20T04:22:27.113 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-12-20T04:22:27.113 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-12-20T04:22:27.113 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000180893 s, 2.8 MB/s 2023-12-20T04:22:27.114 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-20T04:22:27.170 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:27.170 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:27.170 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2023-12-20T04:22:27.190 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-20T04:22:27.190 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2023-12-20T04:22:27.247 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-20 04:22:01.092607395 +0000 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-20 04:15:50.725816463 +0000 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-20 04:15:50.725816463 +0000 2023-12-20T04:22:27.248 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-20 04:15:50.725816463 +0000 2023-12-20T04:22:27.248 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-20T04:22:27.317 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-20T04:22:27.317 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-20T04:22:27.317 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000220079 s, 2.3 MB/s 2023-12-20T04:22:27.318 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-20T04:22:27.376 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2023-12-20T04:22:27.433 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-20T04:22:27.433 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:27.433 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-20T04:22:27.433 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:27.433 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:27.433 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-20 04:22:01.092607395 +0000 2023-12-20T04:22:27.433 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-20 04:15:51.331802651 +0000 2023-12-20T04:22:27.434 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-20 04:15:51.331802651 +0000 2023-12-20T04:22:27.434 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-20 04:15:51.331802651 +0000 2023-12-20T04:22:27.434 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-20T04:22:27.500 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-20T04:22:27.500 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-20T04:22:27.501 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000177874 s, 2.9 MB/s 2023-12-20T04:22:27.502 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-20T04:22:27.558 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2023-12-20T04:22:27.613 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-20 04:22:01.093607372 +0000 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-20 04:15:51.880790137 +0000 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-20 04:15:51.880790137 +0000 2023-12-20T04:22:27.614 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-20 04:15:51.880790137 +0000 2023-12-20T04:22:27.614 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-20T04:22:27.680 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-20T04:22:27.680 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-20T04:22:27.680 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000200136 s, 2.6 MB/s 2023-12-20T04:22:27.682 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-20T04:22:27.737 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2023-12-20T04:22:27.791 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-20T04:22:27.791 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:22:27.792 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 718 Links: 1 2023-12-20T04:22:27.792 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:22:27.792 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:22:27.792 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-12-20 04:22:01.093607372 +0000 2023-12-20T04:22:27.792 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-12-20 04:15:52.427777669 +0000 2023-12-20T04:22:27.792 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-12-20 04:15:52.427777669 +0000 2023-12-20T04:22:27.792 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2023-12-20 04:15:52.427777669 +0000 2023-12-20T04:22:27.792 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-20T04:22:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-12-20T04:22:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-12-20T04:22:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.00018862 s, 2.7 MB/s 2023-12-20T04:22:27.858 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-20T04:22:27.914 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:27.914 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-20T04:22:27.914 INFO:tasks.ceph:Generating config... 2023-12-20T04:22:27.915 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-20T04:22:27.916 INFO:tasks.ceph:[client] debug client = 20 2023-12-20T04:22:27.916 INFO:tasks.ceph:[client] debug ms = 1 2023-12-20T04:22:27.916 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-20T04:22:27.916 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-20T04:22:27.916 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-20T04:22:27.916 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-20T04:22:27.917 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-20T04:22:27.917 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-20T04:22:27.917 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-20T04:22:27.917 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-20T04:22:27.917 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-20T04:22:27.917 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-20T04:22:27.917 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-20T04:22:27.917 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-20T04:22:27.918 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-20T04:22:27.918 INFO:tasks.ceph:Setting up mon.a... 2023-12-20T04:22:27.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-20T04:22:27.977 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2023-12-20T04:22:27.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-20T04:22:28.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-20T04:22:28.063 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.69'), ('mon.c', '[v2:172.21.15.69:3301,v1:172.21.15.69:6790]')] 2023-12-20T04:22:28.064 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-20T04:22:28.065 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:28.065 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-20T04:22:28.120 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.69 --addv c '[v2:172.21.15.69:3301,v1:172.21.15.69:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 9ed6574e-2792-4eae-92b0-945f286f0eed 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = pacific 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 9ed6574e-2792-4eae-92b0-945f286f0eed 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2023-12-20T04:22:28.206702+0000 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:created 2023-12-20T04:22:28.206702+0000 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 16 (pacific) 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2023-12-20T04:22:28.206 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2023-12-20T04:22:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.b 2023-12-20T04:22:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] mon.c 2023-12-20T04:22:28.207 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-20T04:22:28.208 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-20T04:22:28.223 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9ed6574e-2792-4eae-92b0-945f286f0eed... 2023-12-20T04:22:28.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-20T04:22:28.266 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-20T04:22:28.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-20T04:22:28.318 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-12-20T04:22:28.318 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.319 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2023-12-20T04:22:28.320 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-20T04:22:28.321 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-20T04:22:28.322 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2023-12-20T04:22:28.322 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.322 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-20T04:22:28.322 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.322 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2023-12-20T04:22:28.322 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.323 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2023-12-20T04:22:28.323 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.323 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2023-12-20T04:22:28.323 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2023-12-20T04:22:28.323 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2023-12-20T04:22:28.323 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.40,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]" 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn min per osd = 0 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = 9ed6574e-2792-4eae-92b0-945f286f0eed 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.324 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2023-12-20T04:22:28.325 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2023-12-20T04:22:28.325 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.325 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2023-12-20T04:22:28.325 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2023-12-20T04:22:28.325 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2023-12-20T04:22:28.325 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.325 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2023-12-20T04:22:28.326 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.327 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2023-12-20T04:22:28.327 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2023-12-20T04:22:28.327 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2023-12-20T04:22:28.327 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2023-12-20T04:22:28.327 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore allocator = bitmap 2023-12-20T04:22:28.327 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2023-12-20T04:22:28.328 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2023-12-20T04:22:28.328 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2023-12-20T04:22:28.328 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2023-12-20T04:22:28.328 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-20T04:22:28.328 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2023-12-20T04:22:28.328 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-12-20T04:22:28.329 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2023-12-20T04:22:28.330 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-12-20T04:22:28.331 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2023-12-20T04:22:28.331 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2023-12-20T04:22:28.331 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:22:28.331 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2023-12-20T04:22:28.331 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2023-12-20T04:22:28.331 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:22:28.331 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: mon op complaint time = 120 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T04:22:28.332 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: client mount timeout = 600 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-12-20T04:22:28.333 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout:[mds] 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds = 20 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds balancer = 20 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug frag = True 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug scatterstat = True 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: mds op complaint time = 180 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: mds verify scatter = True 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-12-20T04:22:28.334 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-12-20T04:22:28.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.336 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.337 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]" 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn min per osd = 0 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 9ed6574e-2792-4eae-92b0-945f286f0eed 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.338 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-12-20T04:22:28.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-12-20T04:22:28.340 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-12-20T04:22:28.341 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.342 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-12-20T04:22:28.343 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-12-20T04:22:28.344 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-12-20T04:22:28.345 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.441 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.442 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-12-20T04:22:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-20T04:22:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-12-20T04:22:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-12-20T04:22:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-12-20T04:22:28.443 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-20T04:22:28.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.40,172.21.15.69,[v2:172.21.15.69:3301,v1:172.21.15.69:6790]" 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn min per osd = 0 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 9ed6574e-2792-4eae-92b0-945f286f0eed 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.445 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-12-20T04:22:28.446 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-12-20T04:22:28.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2023-12-20T04:22:28.448 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-12-20T04:22:28.449 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-12-20T04:22:28.450 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-20T04:22:28.451 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-12-20T04:22:28.452 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-20T04:22:28.453 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-12-20T04:22:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-12-20T04:22:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-12-20T04:22:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2023-12-20T04:22:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-12-20T04:22:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-12-20T04:22:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-12-20T04:22:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-12-20T04:22:28.455 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-12-20T04:22:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-12-20T04:22:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-12-20T04:22:28.456 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-12-20T04:22:28.484 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-20T04:22:28.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-20T04:22:28.544 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-20T04:22:28.544 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:28.544 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-20T04:22:28.559 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:28.559 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-20T04:22:28.616 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T04:22:28.617 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:28.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-20T04:22:28.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-20T04:22:28.702 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:28.702 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:28.757 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T04:22:28.757 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:28.757 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-20T04:22:28.758 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-20T04:22:28.797 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:22:28.797 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:28.851 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-12-20T04:22:28.851 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:22:28.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-20T04:22:28.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-20T04:22:28.988 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:22:28.988 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:29.080 INFO:tasks.ceph:Setting up mon nodes... 2023-12-20T04:22:29.080 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-20T04:22:29.080 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-20T04:22:29.143 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-20T04:22:29.145 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-20T04:22:29.206 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-20T04:22:29.206 INFO:tasks.ceph:Setting up mds nodes... 2023-12-20T04:22:29.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-20T04:22:29.269 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-20T04:22:29.271 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-20T04:22:29.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-20T04:22:29.403 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-20T04:22:29.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-20T04:22:29.436 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-20T04:22:29.490 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-20T04:22:29.493 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-20T04:22:29.519 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-20T04:22:29.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-20T04:22:29.638 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-20T04:22:29.694 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-20T04:22:29.694 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-20T04:22:29.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-20T04:22:29.726 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:29.726 INFO:tasks.ceph:role: osd.0 2023-12-20T04:22:29.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T04:22:29.726 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-20T04:22:29.804 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:29.805 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-20T04:22:30.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-20T04:22:30.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-20T04:22:30.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-20T04:22:30.470 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-20T04:22:30.543 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:30.543 INFO:tasks.ceph:role: osd.1 2023-12-20T04:22:30.543 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T04:22:30.543 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:30.622 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:31.075 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-20T04:22:31.077 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-20T04:22:31.077 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-20T04:22:31.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-20T04:22:31.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-20T04:22:31.277 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:31.277 INFO:tasks.ceph:role: osd.2 2023-12-20T04:22:31.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T04:22:31.278 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-20T04:22:31.356 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:31.356 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:31.356 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:31.356 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:31.357 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:31.357 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:31.357 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:31.841 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-20T04:22:31.843 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-20T04:22:31.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-20T04:22:31.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-20T04:22:32.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-20T04:22:32.096 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:32.096 INFO:tasks.ceph:role: osd.3 2023-12-20T04:22:32.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T04:22:32.096 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:32.176 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:32.640 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-12-20T04:22:32.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-12-20T04:22:32.642 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-20T04:22:32.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-20T04:22:32.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:32.897+0000 7f413ea14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-20T04:22:32.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:32.898+0000 7f413ea14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-20T04:22:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:32.898+0000 7f413ea14500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-20T04:22:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:32.898+0000 7f413ea14500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-20T04:22:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:32.898+0000 7f413ea14500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-20T04:22:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:32.899+0000 7f413ea14500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-20T04:22:35.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-20T04:22:35.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:35.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:35.883+0000 7f8f5f614500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-20T04:22:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:35.884+0000 7f8f5f614500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-20T04:22:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:35.884+0000 7f8f5f614500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-20T04:22:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:35.884+0000 7f8f5f614500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-20T04:22:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:35.884+0000 7f8f5f614500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-20T04:22:35.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:35.884+0000 7f8f5f614500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-20T04:22:38.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-20T04:22:38.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:38.863+0000 7fe6f121b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-20T04:22:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:38.863+0000 7fe6f121b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-20T04:22:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:38.863+0000 7fe6f121b500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-20T04:22:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:38.863+0000 7fe6f121b500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-20T04:22:38.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:38.863+0000 7fe6f121b500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-20T04:22:38.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:38.864+0000 7fe6f121b500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-20T04:22:41.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-20T04:22:41.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:41.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:41.853+0000 7f361cb22500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-20T04:22:41.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:41.853+0000 7f361cb22500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-20T04:22:41.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:41.853+0000 7f361cb22500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-20T04:22:41.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:41.853+0000 7f361cb22500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-20T04:22:41.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:41.853+0000 7f361cb22500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-20T04:22:41.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:22:41.854+0000 7f361cb22500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-20T04:22:44.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-20T04:22:44.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-20T04:22:44.776 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:44.776 INFO:tasks.ceph:role: osd.4 2023-12-20T04:22:44.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T04:22:44.776 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-20T04:22:44.853 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:44.853 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:44.853 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:44.853 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:44.854 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:44.854 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:44.854 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:44.854 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:44.854 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:44.854 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:45.339 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-20T04:22:45.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-20T04:22:45.342 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-20T04:22:45.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-20T04:22:45.508 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-20T04:22:45.576 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:45.576 INFO:tasks.ceph:role: osd.5 2023-12-20T04:22:45.577 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T04:22:45.577 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:45.652 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:46.109 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-20T04:22:46.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-20T04:22:46.111 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-20T04:22:46.211 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-20T04:22:46.243 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-20T04:22:46.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:46.312 INFO:tasks.ceph:role: osd.6 2023-12-20T04:22:46.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T04:22:46.312 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-20T04:22:46.386 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:46.386 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:46.386 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:46.387 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:46.387 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:46.387 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:46.387 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:46.387 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:46.387 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:46.387 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:46.872 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-20T04:22:46.875 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-20T04:22:46.875 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-20T04:22:46.996 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-20T04:22:47.031 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-20T04:22:47.100 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:22:47.100 INFO:tasks.ceph:role: osd.7 2023-12-20T04:22:47.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T04:22:47.101 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-20T04:22:47.175 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:22:47.175 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:22:47.175 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:22:47.175 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:22:47.175 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:22:47.175 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:22:47.175 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:22:47.176 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:22:47.176 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:22:47.176 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:22:47.685 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-12-20T04:22:47.688 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-12-20T04:22:47.688 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-20T04:22:47.831 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-20T04:22:47.879 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:47.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:47.971+0000 7f6988a25500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-20T04:22:47.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:47.972+0000 7f6988a25500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-20T04:22:47.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:47.972+0000 7f6988a25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-20T04:22:47.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:47.972+0000 7f6988a25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-20T04:22:47.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:47.972+0000 7f6988a25500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-20T04:22:47.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:47.972+0000 7f6988a25500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-20T04:22:50.820 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-20T04:22:50.850 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:50.940+0000 7f76a88da500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-20T04:22:50.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:50.940+0000 7f76a88da500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-20T04:22:50.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:50.941+0000 7f76a88da500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-20T04:22:50.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:50.941+0000 7f76a88da500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-20T04:22:50.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:50.941+0000 7f76a88da500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-20T04:22:50.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:50.941+0000 7f76a88da500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-20T04:22:53.789 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-20T04:22:53.822 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:53.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:53.911+0000 7f73e9325500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-20T04:22:53.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:53.912+0000 7f73e9325500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-20T04:22:53.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:53.912+0000 7f73e9325500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-20T04:22:53.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:53.912+0000 7f73e9325500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-20T04:22:53.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:53.912+0000 7f73e9325500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-20T04:22:53.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:53.912+0000 7f73e9325500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-20T04:22:56.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:56.255 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:56.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:22:56.774 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-20T04:22:56.804 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:56.892+0000 7f6d0681a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-20T04:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:56.892+0000 7f6d0681a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-20T04:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:56.892+0000 7f6d0681a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-20T04:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:56.892+0000 7f6d0681a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-20T04:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:56.892+0000 7f6d0681a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-20T04:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:22:56.893+0000 7f6d0681a500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-20T04:22:59.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-20T04:22:59.771 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-20T04:22:59.771 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:59.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-20T04:22:59.809 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:59.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-20T04:22:59.885 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:59.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-20T04:22:59.960 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:22:59.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-20T04:23:00.035 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:23:00.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-20T04:23:00.109 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:23:00.109 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-20T04:23:00.183 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:23:00.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-20T04:23:00.258 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:00.258 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-20T04:23:00.289 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:00.289 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-20T04:23:00.360 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:00.360 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-20T04:23:00.431 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:00.431 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-20T04:23:00.499 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:00.499 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-20T04:23:00.567 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:00.567 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-20T04:23:00.634 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:23:00.635 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-20T04:23:00.695 INFO:tasks.ceph:Adding keys to all mons... 2023-12-20T04:23:00.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-20T04:23:00.697 DEBUG:teuthology.orchestra.run.smithi069:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-20T04:23:00.723 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.y] 2023-12-20T04:23:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAFbIJlAaWTCBAAl7nRzwbGlORdLJdTxyM4NQ== 2023-12-20T04:23:00.723 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-12-20T04:23:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAFbIJl6cAWEBAAS15c3doEp2caBK9E81N01g== 2023-12-20T04:23:00.723 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-12-20T04:23:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAFbIJlIz8QGBAAGrcvYXDWFVf5GhvQNAuUpQ== 2023-12-20T04:23:00.723 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.0] 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAIbIJlCDyINRAAmfMMf25bBNKGxum/KnW/Mw== 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.1] 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQALbIJljCSyNBAAlAk/lND6EpnRmDgzDN0poA== 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.2] 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAObIJl3r56MxAAr5/LQ56nAaJiKgFIGpFVIw== 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.3] 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQARbIJlRFnkMhAAhnoCqfbZNNZiYeFw21HCpQ== 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.x] 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAFbIJle3gfDBAALZmlIBpltRbrIpKDMWUxaw== 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAFbIJl8iFPHRAALyhjvBBaHSe977ENcZZpow== 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.4] 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAXbIJlqDz+ORAAqFbSJiQJcbarmw8Lv+AzJw== 2023-12-20T04:23:00.724 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.5] 2023-12-20T04:23:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAabIJlAGsiOBAAB7CGaBGfIkssUzDWkKEfww== 2023-12-20T04:23:00.725 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.6] 2023-12-20T04:23:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAdbIJlkcVpNhAA6KGypowWcacAenfrzuWJIA== 2023-12-20T04:23:00.725 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.7] 2023-12-20T04:23:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAgbIJlYh5FNRAAEktJ21c6KbqHX7YzoLw4IQ== 2023-12-20T04:23:00.725 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-12-20T04:23:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAFbIJlauARJhAAiAWbidqDV0sj50MXKz7orw== 2023-12-20T04:23:00.729 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-12-20T04:23:00.729 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAFbIJlAaWTCBAAl7nRzwbGlORdLJdTxyM4NQ== 2023-12-20T04:23:00.729 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-12-20T04:23:00.729 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAFbIJl6cAWEBAAS15c3doEp2caBK9E81N01g== 2023-12-20T04:23:00.729 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAFbIJlIz8QGBAAGrcvYXDWFVf5GhvQNAuUpQ== 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAIbIJlCDyINRAAmfMMf25bBNKGxum/KnW/Mw== 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQALbIJljCSyNBAAlAk/lND6EpnRmDgzDN0poA== 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAObIJl3r56MxAAr5/LQ56nAaJiKgFIGpFVIw== 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQARbIJlRFnkMhAAhnoCqfbZNNZiYeFw21HCpQ== 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAFbIJle3gfDBAALZmlIBpltRbrIpKDMWUxaw== 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAFbIJl8iFPHRAALyhjvBBaHSe977ENcZZpow== 2023-12-20T04:23:00.730 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAXbIJlqDz+ORAAqFbSJiQJcbarmw8Lv+AzJw== 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAabIJlAGsiOBAAB7CGaBGfIkssUzDWkKEfww== 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAdbIJlkcVpNhAA6KGypowWcacAenfrzuWJIA== 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAgbIJlYh5FNRAAEktJ21c6KbqHX7YzoLw4IQ== 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-12-20T04:23:00.731 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAFbIJlauARJhAAiAWbidqDV0sj50MXKz7orw== 2023-12-20T04:23:00.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:23:00.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:23:00.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:23:00.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:23:00.897 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:23:00.899 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:23:00.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:00.958 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.013 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.069 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.124 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:23:01.179 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:23:01.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:23:01.234 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:23:01.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.293 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.348 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.404 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.459 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:23:01.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:23:01.514 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:23:01.570 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-20T04:23:01.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-20T04:23:01.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-20T04:23:01.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-20T04:23:01.731 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-20T04:23:01.759 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-20T04:23:01.855 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-20T04:23:01.882 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-20T04:23:01.949 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-20T04:23:02.046 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-20T04:23:02.072 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:23:02.075 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:23:02.127 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-20T04:23:02.127 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-20T04:23:02.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-20T04:23:02.131 INFO:tasks.ceph.mon.a:Started 2023-12-20T04:23:02.131 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-20T04:23:02.131 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-20T04:23:02.170 INFO:tasks.ceph.mon.b:Started 2023-12-20T04:23:02.170 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-20T04:23:02.170 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-20T04:23:02.172 INFO:tasks.ceph.mon.c:Started 2023-12-20T04:23:02.173 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-20T04:23:02.173 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-20T04:23:02.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-20T04:23:02.175 INFO:tasks.ceph.mgr.y:Started 2023-12-20T04:23:02.176 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-20T04:23:02.176 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-20T04:23:02.178 INFO:tasks.ceph.mgr.x:Started 2023-12-20T04:23:02.178 INFO:tasks.ceph:Setting crush tunables to default 2023-12-20T04:23:02.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2023-12-20T04:23:02.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.284+0000 7f8cb3296640 1 Processor -- start 2023-12-20T04:23:02.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb3296640 1 -- start start 2023-12-20T04:23:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb3296640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8cac071960 0x7f8cac06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb3296640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb3296640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac070890 con 0x7f8cac148340 2023-12-20T04:23:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb3296640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0b0940 con 0x7f8cac071960 2023-12-20T04:23:02.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb3296640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac06dc30 con 0x7f8cac070270 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb1833640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb0831640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8cac071960 0x7f8cac06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb1833640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:39380/0 (socket says 172.21.15.40:39380) 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.285+0000 7f8cb1833640 1 -- 172.21.15.40:0/2913393510 learned_addr learned my addr 172.21.15.40:0/2913393510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb1833640 1 -- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 msgr2=0x7f8cac1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb1833640 1 -- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 msgr2=0x7f8cac1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb1833640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb1833640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb0831640 1 -- 172.21.15.40:0/2913393510 >> v2:172.21.15.69:3300/0 conn(0x7f8cac071960 msgr2=0x7f8cac06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb0831640 1 -- 172.21.15.40:0/2913393510 >> v2:172.21.15.69:3300/0 conn(0x7f8cac071960 msgr2=0x7f8cac06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb0831640 1 --2- 172.21.15.40:0/2913393510 >> v2:172.21.15.69:3300/0 conn(0x7f8cac071960 0x7f8cac06fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:23:02.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.286+0000 7f8cb0831640 1 --2- 172.21.15.40:0/2913393510 >> v2:172.21.15.69:3300/0 conn(0x7f8cac071960 0x7f8cac06fd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-20T04:23:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.486+0000 7f8ca3fff640 1 -- 172.21.15.40:0/2913393510 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202535204 0 0) 0x7f8c9c001110 con 0x7f8cac148340 2023-12-20T04:23:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.486+0000 7f8ca3fff640 1 -- 172.21.15.40:0/2913393510 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c98003520 con 0x7f8cac148340 2023-12-20T04:23:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.487+0000 7f8cb0831640 1 --2- 172.21.15.40:0/2913393510 >> v2:172.21.15.69:3300/0 conn(0x7f8cac071960 0x7f8cac06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.487+0000 7f8cb1833640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.487+0000 7f8cb0831640 1 -- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 msgr2=0x7f8cac1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.487+0000 7f8cb0831640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.487+0000 7f8cb0831640 1 -- 172.21.15.40:0/2913393510 >> v1:172.21.15.69:6789/0 conn(0x7f8cac148340 legacy=0x7f8cac06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.487+0000 7f8cb0831640 1 -- 172.21.15.40:0/2913393510 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0b80d0 con 0x7f8cac071960 2023-12-20T04:23:02.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.488+0000 7f8cb0831640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac071960 0x7f8cac06fd30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8006fd0 tx=0x7f8ca802b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7e60f98027ea779 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.488+0000 7f8ca3fff640 1 -- 172.21.15.40:0/2913393510 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8032790 con 0x7f8cac071960 2023-12-20T04:23:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.488+0000 7f8ca3fff640 1 -- 172.21.15.40:0/2913393510 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca802d040 con 0x7f8cac071960 2023-12-20T04:23:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.488+0000 7f8ca3fff640 1 -- 172.21.15.40:0/2913393510 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8032b10 con 0x7f8cac071960 2023-12-20T04:23:02.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 -- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac071960 msgr2=0x7f8cac06fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac071960 0x7f8cac06fd30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8006fd0 tx=0x7f8ca802b8c0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 -- 172.21.15.40:0/2913393510 shutdown_connections 2023-12-20T04:23:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac071960 0x7f8cac06fd30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 --2- 172.21.15.40:0/2913393510 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac070270 0x7f8cac1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 -- 172.21.15.40:0/2913393510 >> 172.21.15.40:0/2913393510 conn(0x7f8cac0b99c0 msgr2=0x7f8cac0b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 -- 172.21.15.40:0/2913393510 shutdown_connections 2023-12-20T04:23:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.489+0000 7f8cb3296640 1 -- 172.21.15.40:0/2913393510 wait complete. 2023-12-20T04:23:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.490+0000 7f8cb3296640 1 Processor -- start 2023-12-20T04:23:02.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.490+0000 7f8cb3296640 1 -- start start 2023-12-20T04:23:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb3296640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac070270 0x7f8cac0bb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:02.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb3296640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac071960 0x7f8cac1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb3296640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cac148340 0x7f8cac0af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:02.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb3296640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0bbcc0 con 0x7f8cac148340 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb3296640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac142350 con 0x7f8cac070270 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb3296640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac142600 con 0x7f8cac071960 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb1833640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cac148340 0x7f8cac0af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb1833640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cac148340 0x7f8cac0af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51368/0 (socket says 172.21.15.40:51368) 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb1833640 1 -- 172.21.15.40:0/581617663 learned_addr learned my addr 172.21.15.40:0/581617663 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb0831640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac071960 0x7f8cac1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.491+0000 7f8cb1032640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac070270 0x7f8cac0bb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb1833640 1 -- 172.21.15.40:0/581617663 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac071960 msgr2=0x7f8cac1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb1833640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac071960 0x7f8cac1408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb1833640 1 -- 172.21.15.40:0/581617663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac070270 msgr2=0x7f8cac0bb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:02.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb1833640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac070270 0x7f8cac0bb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb1833640 1 -- 172.21.15.40:0/581617663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca800e040 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb1833640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cac148340 0x7f8cac0af750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40042f0 tx=0x7f8ca40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8ca1ffb640 1 -- 172.21.15.40:0/581617663 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4007d80 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8ca1ffb640 1 -- 172.21.15.40:0/581617663 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca400f070 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8ca1ffb640 1 -- 172.21.15.40:0/581617663 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4014650 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac1428f0 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8ca1ffb640 1 -- 172.21.15.40:0/581617663 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8ca40147b0 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac142eb0 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.492+0000 7f8ca1ffb640 1 -- 172.21.15.40:0/581617663 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8ca401e460 con 0x7f8cac148340 2023-12-20T04:23:02.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.493+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac1430a0 con 0x7f8cac148340 2023-12-20T04:23:02.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.497+0000 7f8ca1ffb640 1 -- 172.21.15.40:0/581617663 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f8ca4014c40 con 0x7f8cac148340 2023-12-20T04:23:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.567+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8cac04e840 con 0x7f8cac148340 2023-12-20T04:23:02.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.569+0000 7f8ca1ffb640 1 -- 172.21.15.40:0/581617663 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8ca4014de0 con 0x7f8cac148340 2023-12-20T04:23:02.570 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2023-12-20T04:23:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cac148340 msgr2=0x7f8cac0af750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cac148340 0x7f8cac0af750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40042f0 tx=0x7f8ca40047b0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 shutdown_connections 2023-12-20T04:23:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8cac148340 0x7f8cac0af750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8cac071960 0x7f8cac1408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 --2- 172.21.15.40:0/581617663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac070270 0x7f8cac0bb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:02.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 >> 172.21.15.40:0/581617663 conn(0x7f8cac0b99c0 msgr2=0x7f8cac145bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:02.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 shutdown_connections 2023-12-20T04:23:02.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:02.570+0000 7f8cb3296640 1 -- 172.21.15.40:0/581617663 wait complete. 2023-12-20T04:23:02.581 INFO:tasks.ceph:check_enable_crimson: False 2023-12-20T04:23:02.581 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-20T04:23:02.582 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:23:02.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-20T04:23:02.613 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:23:02.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-20T04:23:02.683 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:23:02.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-20T04:23:02.754 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-12-20T04:23:02.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-20T04:23:02.824 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:02.824 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-20T04:23:02.852 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:02.852 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-20T04:23:02.920 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:02.920 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-20T04:23:02.932 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:02.932+0000 7f42efa2c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-20T04:23:02.936 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:02.936+0000 7f4c12c50040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-20T04:23:02.962 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-12-20T04:23:02.962 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-20T04:23:02.986 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:02.985+0000 7f42efa2c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-20T04:23:02.990 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:02.989+0000 7f4c12c50040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-20T04:23:03.016 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 33c863db-afa5-44bd-b009-cc8fae07ef10 0 2023-12-20T04:23:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.154+0000 7fd3f30af640 1 Processor -- start 2023-12-20T04:23:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.154+0000 7fd3f30af640 1 -- start start 2023-12-20T04:23:03.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.154+0000 7fd3f30af640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3ec144c40 0x7fd3ec0b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.154+0000 7fd3f30af640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec0b3290 0x7fd3ec155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.154+0000 7fd3f30af640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec0b2ee0 con 0x7fd3ec0b79e0 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.154+0000 7fd3f30af640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec0b1630 con 0x7fd3ec144c40 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.154+0000 7fd3f30af640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0b18d0 con 0x7fd3ec0b3290 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3ebfff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd3ec0b79e0 0x7fd3ec14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46970/0 (socket says 172.21.15.69:46970) 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3ebfff640 1 -- 172.21.15.69:0/4105224785 learned_addr learned my addr 172.21.15.69:0/4105224785 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3f164c640 1 --2- 172.21.15.69:0/4105224785 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec0b3290 0x7fd3ec155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3f0e4b640 1 --2- 172.21.15.69:0/4105224785 >> v2:172.21.15.40:3300/0 conn(0x7fd3ec144c40 0x7fd3ec0b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3eb7fe640 1 -- 172.21.15.69:0/4105224785 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595296132 0 0) 0x7fd3ec0b2ee0 con 0x7fd3ec0b79e0 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3eb7fe640 1 -- 172.21.15.69:0/4105224785 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3dc003520 con 0x7fd3ec0b79e0 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3f164c640 1 -- 172.21.15.69:0/4105224785 >> v2:172.21.15.40:3300/0 conn(0x7fd3ec144c40 msgr2=0x7fd3ec0b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3f164c640 1 --2- 172.21.15.69:0/4105224785 >> v2:172.21.15.40:3300/0 conn(0x7fd3ec144c40 0x7fd3ec0b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3f164c640 1 -- 172.21.15.69:0/4105224785 >> v1:172.21.15.69:6789/0 conn(0x7fd3ec0b79e0 legacy=0x7fd3ec14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.155+0000 7fd3f164c640 1 -- 172.21.15.69:0/4105224785 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0b1bb0 con 0x7fd3ec0b3290 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f164c640 1 --2- 172.21.15.69:0/4105224785 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec0b3290 0x7fd3ec155340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009d90 tx=0x7fd3e402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb3cb9f4d2de6e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3eb7fe640 1 -- 172.21.15.69:0/4105224785 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e402cce0 con 0x7fd3ec0b3290 2023-12-20T04:23:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3eb7fe640 1 -- 172.21.15.69:0/4105224785 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e402ce40 con 0x7fd3ec0b3290 2023-12-20T04:23:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3eb7fe640 1 -- 172.21.15.69:0/4105224785 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4034660 con 0x7fd3ec0b3290 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f30af640 1 -- 172.21.15.69:0/4105224785 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec0b3290 msgr2=0x7fd3ec155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f30af640 1 --2- 172.21.15.69:0/4105224785 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec0b3290 0x7fd3ec155340 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009d90 tx=0x7fd3e402bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f30af640 1 -- 172.21.15.69:0/4105224785 shutdown_connections 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f30af640 1 --2- 172.21.15.69:0/4105224785 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec0b3290 0x7fd3ec155340 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f30af640 1 --2- 172.21.15.69:0/4105224785 >> v2:172.21.15.40:3300/0 conn(0x7fd3ec144c40 0x7fd3ec0b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f30af640 1 -- 172.21.15.69:0/4105224785 >> 172.21.15.69:0/4105224785 conn(0x7fd3ec0b9150 msgr2=0x7fd3ec0b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.156+0000 7fd3f30af640 1 -- 172.21.15.69:0/4105224785 shutdown_connections 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.157+0000 7fd3f30af640 1 -- 172.21.15.69:0/4105224785 wait complete. 2023-12-20T04:23:03.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.157+0000 7fd3f30af640 1 Processor -- start 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.157+0000 7fd3f30af640 1 -- start start 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f30af640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ec0b3290 0x7fd3ec0a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f30af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ec0b79e0 0x7fd3ec14c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f30af640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec144c40 0x7fd3ec1e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f30af640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec06a850 con 0x7fd3ec0b79e0 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f30af640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec06aa30 con 0x7fd3ec0b3290 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f30af640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec1e0480 con 0x7fd3ec144c40 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f0e4b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ec0b3290 0x7fd3ec0a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f164c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec144c40 0x7fd3ec1e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f0e4b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ec0b3290 0x7fd3ec0a14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54296/0 (socket says 172.21.15.69:54296) 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3f0e4b640 1 -- 172.21.15.69:0/613529950 learned_addr learned my addr 172.21.15.69:0/613529950 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.158+0000 7fd3ebfff640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ec0b79e0 0x7fd3ec14c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f0e4b640 1 -- 172.21.15.69:0/613529950 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec144c40 msgr2=0x7fd3ec1e08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f0e4b640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec144c40 0x7fd3ec1e08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f0e4b640 1 -- 172.21.15.69:0/613529950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ec0b79e0 msgr2=0x7fd3ec14c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f0e4b640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ec0b79e0 0x7fd3ec14c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f0e4b640 1 -- 172.21.15.69:0/613529950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4009a70 con 0x7fd3ec0b3290 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f0e4b640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ec0b3290 0x7fd3ec0a14b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000e8a0 tx=0x7fd3e000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3e97fa640 1 -- 172.21.15.69:0/613529950 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e00094f0 con 0x7fd3ec0b3290 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3e97fa640 1 -- 172.21.15.69:0/613529950 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e000c940 con 0x7fd3ec0b3290 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec14cb50 con 0x7fd3ec0b3290 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3e97fa640 1 -- 172.21.15.69:0/613529950 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000ccf0 con 0x7fd3ec0b3290 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec09fce0 con 0x7fd3ec0b3290 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3e97fa640 1 -- 172.21.15.69:0/613529950 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd3e0005c90 con 0x7fd3ec0b3290 2023-12-20T04:23:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.159+0000 7fd3e97fa640 1 -- 172.21.15.69:0/613529950 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd3e00137b0 con 0x7fd3ec0b3290 2023-12-20T04:23:03.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.160+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec0b8640 con 0x7fd3ec0b3290 2023-12-20T04:23:03.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.162+0000 7fd3e97fa640 1 -- 172.21.15.69:0/613529950 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fd3ec14cb50 con 0x7fd3ec0b3290 2023-12-20T04:23:03.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.233+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "33c863db-afa5-44bd-b009-cc8fae07ef10", "id": 0} v 0) v1 -- 0x7fd3ec04e840 con 0x7fd3ec0b3290 2023-12-20T04:23:03.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.238+0000 7fd3e97fa640 1 -- 172.21.15.69:0/613529950 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33c863db-afa5-44bd-b009-cc8fae07ef10", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3e0021060 con 0x7fd3ec0b3290 2023-12-20T04:23:03.239 INFO:teuthology.orchestra.run.smithi069.stdout:0 2023-12-20T04:23:03.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ec0b3290 msgr2=0x7fd3ec0a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ec0b3290 0x7fd3ec0a14b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd3e000e8a0 tx=0x7fd3e000ed60 comp rx=0 tx=0).stop 2023-12-20T04:23:03.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 shutdown_connections 2023-12-20T04:23:03.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd3ec144c40 0x7fd3ec1e08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ec0b79e0 0x7fd3ec14c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 --2- 172.21.15.69:0/613529950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3ec0b3290 0x7fd3ec0a14b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 >> 172.21.15.69:0/613529950 conn(0x7fd3ec0b9150 msgr2=0x7fd3ec14aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 shutdown_connections 2023-12-20T04:23:03.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.239+0000 7fd3f30af640 1 -- 172.21.15.69:0/613529950 wait complete. 2023-12-20T04:23:03.250 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 6515c24a-73aa-409f-95b7-84322a930eec 1 2023-12-20T04:23:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.348+0000 7f7399d99640 1 Processor -- start 2023-12-20T04:23:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.348+0000 7f7399d99640 1 -- start start 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7399d99640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7394148340 0x7f739406d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7399d99640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f73941533e0 0x7f73941557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7399d99640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7394070890 con 0x7f7394071960 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7399d99640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73940b0940 con 0x7f7394148340 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7399d99640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73940b80d0 con 0x7f73941533e0 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7393fff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f73941533e0 0x7f73941557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7392ffd640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7394071960 0x7f739406fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46984/0 (socket says 172.21.15.69:46984) 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7392ffd640 1 -- 172.21.15.69:0/740309689 learned_addr learned my addr 172.21.15.69:0/740309689 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7393fff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f73941533e0 0x7f73941557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54306/0 (socket says 172.21.15.69:54306) 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f73937fe640 1 --2- 172.21.15.69:0/740309689 >> v2:172.21.15.40:3300/0 conn(0x7f7394148340 0x7f739406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7393fff640 1 -- 172.21.15.69:0/740309689 >> v2:172.21.15.40:3300/0 conn(0x7f7394148340 msgr2=0x7f739406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.349+0000 7f7393fff640 1 --2- 172.21.15.69:0/740309689 >> v2:172.21.15.40:3300/0 conn(0x7f7394148340 0x7f739406d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.350+0000 7f7393fff640 1 -- 172.21.15.69:0/740309689 >> v1:172.21.15.69:6789/0 conn(0x7f7394071960 legacy=0x7f739406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.350+0000 7f73927fc640 1 -- 172.21.15.69:0/740309689 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079359447 0 0) 0x7f7388001110 con 0x7f7394071960 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.350+0000 7f7393fff640 1 -- 172.21.15.69:0/740309689 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394071540 con 0x7f73941533e0 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.350+0000 7f7393fff640 1 --2- 172.21.15.69:0/740309689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f73941557d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7394071dc0 tx=0x7f738c02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3b87e699c07f0a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.350+0000 7f73927fc640 1 -- 172.21.15.69:0/740309689 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c02cbf0 con 0x7f73941533e0 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.350+0000 7f73927fc640 1 -- 172.21.15.69:0/740309689 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c02cd50 con 0x7f73941533e0 2023-12-20T04:23:03.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.350+0000 7f73927fc640 1 -- 172.21.15.69:0/740309689 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c034660 con 0x7f73941533e0 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 -- 172.21.15.69:0/740309689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 msgr2=0x7f73941557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 --2- 172.21.15.69:0/740309689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f73941557d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7394071dc0 tx=0x7f738c02be40 comp rx=0 tx=0).stop 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 -- 172.21.15.69:0/740309689 shutdown_connections 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 --2- 172.21.15.69:0/740309689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f73941557d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 --2- 172.21.15.69:0/740309689 >> v2:172.21.15.40:3300/0 conn(0x7f7394148340 0x7f739406d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 -- 172.21.15.69:0/740309689 >> 172.21.15.69:0/740309689 conn(0x7f73940b99c0 msgr2=0x7f73940b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 -- 172.21.15.69:0/740309689 shutdown_connections 2023-12-20T04:23:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.351+0000 7f7399d99640 1 -- 172.21.15.69:0/740309689 wait complete. 2023-12-20T04:23:03.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.352+0000 7f7399d99640 1 Processor -- start 2023-12-20T04:23:03.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.352+0000 7f7399d99640 1 -- start start 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7399d99640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7394071960 0x7f7394149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7399d99640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7394148340 0x7f7394141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7399d99640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f7394148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7399d99640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739414ac50 con 0x7f7394148340 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7399d99640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739414a310 con 0x7f73941533e0 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7399d99640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739414a830 con 0x7f7394071960 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f73937fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7394071960 0x7f7394149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7393fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f7394148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f73937fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7394071960 0x7f7394149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58316/0 (socket says 172.21.15.69:58316) 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f73937fe640 1 -- 172.21.15.69:0/3370989267 learned_addr learned my addr 172.21.15.69:0/3370989267 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.353+0000 7f7392ffd640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7394148340 0x7f7394141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f73937fe640 1 -- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 msgr2=0x7f7394148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f73937fe640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f7394148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f73937fe640 1 -- 172.21.15.69:0/3370989267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7394148340 msgr2=0x7f7394141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f73937fe640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7394148340 0x7f7394141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f73937fe640 1 -- 172.21.15.69:0/3370989267 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c009a70 con 0x7f7394071960 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f7393fff640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f7394148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f7392ffd640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7394148340 0x7f7394141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f73937fe640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7394071960 0x7f7394149dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f738400e930 tx=0x7f738400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f737bfff640 1 -- 172.21.15.69:0/3370989267 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384009690 con 0x7f7394071960 2023-12-20T04:23:03.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f737bfff640 1 -- 172.21.15.69:0/3370989267 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738400c9a0 con 0x7f7394071960 2023-12-20T04:23:03.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73941426a0 con 0x7f7394071960 2023-12-20T04:23:03.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f737bfff640 1 -- 172.21.15.69:0/3370989267 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400cd50 con 0x7f7394071960 2023-12-20T04:23:03.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739414b420 con 0x7f7394071960 2023-12-20T04:23:03.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f737bfff640 1 -- 172.21.15.69:0/3370989267 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7384005c90 con 0x7f7394071960 2023-12-20T04:23:03.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.354+0000 7f737bfff640 1 -- 172.21.15.69:0/3370989267 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7384013930 con 0x7f7394071960 2023-12-20T04:23:03.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.355+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739414b8c0 con 0x7f7394071960 2023-12-20T04:23:03.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.357+0000 7f737bfff640 1 -- 172.21.15.69:0/3370989267 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f7384021060 con 0x7f7394071960 2023-12-20T04:23:03.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.427+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6515c24a-73aa-409f-95b7-84322a930eec", "id": 1} v 0) v1 -- 0x7f739414af80 con 0x7f7394071960 2023-12-20T04:23:03.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.432+0000 7f737bfff640 1 -- 172.21.15.69:0/3370989267 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6515c24a-73aa-409f-95b7-84322a930eec", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7384017070 con 0x7f7394071960 2023-12-20T04:23:03.433 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-12-20T04:23:03.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7394071960 msgr2=0x7f7394149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7394071960 0x7f7394149dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f738400e930 tx=0x7f738400edf0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 shutdown_connections 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73941533e0 0x7f7394148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7394148340 0x7f7394141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 --2- 172.21.15.69:0/3370989267 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7394071960 0x7f7394149dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 >> 172.21.15.69:0/3370989267 conn(0x7f73940b99c0 msgr2=0x7f7394145100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 shutdown_connections 2023-12-20T04:23:03.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.433+0000 7f7399d99640 1 -- 172.21.15.69:0/3370989267 wait complete. 2023-12-20T04:23:03.444 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new b0a23918-8a6c-442f-912e-db9f61f3f28d 2 2023-12-20T04:23:03.517 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.517+0000 7f4c12c50040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-20T04:23:03.526 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.525+0000 7f42efa2c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-20T04:23:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.543+0000 7f952262c640 1 Processor -- start 2023-12-20T04:23:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.543+0000 7f952262c640 1 -- start start 2023-12-20T04:23:03.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f952262c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f951c148340 0x7f951c06d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f952262c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f951c1533e0 0x7f951c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f952262c640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c070890 con 0x7f951c071960 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f952262c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0b0940 con 0x7f951c1533e0 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f952262c640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0b80d0 con 0x7f951c148340 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951bfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f951c148340 0x7f951c06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951b7fe640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f951c071960 0x7f951c06fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46996/0 (socket says 172.21.15.69:46996) 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951b7fe640 1 -- 172.21.15.69:0/443031312 learned_addr learned my addr 172.21.15.69:0/443031312 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f9520bc9640 1 --2- 172.21.15.69:0/443031312 >> v2:172.21.15.40:3300/0 conn(0x7f951c1533e0 0x7f951c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951bfff640 1 -- 172.21.15.69:0/443031312 >> v2:172.21.15.40:3300/0 conn(0x7f951c1533e0 msgr2=0x7f951c1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951bfff640 1 --2- 172.21.15.69:0/443031312 >> v2:172.21.15.40:3300/0 conn(0x7f951c1533e0 0x7f951c1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951bfff640 1 -- 172.21.15.69:0/443031312 >> v1:172.21.15.69:6789/0 conn(0x7f951c071960 legacy=0x7f951c06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951affd640 1 -- 172.21.15.69:0/443031312 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823367851 0 0) 0x7f950c001110 con 0x7f951c071960 2023-12-20T04:23:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.544+0000 7f951bfff640 1 -- 172.21.15.69:0/443031312 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c071540 con 0x7f951c148340 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.545+0000 7f951bfff640 1 --2- 172.21.15.69:0/443031312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c148340 0x7f951c06d520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f951c06f810 tx=0x7f951002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7989488761ce1294 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.545+0000 7f951affd640 1 -- 172.21.15.69:0/443031312 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951002e070 con 0x7f951c148340 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.545+0000 7f951affd640 1 -- 172.21.15.69:0/443031312 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95100315a0 con 0x7f951c148340 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.545+0000 7f951affd640 1 -- 172.21.15.69:0/443031312 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510031930 con 0x7f951c148340 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.545+0000 7f952262c640 1 -- 172.21.15.69:0/443031312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c148340 msgr2=0x7f951c06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.545+0000 7f952262c640 1 --2- 172.21.15.69:0/443031312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c148340 0x7f951c06d520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f951c06f810 tx=0x7f951002b840 comp rx=0 tx=0).stop 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.546+0000 7f952262c640 1 -- 172.21.15.69:0/443031312 shutdown_connections 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.546+0000 7f952262c640 1 --2- 172.21.15.69:0/443031312 >> v2:172.21.15.40:3300/0 conn(0x7f951c1533e0 0x7f951c1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.546+0000 7f952262c640 1 --2- 172.21.15.69:0/443031312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c148340 0x7f951c06d520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.546+0000 7f952262c640 1 -- 172.21.15.69:0/443031312 >> 172.21.15.69:0/443031312 conn(0x7f951c0b99c0 msgr2=0x7f951c0b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.546+0000 7f952262c640 1 -- 172.21.15.69:0/443031312 shutdown_connections 2023-12-20T04:23:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.546+0000 7f952262c640 1 -- 172.21.15.69:0/443031312 wait complete. 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 Processor -- start 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 -- start start 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c071960 0x7f951c14d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f951c148340 0x7f951c0bad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f951c1533e0 0x7f951c0bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c14d6c0 con 0x7f951c148340 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0b2c90 con 0x7f951c071960 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f952262c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0b1500 con 0x7f951c1533e0 2023-12-20T04:23:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f951bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c071960 0x7f951c14d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f951bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c071960 0x7f951c14d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54336/0 (socket says 172.21.15.69:54336) 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f9520bc9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f951c1533e0 0x7f951c0bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.547+0000 7f951bfff640 1 -- 172.21.15.69:0/3980696896 learned_addr learned my addr 172.21.15.69:0/3980696896 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951b7fe640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f951c148340 0x7f951c0bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951bfff640 1 -- 172.21.15.69:0/3980696896 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f951c1533e0 msgr2=0x7f951c0bb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951bfff640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f951c1533e0 0x7f951c0bb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951bfff640 1 -- 172.21.15.69:0/3980696896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f951c148340 msgr2=0x7f951c0bad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951bfff640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f951c148340 0x7f951c0bad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951bfff640 1 -- 172.21.15.69:0/3980696896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009400 con 0x7f951c071960 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951b7fe640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f951c148340 0x7f951c0bad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f951bfff640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c071960 0x7f951c14d180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9510009890 tx=0x7f95100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f9518ff9640 1 -- 172.21.15.69:0/3980696896 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510032900 con 0x7f951c071960 2023-12-20T04:23:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f9518ff9640 1 -- 172.21.15.69:0/3980696896 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9510032a80 con 0x7f951c071960 2023-12-20T04:23:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f9518ff9640 1 -- 172.21.15.69:0/3980696896 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9510032e30 con 0x7f951c071960 2023-12-20T04:23:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c0b3960 con 0x7f951c071960 2023-12-20T04:23:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c0bc640 con 0x7f951c071960 2023-12-20T04:23:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f9518ff9640 1 -- 172.21.15.69:0/3980696896 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95100456f0 con 0x7f951c071960 2023-12-20T04:23:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.548+0000 7f9518ff9640 1 -- 172.21.15.69:0/3980696896 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f951003b810 con 0x7f951c071960 2023-12-20T04:23:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.549+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c04e840 con 0x7f951c071960 2023-12-20T04:23:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.551+0000 7f9518ff9640 1 -- 172.21.15.69:0/3980696896 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f9510045bd0 con 0x7f951c071960 2023-12-20T04:23:03.572 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.572+0000 7f4c12c50040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-20T04:23:03.580 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.580+0000 7f42efa2c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-20T04:23:03.617 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.617+0000 7f4c12c50040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-20T04:23:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.622+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0a23918-8a6c-442f-912e-db9f61f3f28d", "id": 2} v 0) v1 -- 0x7f951c0b7d30 con 0x7f951c071960 2023-12-20T04:23:03.627 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.626+0000 7f42efa2c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-20T04:23:03.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.630+0000 7f9518ff9640 1 -- 172.21.15.69:0/3980696896 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0a23918-8a6c-442f-912e-db9f61f3f28d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f951003b3f0 con 0x7f951c071960 2023-12-20T04:23:03.631 INFO:teuthology.orchestra.run.smithi069.stdout:2 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c071960 msgr2=0x7f951c14d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c071960 0x7f951c14d180 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9510009890 tx=0x7f95100046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 shutdown_connections 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f951c1533e0 0x7f951c0bb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f951c148340 0x7f951c0bad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 --2- 172.21.15.69:0/3980696896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f951c071960 0x7f951c14d180 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 >> 172.21.15.69:0/3980696896 conn(0x7f951c0b99c0 msgr2=0x7f951c1475f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 shutdown_connections 2023-12-20T04:23:03.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.631+0000 7f952262c640 1 -- 172.21.15.69:0/3980696896 wait complete. 2023-12-20T04:23:03.642 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 3e9a1150-4fdb-4440-bf5f-a5145ccd3b73 3 2023-12-20T04:23:03.675 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.674+0000 7f4c12c50040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-20T04:23:03.683 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.682+0000 7f42efa2c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-20T04:23:03.719 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.719+0000 7f4c12c50040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-20T04:23:03.727 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.726+0000 7f42efa2c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-20T04:23:03.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.740+0000 7f8f597ae640 1 Processor -- start 2023-12-20T04:23:03.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f597ae640 1 -- start start 2023-12-20T04:23:03.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f597ae640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540ba1b0 0x7f8f5414b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f597ae640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8f540b7a90 0x7f8f540bac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f597ae640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f540ba720 con 0x7f8f540b82c0 2023-12-20T04:23:03.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f597ae640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f5414ab30 con 0x7f8f540b7a90 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f597ae640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5414ae10 con 0x7f8f540ba1b0 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f527fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540ba1b0 0x7f8f5414b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f527fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540ba1b0 0x7f8f5414b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58338/0 (socket says 172.21.15.69:58338) 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f527fc640 1 -- 172.21.15.69:0/732909386 learned_addr learned my addr 172.21.15.69:0/732909386 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.741+0000 7f8f537fe640 1 --2- 172.21.15.69:0/732909386 >> v2:172.21.15.40:3300/0 conn(0x7f8f540b7a90 0x7f8f540bac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f527fc640 1 -- 172.21.15.69:0/732909386 >> v2:172.21.15.40:3300/0 conn(0x7f8f540b7a90 msgr2=0x7f8f540bac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f527fc640 1 --2- 172.21.15.69:0/732909386 >> v2:172.21.15.40:3300/0 conn(0x7f8f540b7a90 0x7f8f540bac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f527fc640 1 -- 172.21.15.69:0/732909386 >> v1:172.21.15.40:6789/0 conn(0x7f8f540b82c0 legacy=0x7f8f541410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f527fc640 1 -- 172.21.15.69:0/732909386 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5414b0f0 con 0x7f8f540ba1b0 2023-12-20T04:23:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f527fc640 1 --2- 172.21.15.69:0/732909386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540ba1b0 0x7f8f5414b610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009870 tx=0x7f8f4802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b08ec3d61792641 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f51ffb640 1 -- 172.21.15.69:0/732909386 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48030840 con 0x7f8f540ba1b0 2023-12-20T04:23:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f51ffb640 1 -- 172.21.15.69:0/732909386 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f480309a0 con 0x7f8f540ba1b0 2023-12-20T04:23:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.742+0000 7f8f51ffb640 1 -- 172.21.15.69:0/732909386 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48030d30 con 0x7f8f540ba1b0 2023-12-20T04:23:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 -- 172.21.15.69:0/732909386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540ba1b0 msgr2=0x7f8f5414b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 --2- 172.21.15.69:0/732909386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540ba1b0 0x7f8f5414b610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009870 tx=0x7f8f4802b980 comp rx=0 tx=0).stop 2023-12-20T04:23:03.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 -- 172.21.15.69:0/732909386 shutdown_connections 2023-12-20T04:23:03.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 --2- 172.21.15.69:0/732909386 >> v2:172.21.15.40:3300/0 conn(0x7f8f540b7a90 0x7f8f540bac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 --2- 172.21.15.69:0/732909386 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540ba1b0 0x7f8f5414b610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 -- 172.21.15.69:0/732909386 >> 172.21.15.69:0/732909386 conn(0x7f8f540b6d30 msgr2=0x7f8f540712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 -- 172.21.15.69:0/732909386 shutdown_connections 2023-12-20T04:23:03.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.743+0000 7f8f597ae640 1 -- 172.21.15.69:0/732909386 wait complete. 2023-12-20T04:23:03.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.744+0000 7f8f597ae640 1 Processor -- start 2023-12-20T04:23:03.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.744+0000 7f8f597ae640 1 -- start start 2023-12-20T04:23:03.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f597ae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f540b7a90 0x7f8f541e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f597ae640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540b82c0 0x7f8f541e3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f597ae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f540ba1b0 0x7f8f54137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f597ae640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f540bf0d0 con 0x7f8f540b7a90 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f597ae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5414e9e0 con 0x7f8f540ba1b0 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f597ae640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f541e3e20 con 0x7f8f540b82c0 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f540ba1b0 0x7f8f54137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f540ba1b0 0x7f8f54137f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54338/0 (socket says 172.21.15.69:54338) 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f527fc640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540b82c0 0x7f8f541e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 -- 172.21.15.69:0/3837842554 learned_addr learned my addr 172.21.15.69:0/3837842554 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f52ffd640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f540b7a90 0x7f8f541e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 -- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540b82c0 msgr2=0x7f8f541e3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540b82c0 0x7f8f541e3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 -- 172.21.15.69:0/3837842554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f540b7a90 msgr2=0x7f8f541e32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f540b7a90 0x7f8f541e32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 -- 172.21.15.69:0/3837842554 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480094d0 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f527fc640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540b82c0 0x7f8f541e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.745+0000 7f8f537fe640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f540ba1b0 0x7f8f54137f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c007e40 tx=0x7f8f4c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.746+0000 7f8f3b7fe640 1 -- 172.21.15.69:0/3837842554 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c014620 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.746+0000 7f8f3b7fe640 1 -- 172.21.15.69:0/3837842554 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c00ee90 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.746+0000 7f8f3b7fe640 1 -- 172.21.15.69:0/3837842554 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0149e0 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.746+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f54141940 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.746+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f540bf2d0 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.746+0000 7f8f3b7fe640 1 -- 172.21.15.69:0/3837842554 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8f4c01e460 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.746+0000 7f8f3b7fe640 1 -- 172.21.15.69:0/3837842554 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8f4c01d850 con 0x7f8f540ba1b0 2023-12-20T04:23:03.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.747+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f5414cb80 con 0x7f8f540ba1b0 2023-12-20T04:23:03.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.749+0000 7f8f3b7fe640 1 -- 172.21.15.69:0/3837842554 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f8f5414cb80 con 0x7f8f540ba1b0 2023-12-20T04:23:03.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.820+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3e9a1150-4fdb-4440-bf5f-a5145ccd3b73", "id": 3} v 0) v1 -- 0x7f8f5414ec00 con 0x7f8f540ba1b0 2023-12-20T04:23:03.824 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.824+0000 7f4c12c50040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-20T04:23:03.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.827+0000 7f8f3b7fe640 1 -- 172.21.15.69:0/3837842554 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e9a1150-4fdb-4440-bf5f-a5145ccd3b73", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8f4c01d4e0 con 0x7f8f540ba1b0 2023-12-20T04:23:03.828 INFO:teuthology.orchestra.run.smithi069.stdout:3 2023-12-20T04:23:03.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f540ba1b0 msgr2=0x7f8f54137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f540ba1b0 0x7f8f54137f10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c007e40 tx=0x7f8f4c00e4b0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 shutdown_connections 2023-12-20T04:23:03.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f540ba1b0 0x7f8f54137f10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8f540b82c0 0x7f8f541e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 --2- 172.21.15.69:0/3837842554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8f540b7a90 0x7f8f541e32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 >> 172.21.15.69:0/3837842554 conn(0x7f8f540b6d30 msgr2=0x7f8f54149930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 shutdown_connections 2023-12-20T04:23:03.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.828+0000 7f8f597ae640 1 -- 172.21.15.69:0/3837842554 wait complete. 2023-12-20T04:23:03.832 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.832+0000 7f42efa2c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-20T04:23:03.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new e542e453-dc96-473e-a782-f67519ccf8b9 4 2023-12-20T04:23:03.897 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.896+0000 7f4c12c50040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-20T04:23:03.905 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.905+0000 7f42efa2c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-20T04:23:03.944 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.944+0000 7f4c12c50040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-20T04:23:03.953 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:03.952+0000 7f42efa2c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-20T04:23:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.978+0000 7f6c00e5f640 1 Processor -- start 2023-12-20T04:23:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.978+0000 7f6c00e5f640 1 -- start start 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6c00e5f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc0b9590 0x7f6bfc071030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6c00e5f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0b4f30 0x7f6bfc1530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6c00e5f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc0717e0 con 0x7f6bfc1427b0 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6c00e5f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc0b5d00 con 0x7f6bfc0b4f30 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6c00e5f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc071570 con 0x7f6bfc0b9590 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bfa59c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc0b9590 0x7f6bfc071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bf3fff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6bfc1427b0 0x7f6bfc0b4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47002/0 (socket says 172.21.15.69:47002) 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bf3fff640 1 -- 172.21.15.69:0/2201294101 learned_addr learned my addr 172.21.15.69:0/2201294101 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bfad9d640 1 --2- 172.21.15.69:0/2201294101 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0b4f30 0x7f6bfc1530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bfa59c640 1 -- 172.21.15.69:0/2201294101 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0b4f30 msgr2=0x7f6bfc1530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bfa59c640 1 --2- 172.21.15.69:0/2201294101 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0b4f30 0x7f6bfc1530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bfa59c640 1 -- 172.21.15.69:0/2201294101 >> v1:172.21.15.69:6789/0 conn(0x7f6bfc1427b0 legacy=0x7f6bfc0b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bf9d9b640 1 -- 172.21.15.69:0/2201294101 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512147146 0 0) 0x7f6bfc0717e0 con 0x7f6bfc1427b0 2023-12-20T04:23:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bfa59c640 1 -- 172.21.15.69:0/2201294101 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0b56b0 con 0x7f6bfc0b9590 2023-12-20T04:23:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.979+0000 7f6bfad9d640 1 --2- 172.21.15.69:0/2201294101 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0b4f30 0x7f6bfc1530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.980+0000 7f6bfa59c640 1 --2- 172.21.15.69:0/2201294101 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc0b9590 0x7f6bfc071030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0097d0 tx=0x7f6bec02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26df6ac9903aa5eb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.980+0000 7f6bf9d9b640 1 -- 172.21.15.69:0/2201294101 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec031890 con 0x7f6bfc0b9590 2023-12-20T04:23:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.980+0000 7f6bf9d9b640 1 -- 172.21.15.69:0/2201294101 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec0319f0 con 0x7f6bfc0b9590 2023-12-20T04:23:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.980+0000 7f6bf9d9b640 1 -- 172.21.15.69:0/2201294101 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec031d80 con 0x7f6bfc0b9590 2023-12-20T04:23:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 -- 172.21.15.69:0/2201294101 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc0b9590 msgr2=0x7f6bfc071030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 --2- 172.21.15.69:0/2201294101 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc0b9590 0x7f6bfc071030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0097d0 tx=0x7f6bec02b930 comp rx=0 tx=0).stop 2023-12-20T04:23:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 -- 172.21.15.69:0/2201294101 shutdown_connections 2023-12-20T04:23:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 --2- 172.21.15.69:0/2201294101 >> v2:172.21.15.40:3300/0 conn(0x7f6bfc0b4f30 0x7f6bfc1530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 --2- 172.21.15.69:0/2201294101 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc0b9590 0x7f6bfc071030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 -- 172.21.15.69:0/2201294101 >> 172.21.15.69:0/2201294101 conn(0x7f6bfc0be4b0 msgr2=0x7f6bfc0be8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 -- 172.21.15.69:0/2201294101 shutdown_connections 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.981+0000 7f6c00e5f640 1 -- 172.21.15.69:0/2201294101 wait complete. 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.982+0000 7f6c00e5f640 1 Processor -- start 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.982+0000 7f6c00e5f640 1 -- start start 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6c00e5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc0b4f30 0x7f6bfc144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6c00e5f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bfc0b9590 0x7f6bfc1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6c00e5f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc1427b0 0x7f6bfc143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6c00e5f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc1436a0 con 0x7f6bfc0b4f30 2023-12-20T04:23:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6c00e5f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc143070 con 0x7f6bfc0b9590 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6c00e5f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc13ff00 con 0x7f6bfc1427b0 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bfc0b9590 0x7f6bfc1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bfad9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc1427b0 0x7f6bfc143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bfad9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc1427b0 0x7f6bfc143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58364/0 (socket says 172.21.15.69:58364) 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bfad9d640 1 -- 172.21.15.69:0/306862017 learned_addr learned my addr 172.21.15.69:0/306862017 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bfa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc0b4f30 0x7f6bfc144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bfc0b9590 0x7f6bfc1450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54348/0 (socket says 172.21.15.69:54348) 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 -- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc1427b0 msgr2=0x7f6bfc143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc1427b0 0x7f6bfc143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 -- 172.21.15.69:0/306862017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc0b4f30 msgr2=0x7f6bfc144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc0b4f30 0x7f6bfc144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 -- 172.21.15.69:0/306862017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bec009400 con 0x7f6bfc0b9590 2023-12-20T04:23:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bfad9d640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc1427b0 0x7f6bfc143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.983+0000 7f6bf3fff640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bfc0b9590 0x7f6bfc1450e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c450 tx=0x7f6be400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.984+0000 7f6bf2ffd640 1 -- 172.21.15.69:0/306862017 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40074e0 con 0x7f6bfc0b9590 2023-12-20T04:23:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.984+0000 7f6bf2ffd640 1 -- 172.21.15.69:0/306862017 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4007640 con 0x7f6bfc0b9590 2023-12-20T04:23:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.984+0000 7f6bf2ffd640 1 -- 172.21.15.69:0/306862017 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4004a20 con 0x7f6bfc0b9590 2023-12-20T04:23:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.984+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc1432c0 con 0x7f6bfc0b9590 2023-12-20T04:23:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.984+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc146120 con 0x7f6bfc0b9590 2023-12-20T04:23:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.984+0000 7f6bf2ffd640 1 -- 172.21.15.69:0/306862017 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6be4012400 con 0x7f6bfc0b9590 2023-12-20T04:23:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.984+0000 7f6bf2ffd640 1 -- 172.21.15.69:0/306862017 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6be401b870 con 0x7f6bfc0b9590 2023-12-20T04:23:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.985+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc04e840 con 0x7f6bfc0b9590 2023-12-20T04:23:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:03.987+0000 7f6bf2ffd640 1 -- 172.21.15.69:0/306862017 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f6be4018070 con 0x7f6bfc0b9590 2023-12-20T04:23:03.999 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:03.999+0000 7f4c12c50040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-20T04:23:04.007 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:04.007+0000 7f42efa2c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-20T04:23:04.047 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:04.047+0000 7f4c12c50040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-20T04:23:04.056 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:04.056+0000 7f42efa2c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-20T04:23:04.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.058+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e542e453-dc96-473e-a782-f67519ccf8b9", "id": 4} v 0) v1 -- 0x7f6bfc0b4960 con 0x7f6bfc0b9590 2023-12-20T04:23:04.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.066+0000 7f6bf2ffd640 1 -- 172.21.15.69:0/306862017 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e542e453-dc96-473e-a782-f67519ccf8b9", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6be401b490 con 0x7f6bfc0b9590 2023-12-20T04:23:04.067 INFO:teuthology.orchestra.run.smithi069.stdout:4 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bfc0b9590 msgr2=0x7f6bfc1450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bfc0b9590 0x7f6bfc1450e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c450 tx=0x7f6be400c910 comp rx=0 tx=0).stop 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 shutdown_connections 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6bfc1427b0 0x7f6bfc143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bfc0b9590 0x7f6bfc1450e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 --2- 172.21.15.69:0/306862017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6bfc0b4f30 0x7f6bfc144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 >> 172.21.15.69:0/306862017 conn(0x7f6bfc0be4b0 msgr2=0x7f6bfc0bb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 shutdown_connections 2023-12-20T04:23:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.067+0000 7f6c00e5f640 1 -- 172.21.15.69:0/306862017 wait complete. 2023-12-20T04:23:04.077 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new bd5a6512-aade-40d4-8b73-0b515a54415e 5 2023-12-20T04:23:04.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 Processor -- start 2023-12-20T04:23:04.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 -- start start 2023-12-20T04:23:04.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f84b0148340 0x7f84b006d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84b0071960 0x7f84b006fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0070270 0x7f84b0069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b0070890 con 0x7f84b0071960 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b00b0940 con 0x7f84b0148340 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.216+0000 7f84b5fc9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b80d0 con 0x7f84b0070270 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84affff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0070270 0x7f84b0069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84af7fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f84b0148340 0x7f84b006d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84affff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0070270 0x7f84b0069ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58376/0 (socket says 172.21.15.69:58376) 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84affff640 1 -- 172.21.15.69:0/3229145626 learned_addr learned my addr 172.21.15.69:0/3229145626 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84aeffd640 1 --2- 172.21.15.69:0/3229145626 >> v2:172.21.15.40:3300/0 conn(0x7f84b0071960 0x7f84b006fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84af7fe640 1 -- 172.21.15.69:0/3229145626 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0070270 msgr2=0x7f84b0069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84af7fe640 1 --2- 172.21.15.69:0/3229145626 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0070270 0x7f84b0069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84af7fe640 1 -- 172.21.15.69:0/3229145626 >> v2:172.21.15.40:3300/0 conn(0x7f84b0071960 msgr2=0x7f84b006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84af7fe640 1 --2- 172.21.15.69:0/3229145626 >> v2:172.21.15.40:3300/0 conn(0x7f84b0071960 0x7f84b006fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.217+0000 7f84af7fe640 1 -- 172.21.15.69:0/3229145626 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0071540 con 0x7f84b0148340 2023-12-20T04:23:04.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84af7fe640 1 --2- 172.21.15.69:0/3229145626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0148340 0x7f84b006d520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84b006f810 tx=0x7f84a002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9728c7d99038fc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84ae7fc640 1 -- 172.21.15.69:0/3229145626 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a002f050 con 0x7f84b0148340 2023-12-20T04:23:04.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84ae7fc640 1 -- 172.21.15.69:0/3229145626 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a0031700 con 0x7f84b0148340 2023-12-20T04:23:04.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84ae7fc640 1 -- 172.21.15.69:0/3229145626 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0031a90 con 0x7f84b0148340 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84b5fc9640 1 -- 172.21.15.69:0/3229145626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0148340 msgr2=0x7f84b006d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/3229145626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0148340 0x7f84b006d520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84b006f810 tx=0x7f84a002b7a0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84b5fc9640 1 -- 172.21.15.69:0/3229145626 shutdown_connections 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/3229145626 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0070270 0x7f84b0069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/3229145626 >> v2:172.21.15.40:3300/0 conn(0x7f84b0071960 0x7f84b006fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/3229145626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0148340 0x7f84b006d520 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.218+0000 7f84b5fc9640 1 -- 172.21.15.69:0/3229145626 >> 172.21.15.69:0/3229145626 conn(0x7f84b00b99c0 msgr2=0x7f84b00b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.219+0000 7f84b5fc9640 1 -- 172.21.15.69:0/3229145626 shutdown_connections 2023-12-20T04:23:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.219+0000 7f84b5fc9640 1 -- 172.21.15.69:0/3229145626 wait complete. 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.219+0000 7f84b5fc9640 1 Processor -- start 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84b5fc9640 1 -- start start 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84b5fc9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0070270 0x7f84b014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84b5fc9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0071960 0x7f84b00b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84b5fc9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0148340 0x7f84b00b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84b5fc9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b014d6c0 con 0x7f84b0148340 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84b5fc9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b01e3ef0 con 0x7f84b0070270 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84b5fc9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00bc9c0 con 0x7f84b0071960 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84aeffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0071960 0x7f84b00b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0070270 0x7f84b014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84aeffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0071960 0x7f84b00b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58390/0 (socket says 172.21.15.69:58390) 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84aeffd640 1 -- 172.21.15.69:0/1893213635 learned_addr learned my addr 172.21.15.69:0/1893213635 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.220+0000 7f84affff640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0148340 0x7f84b00b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84af7fe640 1 -- 172.21.15.69:0/1893213635 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0071960 msgr2=0x7f84b00b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84af7fe640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0071960 0x7f84b00b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84af7fe640 1 -- 172.21.15.69:0/1893213635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0148340 msgr2=0x7f84b00b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84af7fe640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0148340 0x7f84b00b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84af7fe640 1 -- 172.21.15.69:0/1893213635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0009400 con 0x7f84b0070270 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84af7fe640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0070270 0x7f84b014d180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f84a0033000 tx=0x7f84a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f8497fff640 1 -- 172.21.15.69:0/1893213635 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0006e10 con 0x7f84b0070270 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f8497fff640 1 -- 172.21.15.69:0/1893213635 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a0031500 con 0x7f84b0070270 2023-12-20T04:23:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f8497fff640 1 -- 172.21.15.69:0/1893213635 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0033c50 con 0x7f84b0070270 2023-12-20T04:23:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b01e35c0 con 0x7f84b0070270 2023-12-20T04:23:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b01e3b80 con 0x7f84b0070270 2023-12-20T04:23:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f8497fff640 1 -- 172.21.15.69:0/1893213635 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84a003a040 con 0x7f84b0070270 2023-12-20T04:23:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.221+0000 7f8497fff640 1 -- 172.21.15.69:0/1893213635 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f84a003c980 con 0x7f84b0070270 2023-12-20T04:23:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.222+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b006da20 con 0x7f84b0070270 2023-12-20T04:23:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.226+0000 7f8497fff640 1 -- 172.21.15.69:0/1893213635 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f84a0043030 con 0x7f84b0070270 2023-12-20T04:23:04.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.297+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bd5a6512-aade-40d4-8b73-0b515a54415e", "id": 5} v 0) v1 -- 0x7f84b01e3d10 con 0x7f84b0070270 2023-12-20T04:23:04.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.304+0000 7f8497fff640 1 -- 172.21.15.69:0/1893213635 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd5a6512-aade-40d4-8b73-0b515a54415e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f84a0038070 con 0x7f84b0070270 2023-12-20T04:23:04.305 INFO:teuthology.orchestra.run.smithi069.stdout:5 2023-12-20T04:23:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0070270 msgr2=0x7f84b014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0070270 0x7f84b014d180 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f84a0033000 tx=0x7f84a00046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 shutdown_connections 2023-12-20T04:23:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84b0148340 0x7f84b00b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f84b0071960 0x7f84b00b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 --2- 172.21.15.69:0/1893213635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b0070270 0x7f84b014d180 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 >> 172.21.15.69:0/1893213635 conn(0x7f84b00b99c0 msgr2=0x7f84b00b8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 shutdown_connections 2023-12-20T04:23:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.305+0000 7f84b5fc9640 1 -- 172.21.15.69:0/1893213635 wait complete. 2023-12-20T04:23:04.316 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new e55e5986-4fe7-4794-adc4-f73d074957d4 6 2023-12-20T04:23:04.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.413+0000 7f488ab11640 1 Processor -- start 2023-12-20T04:23:04.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f488ab11640 1 -- start start 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f488ab11640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4884142cb0 0x7f4884069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f488ab11640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f48840a16a0 0x7f488414c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f488ab11640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4884149180 con 0x7f48840a1260 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f488ab11640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48840a1af0 con 0x7f48840a16a0 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f488ab11640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4884148b30 con 0x7f4884142cb0 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f48890ae640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f48840a16a0 0x7f488414c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f48888ad640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4884142cb0 0x7f4884069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f48888ad640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4884142cb0 0x7f4884069ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58398/0 (socket says 172.21.15.69:58398) 2023-12-20T04:23:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f48890ae640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f48840a16a0 0x7f488414c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54364/0 (socket says 172.21.15.69:54364) 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.414+0000 7f48888ad640 1 -- 172.21.15.69:0/4180689268 learned_addr learned my addr 172.21.15.69:0/4180689268 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.415+0000 7f48888ad640 1 -- 172.21.15.69:0/4180689268 >> v2:172.21.15.69:3300/0 conn(0x7f48840a16a0 msgr2=0x7f488414c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.415+0000 7f48888ad640 1 --2- 172.21.15.69:0/4180689268 >> v2:172.21.15.69:3300/0 conn(0x7f48840a16a0 0x7f488414c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.415+0000 7f48888ad640 1 -- 172.21.15.69:0/4180689268 >> v1:172.21.15.40:6789/0 conn(0x7f48840a1260 legacy=0x7f488414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.415+0000 7f48888ad640 1 -- 172.21.15.69:0/4180689268 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884148e10 con 0x7f4884142cb0 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.415+0000 7f48888ad640 1 --2- 172.21.15.69:0/4180689268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4884142cb0 0x7f4884069ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4878009870 tx=0x7f487802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21998821470ae24d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.415+0000 7f48837fe640 1 -- 172.21.15.69:0/4180689268 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487802f840 con 0x7f4884142cb0 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.415+0000 7f48837fe640 1 -- 172.21.15.69:0/4180689268 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487802f9a0 con 0x7f4884142cb0 2023-12-20T04:23:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f48837fe640 1 -- 172.21.15.69:0/4180689268 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487802fd30 con 0x7f4884142cb0 2023-12-20T04:23:04.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 -- 172.21.15.69:0/4180689268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4884142cb0 msgr2=0x7f4884069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 --2- 172.21.15.69:0/4180689268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4884142cb0 0x7f4884069ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4878009870 tx=0x7f487802ba20 comp rx=0 tx=0).stop 2023-12-20T04:23:04.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 -- 172.21.15.69:0/4180689268 shutdown_connections 2023-12-20T04:23:04.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 --2- 172.21.15.69:0/4180689268 >> v2:172.21.15.69:3300/0 conn(0x7f48840a16a0 0x7f488414c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 --2- 172.21.15.69:0/4180689268 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4884142cb0 0x7f4884069ba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 -- 172.21.15.69:0/4180689268 >> 172.21.15.69:0/4180689268 conn(0x7f48840b9150 msgr2=0x7f48840b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 -- 172.21.15.69:0/4180689268 shutdown_connections 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.416+0000 7f488ab11640 1 -- 172.21.15.69:0/4180689268 wait complete. 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.417+0000 7f488ab11640 1 Processor -- start 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.417+0000 7f488ab11640 1 -- start start 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f488ab11640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48840a1260 0x7f4884147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f488ab11640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f48840a16a0 0x7f48840b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f488ab11640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4884142cb0 0x7f4884139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f488ab11640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4884147cd0 con 0x7f4884142cb0 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f488ab11640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48840b46f0 con 0x7f48840a1260 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f488ab11640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48840b2e90 con 0x7f48840a16a0 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f4883fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f48840a16a0 0x7f48840b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f4883fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f48840a16a0 0x7f48840b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58410/0 (socket says 172.21.15.69:58410) 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f4883fff640 1 -- 172.21.15.69:0/70435472 learned_addr learned my addr 172.21.15.69:0/70435472 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f48888ad640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48840a1260 0x7f4884147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f48890ae640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4884142cb0 0x7f4884139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f48888ad640 1 -- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f48840a16a0 msgr2=0x7f48840b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f48888ad640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f48840a16a0 0x7f48840b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f48888ad640 1 -- 172.21.15.69:0/70435472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4884142cb0 msgr2=0x7f4884139920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f48888ad640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4884142cb0 0x7f4884139920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f48888ad640 1 -- 172.21.15.69:0/70435472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48780094d0 con 0x7f48840a1260 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.418+0000 7f4883fff640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f48840a16a0 0x7f48840b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f48888ad640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48840a1260 0x7f4884147790 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4878033000 tx=0x7f4878004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f48817fa640 1 -- 172.21.15.69:0/70435472 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487803c040 con 0x7f48840a1260 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f48817fa640 1 -- 172.21.15.69:0/70435472 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4878037c60 con 0x7f48840a1260 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48840b6320 con 0x7f48840a1260 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f48817fa640 1 -- 172.21.15.69:0/70435472 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48780423f0 con 0x7f48840a1260 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48840b5f00 con 0x7f48840a1260 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f48817fa640 1 -- 172.21.15.69:0/70435472 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4878042870 con 0x7f48840a1260 2023-12-20T04:23:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.419+0000 7f48817fa640 1 -- 172.21.15.69:0/70435472 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f487802d9c0 con 0x7f48840a1260 2023-12-20T04:23:04.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.420+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48841487b0 con 0x7f48840a1260 2023-12-20T04:23:04.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.422+0000 7f48817fa640 1 -- 172.21.15.69:0/70435472 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f4878047070 con 0x7f48840a1260 2023-12-20T04:23:04.445 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:04.444+0000 7f4c12c50040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-20T04:23:04.455 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:04.455+0000 7f42efa2c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-20T04:23:04.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.495+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e55e5986-4fe7-4794-adc4-f73d074957d4", "id": 6} v 0) v1 -- 0x7f488404e840 con 0x7f48840a1260 2023-12-20T04:23:04.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.500+0000 7f48817fa640 1 -- 172.21.15.69:0/70435472 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e55e5986-4fe7-4794-adc4-f73d074957d4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4878042c60 con 0x7f48840a1260 2023-12-20T04:23:04.501 INFO:teuthology.orchestra.run.smithi069.stdout:6 2023-12-20T04:23:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48840a1260 msgr2=0x7f4884147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48840a1260 0x7f4884147790 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4878033000 tx=0x7f4878004730 comp rx=0 tx=0).stop 2023-12-20T04:23:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 shutdown_connections 2023-12-20T04:23:04.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4884142cb0 0x7f4884139920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f48840a16a0 0x7f48840b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 --2- 172.21.15.69:0/70435472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48840a1260 0x7f4884147790 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 >> 172.21.15.69:0/70435472 conn(0x7f48840b9150 msgr2=0x7f4884071400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 shutdown_connections 2023-12-20T04:23:04.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.501+0000 7f488ab11640 1 -- 172.21.15.69:0/70435472 wait complete. 2023-12-20T04:23:04.511 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd new 9f984eec-3a3e-4edf-b896-8fe6ca58ebdb 7 2023-12-20T04:23:04.587 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:04.587+0000 7f4c12c50040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-20T04:23:04.598 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:04.597+0000 7f42efa2c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-20T04:23:04.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.610+0000 7ffbe2896640 1 Processor -- start 2023-12-20T04:23:04.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.610+0000 7ffbe2896640 1 -- start start 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbe2896640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffbdc06d790 0x7ffbdc0b7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbe2896640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc144b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbe2896640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0b4d70 con 0x7ffbdc145090 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbe2896640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc0b8680 con 0x7ffbdc06d790 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbe2896640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0a2cf0 con 0x7ffbdc0b8220 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdbfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffbdc06d790 0x7ffbdc0b7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc144b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58416/0 (socket says 172.21.15.69:58416) 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdbfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffbdc06d790 0x7ffbdc0b7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54384/0 (socket says 172.21.15.69:54384) 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdb7fe640 1 -- 172.21.15.69:0/3317646633 learned_addr learned my addr 172.21.15.69:0/3317646633 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:04.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdb7fe640 1 -- 172.21.15.69:0/3317646633 >> v2:172.21.15.69:3300/0 conn(0x7ffbdc06d790 msgr2=0x7ffbdc0b7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:04.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdb7fe640 1 --2- 172.21.15.69:0/3317646633 >> v2:172.21.15.69:3300/0 conn(0x7ffbdc06d790 0x7ffbdc0b7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdb7fe640 1 -- 172.21.15.69:0/3317646633 >> v1:172.21.15.40:6789/0 conn(0x7ffbdc145090 legacy=0x7ffbdc14afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdb7fe640 1 -- 172.21.15.69:0/3317646633 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc1482a0 con 0x7ffbdc0b8220 2023-12-20T04:23:04.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.611+0000 7ffbdbfff640 1 --2- 172.21.15.69:0/3317646633 >> v2:172.21.15.69:3300/0 conn(0x7ffbdc06d790 0x7ffbdc0b7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:04.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbdb7fe640 1 --2- 172.21.15.69:0/3317646633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc144b50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009870 tx=0x7ffbcc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af3ac36fb925762 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbdaffd640 1 -- 172.21.15.69:0/3317646633 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc031640 con 0x7ffbdc0b8220 2023-12-20T04:23:04.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbdaffd640 1 -- 172.21.15.69:0/3317646633 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0317a0 con 0x7ffbdc0b8220 2023-12-20T04:23:04.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbdaffd640 1 -- 172.21.15.69:0/3317646633 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc031b30 con 0x7ffbdc0b8220 2023-12-20T04:23:04.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbe2896640 1 -- 172.21.15.69:0/3317646633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 msgr2=0x7ffbdc144b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbe2896640 1 --2- 172.21.15.69:0/3317646633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc144b50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009870 tx=0x7ffbcc02b8f0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbe2896640 1 -- 172.21.15.69:0/3317646633 shutdown_connections 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbe2896640 1 --2- 172.21.15.69:0/3317646633 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc144b50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbe2896640 1 --2- 172.21.15.69:0/3317646633 >> v2:172.21.15.69:3300/0 conn(0x7ffbdc06d790 0x7ffbdc0b7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.612+0000 7ffbe2896640 1 -- 172.21.15.69:0/3317646633 >> 172.21.15.69:0/3317646633 conn(0x7ffbdc0b99c0 msgr2=0x7ffbdc0b9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.613+0000 7ffbe2896640 1 -- 172.21.15.69:0/3317646633 shutdown_connections 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.613+0000 7ffbe2896640 1 -- 172.21.15.69:0/3317646633 wait complete. 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.613+0000 7ffbe2896640 1 Processor -- start 2023-12-20T04:23:04.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe2896640 1 -- start start 2023-12-20T04:23:04.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe2896640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc06d790 0x7ffbdc069e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe2896640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc09e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe2896640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbdc145090 0x7ffbdc13ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe2896640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc06a350 con 0x7ffbdc145090 2023-12-20T04:23:04.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe2896640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc09e9a0 con 0x7ffbdc06d790 2023-12-20T04:23:04.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe2896640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc09dbc0 con 0x7ffbdc0b8220 2023-12-20T04:23:04.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc09e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbdbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc06d790 0x7ffbdc069e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbdb7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc09e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.69:58420/0 (socket says 172.21.15.69:58420) 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbdb7fe640 1 -- 172.21.15.69:0/1552957789 learned_addr learned my addr 172.21.15.69:0/1552957789 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbdbfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc06d790 0x7ffbdc069e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54392/0 (socket says 172.21.15.69:54392) 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.614+0000 7ffbe0e33640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbdc145090 0x7ffbdc13ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbdbfff640 1 -- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 msgr2=0x7ffbdc09e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbdbfff640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc09e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbdbfff640 1 -- 172.21.15.69:0/1552957789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbdc145090 msgr2=0x7ffbdc13ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbdbfff640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbdc145090 0x7ffbdc13ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbdbfff640 1 -- 172.21.15.69:0/1552957789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd0009400 con 0x7ffbdc06d790 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbdb7fe640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc09e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbdbfff640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc06d790 0x7ffbdc069e10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000e900 tx=0x7ffbd000edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbd8ff9640 1 -- 172.21.15.69:0/1552957789 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000ca00 con 0x7ffbdc06d790 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbd8ff9640 1 -- 172.21.15.69:0/1552957789 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000cb60 con 0x7ffbdc06d790 2023-12-20T04:23:04.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbd8ff9640 1 -- 172.21.15.69:0/1552957789 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0013470 con 0x7ffbdc06d790 2023-12-20T04:23:04.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0094d0 con 0x7ffbdc06d790 2023-12-20T04:23:04.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc09d600 con 0x7ffbdc06d790 2023-12-20T04:23:04.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbd8ff9640 1 -- 172.21.15.69:0/1552957789 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffbd00138d0 con 0x7ffbdc06d790 2023-12-20T04:23:04.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.615+0000 7ffbd8ff9640 1 -- 172.21.15.69:0/1552957789 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ffbd00123d0 con 0x7ffbdc06d790 2023-12-20T04:23:04.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.616+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc04e840 con 0x7ffbdc06d790 2023-12-20T04:23:04.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.618+0000 7ffbd8ff9640 1 -- 172.21.15.69:0/1552957789 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7ffbd0021060 con 0x7ffbdc06d790 2023-12-20T04:23:04.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.689+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f984eec-3a3e-4edf-b896-8fe6ca58ebdb", "id": 7} v 0) v1 -- 0x7ffbdc0b06a0 con 0x7ffbdc06d790 2023-12-20T04:23:04.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.696+0000 7ffbd8ff9640 1 -- 172.21.15.69:0/1552957789 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f984eec-3a3e-4edf-b896-8fe6ca58ebdb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffbd002a0b0 con 0x7ffbdc06d790 2023-12-20T04:23:04.697 INFO:teuthology.orchestra.run.smithi069.stdout:7 2023-12-20T04:23:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc06d790 msgr2=0x7ffbdc069e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc06d790 0x7ffbdc069e10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000e900 tx=0x7ffbd000edc0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 shutdown_connections 2023-12-20T04:23:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbdc145090 0x7ffbdc13ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffbdc0b8220 0x7ffbdc09e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 --2- 172.21.15.69:0/1552957789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbdc06d790 0x7ffbdc069e10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 >> 172.21.15.69:0/1552957789 conn(0x7ffbdc0b99c0 msgr2=0x7ffbdc0bc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 shutdown_connections 2023-12-20T04:23:04.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-12-20T04:23:04.697+0000 7ffbe2896640 1 -- 172.21.15.69:0/1552957789 wait complete. 2023-12-20T04:23:04.708 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-20T04:23:04.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-20T04:23:04.710 INFO:tasks.ceph.osd.0:Started 2023-12-20T04:23:04.710 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-20T04:23:04.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-20T04:23:04.711 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:04.710+0000 7f42efa2c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-20T04:23:04.712 INFO:tasks.ceph.osd.1:Started 2023-12-20T04:23:04.712 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-20T04:23:04.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-20T04:23:04.714 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:04.714+0000 7f4c12c50040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-20T04:23:04.714 INFO:tasks.ceph.osd.2:Started 2023-12-20T04:23:04.715 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-20T04:23:04.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-20T04:23:04.717 INFO:tasks.ceph.osd.3:Started 2023-12-20T04:23:04.717 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-20T04:23:04.717 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-20T04:23:04.719 INFO:tasks.ceph.osd.4:Started 2023-12-20T04:23:04.719 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-20T04:23:04.719 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-20T04:23:04.721 INFO:tasks.ceph.osd.5:Started 2023-12-20T04:23:04.722 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-20T04:23:04.722 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-20T04:23:04.724 INFO:tasks.ceph.osd.6:Started 2023-12-20T04:23:04.724 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-20T04:23:04.724 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-20T04:23:04.726 INFO:tasks.ceph.osd.7:Started 2023-12-20T04:23:04.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:04.769 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:04.768+0000 7f4c12c50040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-20T04:23:04.770 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:04.769+0000 7f42efa2c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-20T04:23:04.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.866+0000 7ff96ef00640 1 Processor -- start 2023-12-20T04:23:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.866+0000 7ff96ef00640 1 -- start start 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.866+0000 7ff96ef00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff968144ea0 0x7ff968156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.866+0000 7ff96ef00640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680bc6b0 con 0x7ff9680b6690 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.866+0000 7ff96ef00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680a59f0 con 0x7ff9680bcdd0 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.866+0000 7ff96ef00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680bc0a0 con 0x7ff968144ea0 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff967fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff9680b6690 0x7ff968144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51662/0 (socket says 172.21.15.40:51662) 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff967fff640 1 -- 172.21.15.40:0/2534855385 learned_addr learned my addr 172.21.15.40:0/2534855385 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff96d49d640 1 --2- 172.21.15.40:0/2534855385 >> v2:172.21.15.69:3300/0 conn(0x7ff968144ea0 0x7ff968156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff9677fe640 1 -- 172.21.15.40:0/2534855385 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163318817 0 0) 0x7ff9680bc6b0 con 0x7ff9680b6690 2023-12-20T04:23:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff9677fe640 1 -- 172.21.15.40:0/2534855385 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff958003520 con 0x7ff9680b6690 2023-12-20T04:23:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff9677fe640 1 -- 172.21.15.40:0/2534855385 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301516356 0 0) 0x7ff9680a59f0 con 0x7ff9680bcdd0 2023-12-20T04:23:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff9677fe640 1 -- 172.21.15.40:0/2534855385 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9680bc6b0 con 0x7ff9680bcdd0 2023-12-20T04:23:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff96d49d640 1 -- 172.21.15.40:0/2534855385 >> v1:172.21.15.69:6789/0 conn(0x7ff9680bcdd0 legacy=0x7ff9680b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff96d49d640 1 -- 172.21.15.40:0/2534855385 >> v1:172.21.15.40:6789/0 conn(0x7ff9680b6690 legacy=0x7ff968144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.867+0000 7ff96d49d640 1 -- 172.21.15.40:0/2534855385 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680bc340 con 0x7ff968144ea0 2023-12-20T04:23:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.868+0000 7ff96d49d640 1 --2- 172.21.15.40:0/2534855385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff968144ea0 0x7ff968156350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff9680a5b80 tx=0x7ff96002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86cb5fad08c184d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.868+0000 7ff9677fe640 1 -- 172.21.15.40:0/2534855385 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96002cce0 con 0x7ff968144ea0 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.868+0000 7ff9677fe640 1 -- 172.21.15.40:0/2534855385 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96002ce40 con 0x7ff968144ea0 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.868+0000 7ff9677fe640 1 -- 172.21.15.40:0/2534855385 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960034640 con 0x7ff968144ea0 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.869+0000 7ff96ef00640 1 -- 172.21.15.40:0/2534855385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff968144ea0 msgr2=0x7ff968156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.869+0000 7ff96ef00640 1 --2- 172.21.15.40:0/2534855385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff968144ea0 0x7ff968156350 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff9680a5b80 tx=0x7ff96002bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.869+0000 7ff96ef00640 1 -- 172.21.15.40:0/2534855385 shutdown_connections 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.869+0000 7ff96ef00640 1 --2- 172.21.15.40:0/2534855385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff968144ea0 0x7ff968156350 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.869+0000 7ff96ef00640 1 -- 172.21.15.40:0/2534855385 >> 172.21.15.40:0/2534855385 conn(0x7ff968071e60 msgr2=0x7ff9680c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.869+0000 7ff96ef00640 1 -- 172.21.15.40:0/2534855385 shutdown_connections 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.869+0000 7ff96ef00640 1 -- 172.21.15.40:0/2534855385 wait complete. 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.870+0000 7ff96ef00640 1 Processor -- start 2023-12-20T04:23:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.870+0000 7ff96ef00640 1 -- start start 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96ef00640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff9680b6690 0x7ff968146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96ef00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9680bcdd0 0x7ff9681dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96ef00640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff968144ea0 0x7ff968141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96ef00640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff968145ce0 con 0x7ff968144ea0 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96ef00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff968146920 con 0x7ff9680bcdd0 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96ef00640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff968147120 con 0x7ff9680b6690 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff968144ea0 0x7ff968141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff968144ea0 0x7ff968141280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51384/0 (socket says 172.21.15.40:51384) 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 -- 172.21.15.40:0/836507920 learned_addr learned my addr 172.21.15.40:0/836507920 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:04.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff967fff640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9680bcdd0 0x7ff9681dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96cc9c640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff9680b6690 0x7ff968146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 -- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff9680b6690 msgr2=0x7ff968146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff9680b6690 0x7ff968146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 -- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9680bcdd0 msgr2=0x7ff9681dfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9680bcdd0 0x7ff9681dfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff96d49d640 1 -- 172.21.15.40:0/836507920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff960009a70 con 0x7ff968144ea0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.871+0000 7ff967fff640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9680bcdd0 0x7ff9681dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff96d49d640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff968144ea0 0x7ff968141280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff96002c540 tx=0x7ff960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff9657fa640 1 -- 172.21.15.40:0/836507920 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96003e610 con 0x7ff968144ea0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff9657fa640 1 -- 172.21.15.40:0/836507920 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96003e770 con 0x7ff968144ea0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9681d4cd0 con 0x7ff968144ea0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff9657fa640 1 -- 172.21.15.40:0/836507920 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96003eb20 con 0x7ff968144ea0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff968147310 con 0x7ff968144ea0 2023-12-20T04:23:04.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff9657fa640 1 -- 172.21.15.40:0/836507920 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff96003b050 con 0x7ff968144ea0 2023-12-20T04:23:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.872+0000 7ff9657fa640 1 -- 172.21.15.40:0/836507920 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff96003da40 con 0x7ff968144ea0 2023-12-20T04:23:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.873+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9680b5c10 con 0x7ff968144ea0 2023-12-20T04:23:04.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:04.875+0000 7ff9657fa640 1 -- 172.21.15.40:0/836507920 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7ff9680b5c10 con 0x7ff968144ea0 2023-12-20T04:23:04.886 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:04.882+0000 7f4c12c50040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:23:04.908 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:04.907+0000 7f42efa2c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:23:04.976 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:04.975+0000 7f4c12c50040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-20T04:23:05.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.009+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff968145e20 con 0x7ff968144ea0 2023-12-20T04:23:05.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.009+0000 7ff9657fa640 1 -- 172.21.15.40:0/836507920 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff968145e20 con 0x7ff968144ea0 2023-12-20T04:23:05.014 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:05.014 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:04.691056+0000","last_up_change":"0.000000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff968144ea0 msgr2=0x7ff968141280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff968144ea0 0x7ff968141280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff96002c540 tx=0x7ff960004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 shutdown_connections 2023-12-20T04:23:05.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff968144ea0 0x7ff968141280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9680bcdd0 0x7ff9681dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 --2- 172.21.15.40:0/836507920 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff9680b6690 0x7ff968146bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 >> 172.21.15.40:0/836507920 conn(0x7ff968071e60 msgr2=0x7ff9681d5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 shutdown_connections 2023-12-20T04:23:05.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:05.011+0000 7ff96ef00640 1 -- 172.21.15.40:0/836507920 wait complete. 2023-12-20T04:23:05.022 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-20T04:23:05.022 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-20T04:23:05.049 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:05.048+0000 7f42efa2c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-20T04:23:05.116 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:05.115+0000 7f4c12c50040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:23:05.159 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:05.158+0000 7f4c12c50040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-20T04:23:05.194 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:05.194+0000 7f42efa2c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:23:05.238 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:05.238+0000 7f42efa2c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-20T04:23:05.297 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:05.295+0000 7f4c12c50040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-20T04:23:05.325 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T04:23:05.324+0000 7fb17fc1c500 -1 Falling back to public interface 2023-12-20T04:23:05.327 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T04:23:05.326+0000 7f07fe59b500 -1 Falling back to public interface 2023-12-20T04:23:05.340 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-20T04:23:05.339+0000 7fbe3614a500 -1 Falling back to public interface 2023-12-20T04:23:05.343 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T04:23:05.342+0000 7ff211a8c500 -1 Falling back to public interface 2023-12-20T04:23:05.345 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-20T04:23:05.345+0000 7f957e405500 -1 Falling back to public interface 2023-12-20T04:23:05.349 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-20T04:23:05.348+0000 7f4e0bf37500 -1 Falling back to public interface 2023-12-20T04:23:05.349 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-20T04:23:05.348+0000 7f5021afa500 -1 Falling back to public interface 2023-12-20T04:23:05.355 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-20T04:23:05.354+0000 7fdca4a16500 -1 Falling back to public interface 2023-12-20T04:23:05.388 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:05.388+0000 7f42efa2c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-20T04:23:05.829 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:05.921 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.918+0000 7f3e87ce5640 1 Processor -- start 2023-12-20T04:23:05.921 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.918+0000 7f3e87ce5640 1 -- start start 2023-12-20T04:23:05.921 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e87ce5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e8006af20 0x7f3e801417d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:05.921 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e87ce5640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3e80141d10 0x7f3e801477e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:05.921 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e87ce5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80147d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:05.921 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e87ce5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e80070500 con 0x7f3e8006af20 2023-12-20T04:23:05.921 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e87ce5640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e80148260 con 0x7f3e80141d10 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e87ce5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8006fbf0 con 0x7f3e800b9130 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e85a81640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e8006af20 0x7f3e801417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e85a81640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e8006af20 0x7f3e801417d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33388/0 (socket says 172.21.15.40:33388) 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e85a81640 1 -- 172.21.15.40:0/1669816679 learned_addr learned my addr 172.21.15.40:0/1669816679 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e85280640 1 --2- 172.21.15.40:0/1669816679 >> v2:172.21.15.69:3300/0 conn(0x7f3e80141d10 0x7f3e801477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.919+0000 7f3e86282640 1 --2- 172.21.15.40:0/1669816679 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.920+0000 7f3e85a81640 1 -- 172.21.15.40:0/1669816679 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 msgr2=0x7f3e80147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.920+0000 7f3e85a81640 1 --2- 172.21.15.40:0/1669816679 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80147d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.920+0000 7f3e85a81640 1 -- 172.21.15.40:0/1669816679 >> v2:172.21.15.69:3300/0 conn(0x7f3e80141d10 msgr2=0x7f3e801477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.920+0000 7f3e85a81640 1 --2- 172.21.15.40:0/1669816679 >> v2:172.21.15.69:3300/0 conn(0x7f3e80141d10 0x7f3e801477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.922 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.920+0000 7f3e85a81640 1 -- 172.21.15.40:0/1669816679 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8006fe40 con 0x7f3e8006af20 2023-12-20T04:23:05.923 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.920+0000 7f3e85a81640 1 --2- 172.21.15.40:0/1669816679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e8006af20 0x7f3e801417d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e801453f0 tx=0x7f3e7002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b720739e8ad0bc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:05.926 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e84a7f640 1 -- 172.21.15.40:0/1669816679 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7002c950 con 0x7f3e8006af20 2023-12-20T04:23:05.926 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e84a7f640 1 -- 172.21.15.40:0/1669816679 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7002cab0 con 0x7f3e8006af20 2023-12-20T04:23:05.926 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e84a7f640 1 -- 172.21.15.40:0/1669816679 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7002ce40 con 0x7f3e8006af20 2023-12-20T04:23:05.926 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 -- 172.21.15.40:0/1669816679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e8006af20 msgr2=0x7f3e801417d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/1669816679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e8006af20 0x7f3e801417d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e801453f0 tx=0x7f3e7002bdb0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 -- 172.21.15.40:0/1669816679 shutdown_connections 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/1669816679 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/1669816679 >> v2:172.21.15.69:3300/0 conn(0x7f3e80141d10 0x7f3e801477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/1669816679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e8006af20 0x7f3e801417d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 -- 172.21.15.40:0/1669816679 >> 172.21.15.40:0/1669816679 conn(0x7f3e800bcfc0 msgr2=0x7f3e800bd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 -- 172.21.15.40:0/1669816679 shutdown_connections 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.921+0000 7f3e87ce5640 1 -- 172.21.15.40:0/1669816679 wait complete. 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 Processor -- start 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 -- start start 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e8006af20 0x7f3e8014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:05.927 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80069e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e80141d10 0x7f3e800b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8006a350 con 0x7f3e80141d10 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800b6f90 con 0x7f3e8006af20 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e87ce5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8014b540 con 0x7f3e800b9130 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e86282640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e80141d10 0x7f3e800b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e86282640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e80141d10 0x7f3e800b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33394/0 (socket says 172.21.15.40:33394) 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e85280640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80069e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e86282640 1 -- 172.21.15.40:0/3992149635 learned_addr learned my addr 172.21.15.40:0/3992149635 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:05.928 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.923+0000 7f3e85a81640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e8006af20 0x7f3e8014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e86282640 1 -- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 msgr2=0x7f3e80069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e86282640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80069e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e86282640 1 -- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e8006af20 msgr2=0x7f3e8014aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e86282640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e8006af20 0x7f3e8014aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e86282640 1 -- 172.21.15.40:0/3992149635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70009b30 con 0x7f3e80141d10 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e85a81640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e8006af20 0x7f3e8014aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e86282640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e80141d10 0x7f3e800b5240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800e7f0 tx=0x7f3e7800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e7e7fc640 1 -- 172.21.15.40:0/3992149635 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78009490 con 0x7f3e80141d10 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e7e7fc640 1 -- 172.21.15.40:0/3992149635 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7800c730 con 0x7f3e80141d10 2023-12-20T04:23:05.930 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e800b6c20 con 0x7f3e80141d10 2023-12-20T04:23:05.931 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e7e7fc640 1 -- 172.21.15.40:0/3992149635 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7800cac0 con 0x7f3e80141d10 2023-12-20T04:23:05.931 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8006a850 con 0x7f3e80141d10 2023-12-20T04:23:05.931 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e7e7fc640 1 -- 172.21.15.40:0/3992149635 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e78013470 con 0x7f3e80141d10 2023-12-20T04:23:05.931 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.924+0000 7f3e7e7fc640 1 -- 172.21.15.40:0/3992149635 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3e7801cd00 con 0x7f3e80141d10 2023-12-20T04:23:05.931 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.925+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8004e840 con 0x7f3e80141d10 2023-12-20T04:23:05.931 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.927+0000 7f3e7e7fc640 1 -- 172.21.15.40:0/3992149635 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f3e78021060 con 0x7f3e80141d10 2023-12-20T04:23:05.990 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.989+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e800b70d0 con 0x7f3e80141d10 2023-12-20T04:23:05.990 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.990+0000 7f3e7e7fc640 1 -- 172.21.15.40:0/3992149635 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3e78017070 con 0x7f3e80141d10 2023-12-20T04:23:05.990 INFO:teuthology.misc.health.smithi040.stdout: 2023-12-20T04:23:05.991 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:04.691056+0000","last_up_change":"0.000000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e80141d10 msgr2=0x7f3e800b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e80141d10 0x7f3e800b5240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800e7f0 tx=0x7f3e7800ecb0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 shutdown_connections 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e80141d10 0x7f3e800b5240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3e800b9130 0x7f3e80069e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 --2- 172.21.15.40:0/3992149635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e8006af20 0x7f3e8014aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 >> 172.21.15.40:0/3992149635 conn(0x7f3e800bcfc0 msgr2=0x7f3e800b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 shutdown_connections 2023-12-20T04:23:05.992 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:05.991+0000 7f3e87ce5640 1 -- 172.21.15.40:0/3992149635 wait complete. 2023-12-20T04:23:06.001 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-20T04:23:06.079 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:06.078+0000 7f4c12c50040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-20T04:23:06.202 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:06.202+0000 7f42efa2c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-20T04:23:06.350 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:06.350+0000 7f4c12c50040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-20T04:23:06.400 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:06.399+0000 7f4c12c50040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-20T04:23:06.489 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:06.488+0000 7f42efa2c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-20T04:23:06.502 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:06.501+0000 7f4c12c50040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-20T04:23:06.545 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:06.545+0000 7f42efa2c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-20T04:23:06.652 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-12-20T04:23:06.651+0000 7f42efa2c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-20T04:23:07.529 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:07.528+0000 7f4bb3fdc640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-20T04:23:07.529 INFO:tasks.ceph.mgr.x.smithi069.stderr:2023-12-20T04:23:07.529+0000 7f4bb3fdc640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-20T04:23:08.820 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T04:23:08.821+0000 7f07fe59b500 -1 osd.5 0 log_to_monitors true 2023-12-20T04:23:08.835 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-20T04:23:08.836+0000 7f957e405500 -1 osd.4 0 log_to_monitors true 2023-12-20T04:23:08.840 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-20T04:23:08.839+0000 7fbe3614a500 -1 osd.0 0 log_to_monitors true 2023-12-20T04:23:08.843 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T04:23:08.844+0000 7fb17fc1c500 -1 osd.6 0 log_to_monitors true 2023-12-20T04:23:08.855 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T04:23:08.855+0000 7ff211a8c500 -1 osd.7 0 log_to_monitors true 2023-12-20T04:23:08.870 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-20T04:23:08.870+0000 7f5021afa500 -1 osd.2 0 log_to_monitors true 2023-12-20T04:23:08.872 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-20T04:23:08.872+0000 7fdca4a16500 -1 osd.3 0 log_to_monitors true 2023-12-20T04:23:08.885 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-20T04:23:08.885+0000 7f4e0bf37500 -1 osd.1 0 log_to_monitors true 2023-12-20T04:23:12.555 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T04:23:12.554+0000 7fb17c502640 -1 osd.6 0 waiting for initial osdmap 2023-12-20T04:23:12.564 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T04:23:12.564+0000 7fb1732f9640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.589 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T04:23:12.588+0000 7ff20d1f6640 -1 osd.7 0 waiting for initial osdmap 2023-12-20T04:23:12.589 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-20T04:23:12.588+0000 7fdc9fbae640 -1 osd.3 0 waiting for initial osdmap 2023-12-20T04:23:12.601 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T04:23:12.601+0000 7ff205828640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.602 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-20T04:23:12.602+0000 7fdc981e0640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.615 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-20T04:23:12.615+0000 7f9579b6d640 -1 osd.4 0 waiting for initial osdmap 2023-12-20T04:23:12.620 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T04:23:12.619+0000 7f07f9d05640 -1 osd.5 0 waiting for initial osdmap 2023-12-20T04:23:12.633 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-20T04:23:12.633+0000 7f957219f640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.638 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T04:23:12.638+0000 7f07f2337640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.639 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-20T04:23:12.639+0000 7fbe330ef640 -1 osd.0 0 waiting for initial osdmap 2023-12-20T04:23:12.649 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-20T04:23:12.648+0000 7f501d264640 -1 osd.2 0 waiting for initial osdmap 2023-12-20T04:23:12.653 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-20T04:23:12.652+0000 7f4e0769f640 -1 osd.1 0 waiting for initial osdmap 2023-12-20T04:23:12.654 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-20T04:23:12.654+0000 7fbe29ee6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.660 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-20T04:23:12.660+0000 7f5015896640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.664 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-20T04:23:12.664+0000 7f4dffcd1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:23:12.807 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:12.899 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 Processor -- start 2023-12-20T04:23:12.899 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 -- start start 2023-12-20T04:23:12.904 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41540b6c00 0x7f41540b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f41540b8250 0x7f41540bad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f4154144800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41540b6300 con 0x7f41540b6c00 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415414ab60 con 0x7f41540b8250 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f415a45f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540bb260 con 0x7f415414b830 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f4153fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41540b6c00 0x7f41540b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f4153fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41540b6c00 0x7f41540b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33430/0 (socket says 172.21.15.40:33430) 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.899+0000 7f4153fff640 1 -- 172.21.15.40:0/3239761798 learned_addr learned my addr 172.21.15.40:0/3239761798 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f41589fc640 1 --2- 172.21.15.40:0/3239761798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f4154144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f41537fe640 1 --2- 172.21.15.40:0/3239761798 >> v2:172.21.15.69:3300/0 conn(0x7f41540b8250 0x7f41540bad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:12.905 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f4153fff640 1 -- 172.21.15.40:0/3239761798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 msgr2=0x7f4154144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f4153fff640 1 --2- 172.21.15.40:0/3239761798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f4154144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f4153fff640 1 -- 172.21.15.40:0/3239761798 >> v2:172.21.15.69:3300/0 conn(0x7f41540b8250 msgr2=0x7f41540bad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f4153fff640 1 --2- 172.21.15.40:0/3239761798 >> v2:172.21.15.69:3300/0 conn(0x7f41540b8250 0x7f41540bad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f4153fff640 1 -- 172.21.15.40:0/3239761798 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415414ad50 con 0x7f41540b6c00 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f41589fc640 1 --2- 172.21.15.40:0/3239761798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f4154144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.900+0000 7f4153fff640 1 --2- 172.21.15.40:0/3239761798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f41540b5dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f3f055ce80d68c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f4152ffd640 1 -- 172.21.15.40:0/3239761798 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144030840 con 0x7f41540b6c00 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f4152ffd640 1 -- 172.21.15.40:0/3239761798 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440309a0 con 0x7f41540b6c00 2023-12-20T04:23:12.906 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f4152ffd640 1 -- 172.21.15.40:0/3239761798 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144030d30 con 0x7f41540b6c00 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 -- 172.21.15.40:0/3239761798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 msgr2=0x7f41540b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 --2- 172.21.15.40:0/3239761798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f41540b5dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414402b980 comp rx=0 tx=0).stop 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 -- 172.21.15.40:0/3239761798 shutdown_connections 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 --2- 172.21.15.40:0/3239761798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f4154144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 --2- 172.21.15.40:0/3239761798 >> v2:172.21.15.69:3300/0 conn(0x7f41540b8250 0x7f41540bad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 --2- 172.21.15.40:0/3239761798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f41540b5dc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 -- 172.21.15.40:0/3239761798 >> 172.21.15.40:0/3239761798 conn(0x7f41540c03a0 msgr2=0x7f41540c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 -- 172.21.15.40:0/3239761798 shutdown_connections 2023-12-20T04:23:12.910 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.901+0000 7f415a45f640 1 -- 172.21.15.40:0/3239761798 wait complete. 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.902+0000 7f415a45f640 1 Processor -- start 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f415a45f640 1 -- start start 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f415a45f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f415414c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f415a45f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41540b8250 0x7f415413e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f415a45f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f41541e0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f415a45f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415414d730 con 0x7f41540b6c00 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f415a45f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415414e670 con 0x7f41540b8250 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f415a45f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415414e8e0 con 0x7f415414b830 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f4153fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f415414c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:12.911 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f4153fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f415414c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33436/0 (socket says 172.21.15.40:33436) 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f4153fff640 1 -- 172.21.15.40:0/1983658356 learned_addr learned my addr 172.21.15.40:0/1983658356 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f41589fc640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f41541e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.903+0000 7f41537fe640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41540b8250 0x7f415413e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4153fff640 1 -- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 msgr2=0x7f41541e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4153fff640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f41541e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4153fff640 1 -- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41540b8250 msgr2=0x7f415413e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4153fff640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41540b8250 0x7f415413e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4153fff640 1 -- 172.21.15.40:0/1983658356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440094d0 con 0x7f41540b6c00 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4153fff640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f415414c790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f414402b9c0 tx=0x7f4144004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4150ff9640 1 -- 172.21.15.40:0/1983658356 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144030810 con 0x7f41540b6c00 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4150ff9640 1 -- 172.21.15.40:0/1983658356 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4144044480 con 0x7f41540b6c00 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f4150ff9640 1 -- 172.21.15.40:0/1983658356 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144044850 con 0x7f41540b6c00 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415414ebc0 con 0x7f41540b6c00 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.904+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4154148a30 con 0x7f41540b6c00 2023-12-20T04:23:12.912 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.905+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415404e840 con 0x7f41540b6c00 2023-12-20T04:23:12.913 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.905+0000 7f4150ff9640 1 -- 172.21.15.40:0/1983658356 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 88551+0+0 (secure 0 0 0) 0x7f414402f390 con 0x7f41540b6c00 2023-12-20T04:23:12.913 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.906+0000 7f4150ff9640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f414006a3a0 0x7f414006c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:12.913 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.906+0000 7f4150ff9640 1 -- 172.21.15.40:0/1983658356 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f414403e070 con 0x7f41540b6c00 2023-12-20T04:23:12.913 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.906+0000 7f41537fe640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f414006a3a0 0x7f414006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:12.913 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.907+0000 7f41537fe640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f414006a3a0 0x7f414006c860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41541487b0 tx=0x7f4148008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:12.913 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:12.911+0000 7f4150ff9640 1 -- 172.21.15.40:0/1983658356 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f41440768c0 con 0x7f41540b6c00 2023-12-20T04:23:13.090 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.090+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41540b7e90 con 0x7f41540b6c00 2023-12-20T04:23:13.091 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.090+0000 7f4150ff9640 1 -- 172.21.15.40:0/1983658356 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4144034090 con 0x7f41540b6c00 2023-12-20T04:23:13.091 INFO:teuthology.misc.health.smithi040.stdout: 2023-12-20T04:23:13.091 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":12,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:10.530435+0000","last_up_change":"0.000000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:13.093 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.092+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f414006a3a0 msgr2=0x7f414006c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.092+0000 7f415a45f640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f414006a3a0 0x7f414006c860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f41541487b0 tx=0x7f4148008040 comp rx=0 tx=0).stop 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.092+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 msgr2=0x7f415414c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.092+0000 7f415a45f640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f415414c790 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f414402b9c0 tx=0x7f4144004730 comp rx=0 tx=0).stop 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.092+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 shutdown_connections 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.092+0000 7f415a45f640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f414006a3a0 0x7f414006c860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.092+0000 7f415a45f640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f415414b830 0x7f41541e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.093+0000 7f415a45f640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41540b8250 0x7f415413e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.093+0000 7f415a45f640 1 --2- 172.21.15.40:0/1983658356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41540b6c00 0x7f415414c790 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.093+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 >> 172.21.15.40:0/1983658356 conn(0x7f41540c03a0 msgr2=0x7f41541499b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.093+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 shutdown_connections 2023-12-20T04:23:13.094 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:13.093+0000 7f415a45f640 1 -- 172.21.15.40:0/1983658356 wait complete. 2023-12-20T04:23:13.103 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-20T04:23:19.911 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:20.014 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2e1680640 1 Processor -- start 2023-12-20T04:23:20.015 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2e1680640 1 -- start start 2023-12-20T04:23:20.016 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2e1680640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2dc0b6c00 0x7ff2dc0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.016 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2e1680640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc14ad50 con 0x7ff2dc14b830 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2e1680640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc14b030 con 0x7ff2dc0b8250 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2e1680640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0b6300 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2daffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2dc0b6c00 0x7ff2dc0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.014+0000 7ff2daffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2dc0b6c00 0x7ff2dc0b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54962/0 (socket says 172.21.15.40:54962) 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.015+0000 7ff2daffd640 1 -- 172.21.15.40:0/1702317460 learned_addr learned my addr 172.21.15.40:0/1702317460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.015+0000 7ff2daffd640 1 -- 172.21.15.40:0/1702317460 >> v1:172.21.15.69:6789/0 conn(0x7ff2dc0b8250 legacy=0x7ff2dc144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.015+0000 7ff2daffd640 1 -- 172.21.15.40:0/1702317460 >> v1:172.21.15.40:6789/0 conn(0x7ff2dc14b830 legacy=0x7ff2dc1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.015+0000 7ff2daffd640 1 -- 172.21.15.40:0/1702317460 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc14b310 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2daffd640 1 --2- 172.21.15.40:0/1702317460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc0b5dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0098a0 tx=0x7ff2cc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aedc6281523757d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2d9ffb640 1 -- 172.21.15.40:0/1702317460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc02f840 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2d9ffb640 1 -- 172.21.15.40:0/1702317460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc02f9a0 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.017 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2d9ffb640 1 -- 172.21.15.40:0/1702317460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc02fd30 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.020 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2e1680640 1 -- 172.21.15.40:0/1702317460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 msgr2=0x7ff2dc0b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2e1680640 1 --2- 172.21.15.40:0/1702317460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc0b5dc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0098a0 tx=0x7ff2cc02ba20 comp rx=0 tx=0).stop 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2e1680640 1 -- 172.21.15.40:0/1702317460 shutdown_connections 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2e1680640 1 --2- 172.21.15.40:0/1702317460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc0b5dc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2e1680640 1 -- 172.21.15.40:0/1702317460 >> 172.21.15.40:0/1702317460 conn(0x7ff2dc0c03a0 msgr2=0x7ff2dc0c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2e1680640 1 -- 172.21.15.40:0/1702317460 shutdown_connections 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.016+0000 7ff2e1680640 1 -- 172.21.15.40:0/1702317460 wait complete. 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 Processor -- start 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 -- start start 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc1e0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff2dc0b8250 0x7ff2dc1e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2dc14b830 0x7ff2dc13efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.021 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc13f4e0 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc13d0f0 con 0x7ff2dc14b830 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2e1680640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc1e3660 con 0x7ff2dc0b8250 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.018+0000 7ff2daffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc1e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc1e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54964/0 (socket says 172.21.15.40:54964) 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 -- 172.21.15.40:0/3333524553 learned_addr learned my addr 172.21.15.40:0/3333524553 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2db7fe640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2dc14b830 0x7ff2dc13efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2da7fc640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff2dc0b8250 0x7ff2dc1e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 -- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff2dc0b8250 msgr2=0x7ff2dc1e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff2dc0b8250 0x7ff2dc1e40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 -- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2dc14b830 msgr2=0x7ff2dc13efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2dc14b830 0x7ff2dc13efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 -- 172.21.15.40:0/3333524553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0094d0 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2da7fc640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff2dc0b8250 0x7ff2dc1e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:20.022 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2daffd640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc1e0110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc000c00 tx=0x7ff2cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.023 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2c37fe640 1 -- 172.21.15.40:0/3333524553 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc041400 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.023 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2c37fe640 1 -- 172.21.15.40:0/3333524553 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc041580 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.023 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc1e3c20 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.023 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2c37fe640 1 -- 172.21.15.40:0/3333524553 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc041930 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.023 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.019+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc13c310 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.024 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.020+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc13c500 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.024 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.021+0000 7ff2c37fe640 1 -- 172.21.15.40:0/3333524553 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2cc041a90 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.024 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.021+0000 7ff2c37fe640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff2c806a430 0x7ff2c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.024 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.021+0000 7ff2c37fe640 1 -- 172.21.15.40:0/3333524553 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff2cc03c070 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.024 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.022+0000 7ff2da7fc640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff2c806a430 0x7ff2c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.024 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.022+0000 7ff2da7fc640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff2c806a430 0x7ff2c806c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0007fd0 tx=0x7ff2d0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.026 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.026+0000 7ff2c37fe640 1 -- 172.21.15.40:0/3333524553 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff2cc076fe0 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.202 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.202+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2dc04e840 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.203 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.203+0000 7ff2c37fe640 1 -- 172.21.15.40:0/3333524553 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7ff2cc041d40 con 0x7ff2dc0b6c00 2023-12-20T04:23:20.203 INFO:teuthology.misc.health.smithi040.stdout: 2023-12-20T04:23:20.204 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":16,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:16.591754+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:20.205 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff2c806a430 msgr2=0x7ff2c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff2c806a430 0x7ff2c806c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0007fd0 tx=0x7ff2d0009040 comp rx=0 tx=0).stop 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 msgr2=0x7ff2dc1e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc1e0110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc000c00 tx=0x7ff2cc004730 comp rx=0 tx=0).stop 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 shutdown_connections 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff2c806a430 0x7ff2c806c8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2dc14b830 0x7ff2dc13efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff2dc0b8250 0x7ff2dc1e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 --2- 172.21.15.40:0/3333524553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2dc0b6c00 0x7ff2dc1e0110 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.204+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 >> 172.21.15.40:0/3333524553 conn(0x7ff2dc0c03a0 msgr2=0x7ff2dc149c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.205+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 shutdown_connections 2023-12-20T04:23:20.206 INFO:teuthology.misc.health.smithi040.stderr:2023-12-20T04:23:20.205+0000 7ff2e1680640 1 -- 172.21.15.40:0/3333524553 wait complete. 2023-12-20T04:23:20.215 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-20T04:23:20.215 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-20T04:23:20.216 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:23:20.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:23:20.219 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:23:20.219 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:23:20.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:23:20.221 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:23:20.221 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:23:20.221 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:23:20.223 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:23:20.224 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-20T04:23:20.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:20.300 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-12-20T04:23:20.301 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-12-20T04:23:20.306 INFO:tasks.ceph.mds.b.smithi069.stdout:starting mds.b at 2023-12-20T04:23:20.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.333+0000 7fadf9221640 1 Processor -- start 2023-12-20T04:23:20.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.333+0000 7fadf9221640 1 -- start start 2023-12-20T04:23:20.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf9221640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fadf40b6730 0x7fadf414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf9221640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40710b0 0x7fadf406a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf9221640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf40b4110 con 0x7fadf40b6b10 2023-12-20T04:23:20.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf9221640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf414b010 con 0x7fadf40b6730 2023-12-20T04:23:20.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf9221640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf406b800 con 0x7fadf40710b0 2023-12-20T04:23:20.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fadf40b6730 0x7fadf414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fadf40b6730 0x7fadf414aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54994/0 (socket says 172.21.15.40:54994) 2023-12-20T04:23:20.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf2d9d640 1 -- 172.21.15.40:0/376608909 learned_addr learned my addr 172.21.15.40:0/376608909 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:20.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf359e640 1 --2- 172.21.15.40:0/376608909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40710b0 0x7fadf406a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf2d9d640 1 -- 172.21.15.40:0/376608909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40710b0 msgr2=0x7fadf406a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf2d9d640 1 --2- 172.21.15.40:0/376608909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40710b0 0x7fadf406a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf2d9d640 1 -- 172.21.15.40:0/376608909 >> v1:172.21.15.69:6789/0 conn(0x7fadf40b6b10 legacy=0x7fadf4069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.334+0000 7fadf2d9d640 1 -- 172.21.15.40:0/376608909 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40b3b50 con 0x7fadf40b6730 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.335+0000 7fadf2d9d640 1 --2- 172.21.15.40:0/376608909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6730 0x7fadf414aad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fade8009870 tx=0x7fade802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408ecf8bbd7da9a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.335+0000 7fadf1d9b640 1 -- 172.21.15.40:0/376608909 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8030840 con 0x7fadf40b6730 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.335+0000 7fadf1d9b640 1 -- 172.21.15.40:0/376608909 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade80309a0 con 0x7fadf40b6730 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.335+0000 7fadf1d9b640 1 -- 172.21.15.40:0/376608909 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8030d30 con 0x7fadf40b6730 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 -- 172.21.15.40:0/376608909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6730 msgr2=0x7fadf414aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 --2- 172.21.15.40:0/376608909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6730 0x7fadf414aad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fade8009870 tx=0x7fade802b980 comp rx=0 tx=0).stop 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 -- 172.21.15.40:0/376608909 shutdown_connections 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 --2- 172.21.15.40:0/376608909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40710b0 0x7fadf406a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 --2- 172.21.15.40:0/376608909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6730 0x7fadf414aad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 -- 172.21.15.40:0/376608909 >> 172.21.15.40:0/376608909 conn(0x7fadf40bcf60 msgr2=0x7fadf40bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:20.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 -- 172.21.15.40:0/376608909 shutdown_connections 2023-12-20T04:23:20.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.336+0000 7fadf9221640 1 -- 172.21.15.40:0/376608909 wait complete. 2023-12-20T04:23:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.337+0000 7fadf9221640 1 Processor -- start 2023-12-20T04:23:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.337+0000 7fadf9221640 1 -- start start 2023-12-20T04:23:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf9221640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf40710b0 0x7fadf413fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf9221640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40b6730 0x7fadf413b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf9221640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6b10 0x7fadf40b9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6b10 0x7fadf40b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf9221640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4140080 con 0x7fadf40b6b10 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6b10 0x7fadf40b9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54998/0 (socket says 172.21.15.40:54998) 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 -- 172.21.15.40:0/3221169208 learned_addr learned my addr 172.21.15.40:0/3221169208 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf9221640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b91d0 con 0x7fadf40710b0 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40b75d0 con 0x7fadf40b6730 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf2d9d640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf40710b0 0x7fadf413fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf259c640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40b6730 0x7fadf413b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 -- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40b6730 msgr2=0x7fadf413b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40b6730 0x7fadf413b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 -- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf40710b0 msgr2=0x7fadf413fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf40710b0 0x7fadf413fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 -- 172.21.15.40:0/3221169208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80094d0 con 0x7fadf40b6b10 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf359e640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6b10 0x7fadf40b9860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadec007e90 tx=0x7fadec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7faddb7fe640 1 -- 172.21.15.40:0/3221169208 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec014420 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7faddb7fe640 1 -- 172.21.15.40:0/3221169208 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec014580 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf40b7910 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.338+0000 7faddb7fe640 1 -- 172.21.15.40:0/3221169208 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec014930 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.339+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf40b7c20 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.340+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf4071ca0 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.340+0000 7faddb7fe640 1 -- 172.21.15.40:0/3221169208 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fadec014a90 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.340+0000 7faddb7fe640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fade006a430 0x7fade006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.340+0000 7faddb7fe640 1 -- 172.21.15.40:0/3221169208 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fadec088d90 con 0x7fadf40b6b10 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.340+0000 7fadf2d9d640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fade006a430 0x7fade006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.341+0000 7fadf2d9d640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fade006a430 0x7fade006c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fade8036000 tx=0x7fade8008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.345+0000 7faddb7fe640 1 -- 172.21.15.40:0/3221169208 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fadec054780 con 0x7fadf40b6b10 2023-12-20T04:23:20.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.524+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadf40b8080 con 0x7fadf40b6b10 2023-12-20T04:23:20.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.525+0000 7faddb7fe640 1 -- 172.21.15.40:0/3221169208 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7fadec057da0 con 0x7fadf40b6b10 2023-12-20T04:23:20.526 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:20.526 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:16.591754+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fade006a430 msgr2=0x7fade006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fade006a430 0x7fade006c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fade8036000 tx=0x7fade8008030 comp rx=0 tx=0).stop 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6b10 msgr2=0x7fadf40b9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6b10 0x7fadf40b9860 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fadec007e90 tx=0x7fadec00e4b0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 shutdown_connections 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fade006a430 0x7fade006c8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadf40b6b10 0x7fadf40b9860 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fadf40b6730 0x7fadf413b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 --2- 172.21.15.40:0/3221169208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf40710b0 0x7fadf413fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 >> 172.21.15.40:0/3221169208 conn(0x7fadf40bcf60 msgr2=0x7fadf4069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:20.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 shutdown_connections 2023-12-20T04:23:20.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.527+0000 7fadf9221640 1 -- 172.21.15.40:0/3221169208 wait complete. 2023-12-20T04:23:20.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:20.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:20.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.647+0000 7fb545adf640 1 Processor -- start 2023-12-20T04:23:20.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb545adf640 1 -- start start 2023-12-20T04:23:20.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb545adf640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb5400bb140 0x7fb5400be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb545adf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb54006a950 0x7fb5400bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb545adf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bee00 0x7fb5400bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb545adf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5400bbda0 con 0x7fb54006a950 2023-12-20T04:23:20.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb545adf640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5400bfa50 con 0x7fb5400bb140 2023-12-20T04:23:20.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb545adf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400bf770 con 0x7fb5400bee00 2023-12-20T04:23:20.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb53effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb54006a950 0x7fb5400bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb53effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb54006a950 0x7fb5400bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55006/0 (socket says 172.21.15.40:55006) 2023-12-20T04:23:20.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb53effd640 1 -- 172.21.15.40:0/267235135 learned_addr learned my addr 172.21.15.40:0/267235135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:20.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.648+0000 7fb53ffff640 1 --2- 172.21.15.40:0/267235135 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bee00 0x7fb5400bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53f7fe640 1 --2- 172.21.15.40:0/267235135 >> v2:172.21.15.69:3300/0 conn(0x7fb5400bb140 0x7fb5400be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53effd640 1 -- 172.21.15.40:0/267235135 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bee00 msgr2=0x7fb5400bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53effd640 1 --2- 172.21.15.40:0/267235135 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bee00 0x7fb5400bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53effd640 1 -- 172.21.15.40:0/267235135 >> v2:172.21.15.69:3300/0 conn(0x7fb5400bb140 msgr2=0x7fb5400be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53effd640 1 --2- 172.21.15.40:0/267235135 >> v2:172.21.15.69:3300/0 conn(0x7fb5400bb140 0x7fb5400be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53effd640 1 -- 172.21.15.40:0/267235135 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54006b040 con 0x7fb54006a950 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53effd640 1 --2- 172.21.15.40:0/267235135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb54006a950 0x7fb5400bfee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb540067620 tx=0x7fb53402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a9e4a3d11ece04 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.649+0000 7fb53e7fc640 1 -- 172.21.15.40:0/267235135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5340317e0 con 0x7fb54006a950 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb53e7fc640 1 -- 172.21.15.40:0/267235135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534031940 con 0x7fb54006a950 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb53e7fc640 1 -- 172.21.15.40:0/267235135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534031cd0 con 0x7fb54006a950 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 -- 172.21.15.40:0/267235135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb54006a950 msgr2=0x7fb5400bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 --2- 172.21.15.40:0/267235135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb54006a950 0x7fb5400bfee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb540067620 tx=0x7fb53402b880 comp rx=0 tx=0).stop 2023-12-20T04:23:20.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 -- 172.21.15.40:0/267235135 shutdown_connections 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 --2- 172.21.15.40:0/267235135 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bee00 0x7fb5400bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 --2- 172.21.15.40:0/267235135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb54006a950 0x7fb5400bfee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 --2- 172.21.15.40:0/267235135 >> v2:172.21.15.69:3300/0 conn(0x7fb5400bb140 0x7fb5400be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 -- 172.21.15.40:0/267235135 >> 172.21.15.40:0/267235135 conn(0x7fb5400bcfd0 msgr2=0x7fb5400bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 -- 172.21.15.40:0/267235135 shutdown_connections 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.650+0000 7fb545adf640 1 -- 172.21.15.40:0/267235135 wait complete. 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.651+0000 7fb545adf640 1 Processor -- start 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.651+0000 7fb545adf640 1 -- start start 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb545adf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb54006a950 0x7fb540146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb545adf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bb140 0x7fb5400a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb545adf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5400bee00 0x7fb5400a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb545adf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540147290 con 0x7fb5400bee00 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb545adf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400a2620 con 0x7fb54006a950 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb545adf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400a2e80 con 0x7fb5400bb140 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5400bee00 0x7fb5400a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5400bee00 0x7fb5400a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55012/0 (socket says 172.21.15.40:55012) 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 -- 172.21.15.40:0/3805980023 learned_addr learned my addr 172.21.15.40:0/3805980023 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53f7fe640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb54006a950 0x7fb540146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53effd640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bb140 0x7fb5400a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 -- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bb140 msgr2=0x7fb5400a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bb140 0x7fb5400a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 -- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb54006a950 msgr2=0x7fb540146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb54006a950 0x7fb540146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53ffff640 1 -- 172.21.15.40:0/3805980023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5340094d0 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.652+0000 7fb53f7fe640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb54006a950 0x7fb540146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.653+0000 7fb53ffff640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5400bee00 0x7fb5400a0ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb538007e60 tx=0x7fb53800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.653+0000 7fb527fff640 1 -- 172.21.15.40:0/3805980023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538014420 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.653+0000 7fb527fff640 1 -- 172.21.15.40:0/3805980023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5380145a0 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.653+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5400a28c0 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.653+0000 7fb527fff640 1 -- 172.21.15.40:0/3805980023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb538014950 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.653+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5400a2080 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.654+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54009fa00 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.654+0000 7fb527fff640 1 -- 172.21.15.40:0/3805980023 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb538014ab0 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.655+0000 7fb527fff640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb52c06a430 0x7fb52c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.655+0000 7fb527fff640 1 -- 172.21.15.40:0/3805980023 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb538088ee0 con 0x7fb5400bee00 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.655+0000 7fb53f7fe640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb52c06a430 0x7fb52c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.655+0000 7fb53f7fe640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb52c06a430 0x7fb52c06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb53000ba50 tx=0x7fb530008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.659+0000 7fb527fff640 1 -- 172.21.15.40:0/3805980023 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb538054820 con 0x7fb5400bee00 2023-12-20T04:23:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.835+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5400740a0 con 0x7fb5400bee00 2023-12-20T04:23:20.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.836+0000 7fb527fff640 1 -- 172.21.15.40:0/3805980023 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb538057e40 con 0x7fb5400bee00 2023-12-20T04:23:20.837 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb52c06a430 msgr2=0x7fb52c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb52c06a430 0x7fb52c06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb53000ba50 tx=0x7fb530008040 comp rx=0 tx=0).stop 2023-12-20T04:23:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5400bee00 msgr2=0x7fb5400a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5400bee00 0x7fb5400a0ca0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb538007e60 tx=0x7fb53800e4b0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 shutdown_connections 2023-12-20T04:23:20.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb52c06a430 0x7fb52c06c8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5400bee00 0x7fb5400a0ca0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb5400bb140 0x7fb5400a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 --2- 172.21.15.40:0/3805980023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb54006a950 0x7fb540146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 >> 172.21.15.40:0/3805980023 conn(0x7fb5400bcfd0 msgr2=0x7fb5400a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 shutdown_connections 2023-12-20T04:23:20.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.838+0000 7fb545adf640 1 -- 172.21.15.40:0/3805980023 wait complete. 2023-12-20T04:23:20.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.954+0000 7fc6e8084640 1 Processor -- start 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.954+0000 7fc6e8084640 1 -- start start 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e8084640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e8084640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6e0144ea0 0x7fc6e0155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e8084640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e00bc6b0 con 0x7fc6e00b64c0 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e8084640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e00b6900 con 0x7fc6e0144ea0 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e8084640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e00a59f0 con 0x7fc6e00bcdd0 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e6621640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6e0144ea0 0x7fc6e0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e561f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc6e00b64c0 0x7fc6e0144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49998/0 (socket says 172.21.15.40:49998) 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e561f640 1 -- 172.21.15.40:0/2212066786 learned_addr learned my addr 172.21.15.40:0/2212066786 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e5e20640 1 --2- 172.21.15.40:0/2212066786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e6621640 1 -- 172.21.15.40:0/2212066786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 msgr2=0x7fc6e00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e6621640 1 --2- 172.21.15.40:0/2212066786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e00b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e6621640 1 -- 172.21.15.40:0/2212066786 >> v1:172.21.15.40:6789/0 conn(0x7fc6e00b64c0 legacy=0x7fc6e0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e6621640 1 -- 172.21.15.40:0/2212066786 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00bc0a0 con 0x7fc6e0144ea0 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.955+0000 7fc6e4e1e640 1 -- 172.21.15.40:0/2212066786 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314765172 0 0) 0x7fc6e00bc6b0 con 0x7fc6e00b64c0 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.956+0000 7fc6e6621640 1 --2- 172.21.15.40:0/2212066786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e0144ea0 0x7fc6e0155340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009d90 tx=0x7fc6d802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a31647b78d58b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.956+0000 7fc6e4e1e640 1 -- 172.21.15.40:0/2212066786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d802cce0 con 0x7fc6e0144ea0 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.956+0000 7fc6e4e1e640 1 -- 172.21.15.40:0/2212066786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d802ce40 con 0x7fc6e0144ea0 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.956+0000 7fc6e4e1e640 1 -- 172.21.15.40:0/2212066786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8034660 con 0x7fc6e0144ea0 2023-12-20T04:23:20.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 -- 172.21.15.40:0/2212066786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e0144ea0 msgr2=0x7fc6e0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2212066786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e0144ea0 0x7fc6e0155340 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009d90 tx=0x7fc6d802bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 -- 172.21.15.40:0/2212066786 shutdown_connections 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2212066786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e0144ea0 0x7fc6e0155340 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2212066786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 -- 172.21.15.40:0/2212066786 >> 172.21.15.40:0/2212066786 conn(0x7fc6e0071e60 msgr2=0x7fc6e00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 -- 172.21.15.40:0/2212066786 shutdown_connections 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.957+0000 7fc6e8084640 1 -- 172.21.15.40:0/2212066786 wait complete. 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 Processor -- start 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 -- start start 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e00b64c0 0x7fc6e01dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e01d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e0144ea0 0x7fc6e01e2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e01e0120 con 0x7fc6e00b64c0 2023-12-20T04:23:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0146600 con 0x7fc6e0144ea0 2023-12-20T04:23:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e8084640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0143d50 con 0x7fc6e00bcdd0 2023-12-20T04:23:20.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.958+0000 7fc6e5e20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e00b64c0 0x7fc6e01dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e00b64c0 0x7fc6e01dfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55030/0 (socket says 172.21.15.40:55030) 2023-12-20T04:23:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 -- 172.21.15.40:0/2139770746 learned_addr learned my addr 172.21.15.40:0/2139770746 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e561f640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e01d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e6621640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e0144ea0 0x7fc6e01e2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 -- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 msgr2=0x7fc6e01d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e01d30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 -- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e0144ea0 msgr2=0x7fc6e01e2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e0144ea0 0x7fc6e01e2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 -- 172.21.15.40:0/2139770746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d8009a70 con 0x7fc6e00b64c0 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e5e20640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e00b64c0 0x7fc6e01dfbe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00c820 tx=0x7fc6dc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6d67fc640 1 -- 172.21.15.40:0/2139770746 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc004220 con 0x7fc6e00b64c0 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6d67fc640 1 -- 172.21.15.40:0/2139770746 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc0043a0 con 0x7fc6e00b64c0 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e01e0800 con 0x7fc6e00b64c0 2023-12-20T04:23:20.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6d67fc640 1 -- 172.21.15.40:0/2139770746 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc007a70 con 0x7fc6e00b64c0 2023-12-20T04:23:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.959+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e0146870 con 0x7fc6e00b64c0 2023-12-20T04:23:20.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.960+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e0145330 con 0x7fc6e00b64c0 2023-12-20T04:23:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.960+0000 7fc6d67fc640 1 -- 172.21.15.40:0/2139770746 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6dc007bd0 con 0x7fc6e00b64c0 2023-12-20T04:23:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.961+0000 7fc6d67fc640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc6c406a460 0x7fc6c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.961+0000 7fc6d67fc640 1 -- 172.21.15.40:0/2139770746 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6dc088350 con 0x7fc6e00b64c0 2023-12-20T04:23:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.961+0000 7fc6e561f640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc6c406a460 0x7fc6c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.961+0000 7fc6e561f640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc6c406a460 0x7fc6c406c920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6e01d3040 tx=0x7fc6d0007c00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:20.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:20.965+0000 7fc6d67fc640 1 -- 172.21.15.40:0/2139770746 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc6dc053c90 con 0x7fc6e00b64c0 2023-12-20T04:23:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.180+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6e004e840 con 0x7fc6e00b64c0 2023-12-20T04:23:21.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.180+0000 7fc6d67fc640 1 -- 172.21.15.40:0/2139770746 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7fc6dc01e090 con 0x7fc6e00b64c0 2023-12-20T04:23:21.182 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-20T04:23:21.182 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc6c406a460 msgr2=0x7fc6c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc6c406a460 0x7fc6c406c920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6e01d3040 tx=0x7fc6d0007c00 comp rx=0 tx=0).stop 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e00b64c0 msgr2=0x7fc6e01dfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e00b64c0 0x7fc6e01dfbe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00c820 tx=0x7fc6dc00cce0 comp rx=0 tx=0).stop 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 shutdown_connections 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc6c406a460 0x7fc6c406c920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e0144ea0 0x7fc6e01e2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:21.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc6e00bcdd0 0x7fc6e01d30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 --2- 172.21.15.40:0/2139770746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6e00b64c0 0x7fc6e01dfbe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 >> 172.21.15.40:0/2139770746 conn(0x7fc6e0071e60 msgr2=0x7fc6e0144560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 shutdown_connections 2023-12-20T04:23:21.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:21.183+0000 7fc6e8084640 1 -- 172.21.15.40:0/2139770746 wait complete. 2023-12-20T04:23:23.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.313+0000 7f812b127640 1 Processor -- start 2023-12-20T04:23:23.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.313+0000 7f812b127640 1 -- start start 2023-12-20T04:23:23.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.314+0000 7f812b127640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f81240b6730 0x7f812414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.314+0000 7f812b127640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81240b4110 con 0x7f81240b6b10 2023-12-20T04:23:23.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.314+0000 7f812b127640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812414b010 con 0x7f81240710b0 2023-12-20T04:23:23.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.314+0000 7f812b127640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812406b800 con 0x7f81240b6730 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.314+0000 7f8123fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f81240b6b10 0x7f8124069ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50012/0 (socket says 172.21.15.40:50012) 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.314+0000 7f8123fff640 1 -- 172.21.15.40:0/1126449692 learned_addr learned my addr 172.21.15.40:0/1126449692 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.314+0000 7f8128ec3640 1 --2- 172.21.15.40:0/1126449692 >> v2:172.21.15.69:3300/0 conn(0x7f81240b6730 0x7f812414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155521227 0 0) 0x7f81240b4110 con 0x7f81240b6b10 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8110003520 con 0x7f81240b6b10 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579208723 0 0) 0x7f812414b010 con 0x7f81240710b0 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81240b4110 con 0x7f81240710b0 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2507607900 0 0) 0x7f8110003520 con 0x7f81240b6b10 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f8128ec3640 1 -- 172.21.15.40:0/1126449692 >> v1:172.21.15.69:6789/0 conn(0x7f81240710b0 legacy=0x7f8124155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f8128ec3640 1 -- 172.21.15.40:0/1126449692 >> v1:172.21.15.40:6789/0 conn(0x7f81240b6b10 legacy=0x7f8124069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.315+0000 7f8128ec3640 1 -- 172.21.15.40:0/1126449692 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240b3b50 con 0x7f81240b6730 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f8128ec3640 1 --2- 172.21.15.40:0/1126449692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240b6730 0x7f812414aad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097a0 tx=0x7f810c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc5ce7033d524f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140019f0 con 0x7f81240b6730 2023-12-20T04:23:23.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c031590 con 0x7f81240b6730 2023-12-20T04:23:23.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f81237fe640 1 -- 172.21.15.40:0/1126449692 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c031920 con 0x7f81240b6730 2023-12-20T04:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f812b127640 1 -- 172.21.15.40:0/1126449692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240b6730 msgr2=0x7f812414aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f812b127640 1 --2- 172.21.15.40:0/1126449692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240b6730 0x7f812414aad0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097a0 tx=0x7f810c02b8b0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f812b127640 1 -- 172.21.15.40:0/1126449692 shutdown_connections 2023-12-20T04:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f812b127640 1 --2- 172.21.15.40:0/1126449692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240b6730 0x7f812414aad0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f812b127640 1 -- 172.21.15.40:0/1126449692 >> 172.21.15.40:0/1126449692 conn(0x7f81240bcf60 msgr2=0x7f81240bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:23.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f812b127640 1 -- 172.21.15.40:0/1126449692 shutdown_connections 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.316+0000 7f812b127640 1 -- 172.21.15.40:0/1126449692 wait complete. 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.317+0000 7f812b127640 1 Processor -- start 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f812b127640 1 -- start start 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f812b127640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240710b0 0x7f81241df980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f812b127640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81240b6730 0x7f81240ba210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f812b127640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81240b6b10 0x7f812414dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f812b127640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240b7a50 con 0x7f81240b6b10 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f812b127640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81241471f0 con 0x7f81240710b0 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f812b127640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8124145bc0 con 0x7f81240b6730 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f81296c4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81240b6b10 0x7f812414dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f81296c4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81240b6b10 0x7f812414dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55046/0 (socket says 172.21.15.40:55046) 2023-12-20T04:23:23.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.318+0000 7f81296c4640 1 -- 172.21.15.40:0/4185328164 learned_addr learned my addr 172.21.15.40:0/4185328164 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f8128ec3640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240710b0 0x7f81241df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f8123fff640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81240b6730 0x7f81240ba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81296c4640 1 -- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81240b6730 msgr2=0x7f81240ba210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81296c4640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81240b6730 0x7f81240ba210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81296c4640 1 -- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240710b0 msgr2=0x7f81241df980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81296c4640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240710b0 0x7f81241df980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81296c4640 1 -- 172.21.15.40:0/4185328164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c009400 con 0x7f81240b6b10 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81296c4640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81240b6b10 0x7f812414dee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f811c001eb0 tx=0x7f811c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81217fa640 1 -- 172.21.15.40:0/4185328164 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0052d0 con 0x7f81240b6b10 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81217fa640 1 -- 172.21.15.40:0/4185328164 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c005430 con 0x7f81240b6b10 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8124147490 con 0x7f81240b6b10 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f81217fa640 1 -- 172.21.15.40:0/4185328164 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0037f0 con 0x7f81240b6b10 2023-12-20T04:23:23.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.319+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8124145f60 con 0x7f81240b6b10 2023-12-20T04:23:23.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.320+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81241476d0 con 0x7f81240b6b10 2023-12-20T04:23:23.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.321+0000 7f81217fa640 1 -- 172.21.15.40:0/4185328164 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f811c003950 con 0x7f81240b6b10 2023-12-20T04:23:23.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.321+0000 7f81217fa640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f810406a400 0x7f810406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.321+0000 7f81217fa640 1 -- 172.21.15.40:0/4185328164 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f811c087860 con 0x7f81240b6b10 2023-12-20T04:23:23.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.321+0000 7f8128ec3640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f810406a400 0x7f810406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.322+0000 7f8128ec3640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f810406a400 0x7f810406c8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f810c036000 tx=0x7f810c03d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.326+0000 7f81217fa640 1 -- 172.21.15.40:0/4185328164 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f81241476d0 con 0x7f81240b6b10 2023-12-20T04:23:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.536+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81241476d0 con 0x7f81240b6b10 2023-12-20T04:23:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.537+0000 7f81217fa640 1 -- 172.21.15.40:0/4185328164 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2765 (secure 0 0 0) 0x7f81241476d0 con 0x7f81240b6b10 2023-12-20T04:23:23.537 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:23.538 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-20T04:23:23.538 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2023-12-20T04:23:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f810406a400 msgr2=0x7f810406c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f810406a400 0x7f810406c8c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f810c036000 tx=0x7f810c03d040 comp rx=0 tx=0).stop 2023-12-20T04:23:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81240b6b10 msgr2=0x7f812414dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81240b6b10 0x7f812414dee0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f811c001eb0 tx=0x7f811c00c820 comp rx=0 tx=0).stop 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 shutdown_connections 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f810406a400 0x7f810406c8c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81240b6b10 0x7f812414dee0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81240b6730 0x7f81240ba210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 --2- 172.21.15.40:0/4185328164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81240710b0 0x7f81241df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 >> 172.21.15.40:0/4185328164 conn(0x7f81240bcf60 msgr2=0x7f8124148ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.538+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 shutdown_connections 2023-12-20T04:23:23.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.539+0000 7f812b127640 1 -- 172.21.15.40:0/4185328164 wait complete. 2023-12-20T04:23:23.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.655+0000 7f4e5e6fb640 1 Processor -- start 2023-12-20T04:23:23.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.655+0000 7f4e5e6fb640 1 -- start start 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e5e6fb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e580bcdd0 0x7f4e580b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e5e6fb640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4e580b64c0 0x7f4e58144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e5e6fb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 0x7f4e5814e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e5e6fb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580bc6b0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e5e6fb640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580b6900 con 0x7f4e580b64c0 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e5e6fb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580a59f0 con 0x7f4e58144cd0 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e580bcdd0 0x7f4e580b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e580bcdd0 0x7f4e580b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55052/0 (socket says 172.21.15.40:55052) 2023-12-20T04:23:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 -- 172.21.15.40:0/1830967174 learned_addr learned my addr 172.21.15.40:0/1830967174 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e577fe640 1 --2- 172.21.15.40:0/1830967174 >> v2:172.21.15.69:3300/0 conn(0x7f4e580b64c0 0x7f4e58144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 -- 172.21.15.40:0/1830967174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 msgr2=0x7f4e5814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 --2- 172.21.15.40:0/1830967174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 0x7f4e5814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 -- 172.21.15.40:0/1830967174 >> v2:172.21.15.69:3300/0 conn(0x7f4e580b64c0 msgr2=0x7f4e58144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 --2- 172.21.15.40:0/1830967174 >> v2:172.21.15.69:3300/0 conn(0x7f4e580b64c0 0x7f4e58144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.656+0000 7f4e57fff640 1 -- 172.21.15.40:0/1830967174 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580bc0a0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.657+0000 7f4e57fff640 1 --2- 172.21.15.40:0/1830967174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e580b5f80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e580b72e0 tx=0x7f4e4802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed358486f45f5e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.657+0000 7f4e56ffd640 1 -- 172.21.15.40:0/1830967174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48030860 con 0x7f4e580bcdd0 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.657+0000 7f4e56ffd640 1 -- 172.21.15.40:0/1830967174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e480309c0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.657+0000 7f4e56ffd640 1 -- 172.21.15.40:0/1830967174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48030d50 con 0x7f4e580bcdd0 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1830967174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 msgr2=0x7f4e580b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1830967174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e580b5f80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e580b72e0 tx=0x7f4e4802b9a0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1830967174 shutdown_connections 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1830967174 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 0x7f4e5814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1830967174 >> v2:172.21.15.69:3300/0 conn(0x7f4e580b64c0 0x7f4e58144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1830967174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e580b5f80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1830967174 >> 172.21.15.40:0/1830967174 conn(0x7f4e58071e60 msgr2=0x7f4e580c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1830967174 shutdown_connections 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.658+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1830967174 wait complete. 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 Processor -- start 2023-12-20T04:23:23.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 -- start start 2023-12-20T04:23:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e580b64c0 0x7f4e5813f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e5813d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 0x7f4e581dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5813fca0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5814ae20 con 0x7f4e580b64c0 2023-12-20T04:23:23.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.659+0000 7f4e5e6fb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581e3d20 con 0x7f4e58144cd0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e5813d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e5813d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55064/0 (socket says 172.21.15.40:55064) 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 -- 172.21.15.40:0/1467148263 learned_addr learned my addr 172.21.15.40:0/1467148263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e57fff640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e580b64c0 0x7f4e5813f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e5cc98640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 0x7f4e581dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 -- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 msgr2=0x7f4e581dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 0x7f4e581dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 -- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e580b64c0 msgr2=0x7f4e5813f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e580b64c0 0x7f4e5813f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 -- 172.21.15.40:0/1467148263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e480094d0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e577fe640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e5813d960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7f0 tx=0x7f4e4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e54ff9640 1 -- 172.21.15.40:0/1467148263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c004220 con 0x7f4e580bcdd0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e581dfa20 con 0x7f4e580bcdd0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e54ff9640 1 -- 172.21.15.40:0/1467148263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c0043a0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e54ff9640 1 -- 172.21.15.40:0/1467148263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c007860 con 0x7f4e580bcdd0 2023-12-20T04:23:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.660+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e581e3a40 con 0x7f4e580bcdd0 2023-12-20T04:23:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.661+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5804e840 con 0x7f4e580bcdd0 2023-12-20T04:23:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.662+0000 7f4e54ff9640 1 -- 172.21.15.40:0/1467148263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e4c0079c0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.662+0000 7f4e54ff9640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e4406a430 0x7f4e4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.662+0000 7f4e54ff9640 1 -- 172.21.15.40:0/1467148263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e4c088300 con 0x7f4e580bcdd0 2023-12-20T04:23:23.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.662+0000 7f4e57fff640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e4406a430 0x7f4e4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.663+0000 7f4e57fff640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e4406a430 0x7f4e4406c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e48036000 tx=0x7f4e48008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.666+0000 7f4e54ff9640 1 -- 172.21.15.40:0/1467148263 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4e4c053d00 con 0x7f4e580bcdd0 2023-12-20T04:23:23.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.842+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e580a57d0 con 0x7f4e580bcdd0 2023-12-20T04:23:23.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.843+0000 7f4e54ff9640 1 -- 172.21.15.40:0/1467148263 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f4e4c057320 con 0x7f4e580bcdd0 2023-12-20T04:23:23.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:23.844 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:16.591754+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e4406a430 msgr2=0x7f4e4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e4406a430 0x7f4e4406c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e48036000 tx=0x7f4e48008030 comp rx=0 tx=0).stop 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 msgr2=0x7f4e5813d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e5813d960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c00c7f0 tx=0x7f4e4c00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 shutdown_connections 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e4406a430 0x7f4e4406c8f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e58144cd0 0x7f4e581dff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e580bcdd0 0x7f4e5813d960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 --2- 172.21.15.40:0/1467148263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e580b64c0 0x7f4e5813f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 >> 172.21.15.40:0/1467148263 conn(0x7f4e58071e60 msgr2=0x7f4e580b87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:23.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 shutdown_connections 2023-12-20T04:23:23.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.845+0000 7f4e5e6fb640 1 -- 172.21.15.40:0/1467148263 wait complete. 2023-12-20T04:23:23.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:23.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:23.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.964+0000 7fceff72e640 1 Processor -- start 2023-12-20T04:23:23.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.964+0000 7fceff72e640 1 -- start start 2023-12-20T04:23:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.964+0000 7fceff72e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcef80bb140 0x7fcef80be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.964+0000 7fceff72e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef806a950 0x7fcef80bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fceff72e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80bfa50 con 0x7fcef80bee00 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fceff72e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef80bbda0 con 0x7fcef80bb140 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fceff72e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef806b040 con 0x7fcef806a950 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefd4ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcef80bb140 0x7fcef80be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefd4ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcef80bb140 0x7fcef80be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55066/0 (socket says 172.21.15.40:55066) 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefd4ca640 1 -- 172.21.15.40:0/92204884 learned_addr learned my addr 172.21.15.40:0/92204884 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefccc9640 1 --2- 172.21.15.40:0/92204884 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef806a950 0x7fcef80bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefd4ca640 1 -- 172.21.15.40:0/92204884 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef806a950 msgr2=0x7fcef80bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefd4ca640 1 --2- 172.21.15.40:0/92204884 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef806a950 0x7fcef80bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefd4ca640 1 -- 172.21.15.40:0/92204884 >> v1:172.21.15.69:6789/0 conn(0x7fcef80bee00 legacy=0x7fcef814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.965+0000 7fcefd4ca640 1 -- 172.21.15.40:0/92204884 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80bb520 con 0x7fcef80bb140 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fcefd4ca640 1 --2- 172.21.15.40:0/92204884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef80bb140 0x7fcef80be350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009870 tx=0x7fcef402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4a8291045b5527 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceeffff640 1 -- 172.21.15.40:0/92204884 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4031640 con 0x7fcef80bb140 2023-12-20T04:23:23.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceeffff640 1 -- 172.21.15.40:0/92204884 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef40317a0 con 0x7fcef80bb140 2023-12-20T04:23:23.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceeffff640 1 -- 172.21.15.40:0/92204884 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4031b30 con 0x7fcef80bb140 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceff72e640 1 -- 172.21.15.40:0/92204884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef80bb140 msgr2=0x7fcef80be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceff72e640 1 --2- 172.21.15.40:0/92204884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef80bb140 0x7fcef80be350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009870 tx=0x7fcef402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceff72e640 1 -- 172.21.15.40:0/92204884 shutdown_connections 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceff72e640 1 --2- 172.21.15.40:0/92204884 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef806a950 0x7fcef80bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceff72e640 1 --2- 172.21.15.40:0/92204884 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef80bb140 0x7fcef80be350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.966+0000 7fceff72e640 1 -- 172.21.15.40:0/92204884 >> 172.21.15.40:0/92204884 conn(0x7fcef80bcfd0 msgr2=0x7fcef80bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.967+0000 7fceff72e640 1 -- 172.21.15.40:0/92204884 shutdown_connections 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.967+0000 7fceff72e640 1 -- 172.21.15.40:0/92204884 wait complete. 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 Processor -- start 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 -- start start 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef806a950 0x7fcef814cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcef80bb140 0x7fcef814daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef80bee00 0x7fcef80b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef814d1d0 con 0x7fcef806a950 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef814e8e0 con 0x7fcef80bb140 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fceff72e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef814c270 con 0x7fcef80bee00 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fcefd4ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef806a950 0x7fcef814cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fcefd4ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef806a950 0x7fcef814cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55082/0 (socket says 172.21.15.40:55082) 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fcefd4ca640 1 -- 172.21.15.40:0/3230462131 learned_addr learned my addr 172.21.15.40:0/3230462131 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fcefccc9640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcef80bb140 0x7fcef814daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.968+0000 7fcefdccb640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef80bee00 0x7fcef80b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fcefd4ca640 1 -- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef80bee00 msgr2=0x7fcef80b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fcefd4ca640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef80bee00 0x7fcef80b2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fcefd4ca640 1 -- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcef80bb140 msgr2=0x7fcef814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fcefd4ca640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcef80bb140 0x7fcef814daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fcefd4ca640 1 -- 172.21.15.40:0/3230462131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40094d0 con 0x7fcef806a950 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fcefd4ca640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef806a950 0x7fcef814cc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000c00 tx=0x7fcef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fceedffb640 1 -- 172.21.15.40:0/3230462131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef403ac60 con 0x7fcef806a950 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fceedffb640 1 -- 172.21.15.40:0/3230462131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef403adc0 con 0x7fcef806a950 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fceedffb640 1 -- 172.21.15.40:0/3230462131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4044630 con 0x7fcef806a950 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef814eb50 con 0x7fcef806a950 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.969+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef8147060 con 0x7fcef806a950 2023-12-20T04:23:23.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.970+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef814e740 con 0x7fcef806a950 2023-12-20T04:23:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.971+0000 7fceedffb640 1 -- 172.21.15.40:0/3230462131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcef402f050 con 0x7fcef806a950 2023-12-20T04:23:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.971+0000 7fceedffb640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.971+0000 7fceedffb640 1 -- 172.21.15.40:0/3230462131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcef40aa270 con 0x7fcef806a950 2023-12-20T04:23:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.971+0000 7fcefccc9640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.972+0000 7fcefccc9640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcef80a4330 tx=0x7fcee8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:23.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:23.975+0000 7fceedffb640 1 -- 172.21.15.40:0/3230462131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcef814e740 con 0x7fcef806a950 2023-12-20T04:23:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.149+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcef814e740 con 0x7fcef806a950 2023-12-20T04:23:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.149+0000 7fceedffb640 1 -- 172.21.15.40:0/3230462131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcef814e740 con 0x7fcef806a950 2023-12-20T04:23:24.150 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcedc06a430 msgr2=0x7fcedc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcef80a4330 tx=0x7fcee8008040 comp rx=0 tx=0).stop 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef806a950 msgr2=0x7fcef814cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef806a950 0x7fcef814cc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcef4000c00 tx=0x7fcef40046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 shutdown_connections 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcef80bee00 0x7fcef80b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcef80bb140 0x7fcef814daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 --2- 172.21.15.40:0/3230462131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcef806a950 0x7fcef814cc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 >> 172.21.15.40:0/3230462131 conn(0x7fcef80bcfd0 msgr2=0x7fcef80a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:24.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 shutdown_connections 2023-12-20T04:23:24.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.151+0000 7fceff72e640 1 -- 172.21.15.40:0/3230462131 wait complete. 2023-12-20T04:23:24.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:23:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.268+0000 7fea723b9640 1 Processor -- start 2023-12-20T04:23:24.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.268+0000 7fea723b9640 1 -- start start 2023-12-20T04:23:24.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea723b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c144e30 0x7fea6c0b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea723b9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0b6da0 con 0x7fea6c0b8b40 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea723b9640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0b8090 con 0x7fea6c0bab80 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea723b9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c14afe0 con 0x7fea6c144e30 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea70956640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fea6c0b8b40 0x7fea6c155320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50028/0 (socket says 172.21.15.40:50028) 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea70956640 1 -- 172.21.15.40:0/2993718650 learned_addr learned my addr 172.21.15.40:0/2993718650 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6bfff640 1 --2- 172.21.15.40:0/2993718650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c144e30 0x7fea6c0b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027823248 0 0) 0x7fea64001490 con 0x7fea6c0b8b40 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea54003520 con 0x7fea6c0b8b40 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132150385 0 0) 0x7fea60001160 con 0x7fea6c0bab80 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea64001490 con 0x7fea6c0bab80 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369333154 0 0) 0x7fea54003520 con 0x7fea6c0b8b40 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6bfff640 1 -- 172.21.15.40:0/2993718650 >> v1:172.21.15.69:6789/0 conn(0x7fea6c0bab80 legacy=0x7fea6c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6bfff640 1 -- 172.21.15.40:0/2993718650 >> v1:172.21.15.40:6789/0 conn(0x7fea6c0b8b40 legacy=0x7fea6c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.269+0000 7fea6bfff640 1 -- 172.21.15.40:0/2993718650 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c145210 con 0x7fea6c144e30 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.270+0000 7fea6bfff640 1 --2- 172.21.15.40:0/2993718650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c144e30 0x7fea6c0b7600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0097d0 tx=0x7fea5c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3c9d67ba11cedfd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.270+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64001b80 con 0x7fea6c144e30 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c031580 con 0x7fea6c144e30 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea6affd640 1 -- 172.21.15.40:0/2993718650 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c031910 con 0x7fea6c144e30 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea723b9640 1 -- 172.21.15.40:0/2993718650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c144e30 msgr2=0x7fea6c0b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea723b9640 1 --2- 172.21.15.40:0/2993718650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c144e30 0x7fea6c0b7600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0097d0 tx=0x7fea5c02b8a0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea723b9640 1 -- 172.21.15.40:0/2993718650 shutdown_connections 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea723b9640 1 --2- 172.21.15.40:0/2993718650 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c144e30 0x7fea6c0b7600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea723b9640 1 -- 172.21.15.40:0/2993718650 >> 172.21.15.40:0/2993718650 conn(0x7fea6c0c0200 msgr2=0x7fea6c0c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:24.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea723b9640 1 -- 172.21.15.40:0/2993718650 shutdown_connections 2023-12-20T04:23:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.271+0000 7fea723b9640 1 -- 172.21.15.40:0/2993718650 wait complete. 2023-12-20T04:23:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.272+0000 7fea723b9640 1 Processor -- start 2023-12-20T04:23:24.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.272+0000 7fea723b9640 1 -- start start 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea723b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0b8b40 0x7fea6c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea723b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c0bab80 0x7fea6c1e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea723b9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c144e30 0x7fea6c0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea723b9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0b14c0 con 0x7fea6c0b8b40 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea723b9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c146230 con 0x7fea6c144e30 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea723b9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c145ec0 con 0x7fea6c0bab80 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0b8b40 0x7fea6c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0b8b40 0x7fea6c0b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55088/0 (socket says 172.21.15.40:55088) 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 -- 172.21.15.40:0/2472799557 learned_addr learned my addr 172.21.15.40:0/2472799557 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6b7fe640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c0bab80 0x7fea6c1e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea70956640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c144e30 0x7fea6c0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 -- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c0bab80 msgr2=0x7fea6c1e2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c0bab80 0x7fea6c1e2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 -- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c144e30 msgr2=0x7fea6c0aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c144e30 0x7fea6c0aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.273+0000 7fea6bfff640 1 -- 172.21.15.40:0/2472799557 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c009400 con 0x7fea6c0b8b40 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.274+0000 7fea6bfff640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0b8b40 0x7fea6c0b0f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0097d0 tx=0x7fea5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.274+0000 7fea68ff9640 1 -- 172.21.15.40:0/2472799557 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c004230 con 0x7fea6c0b8b40 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.274+0000 7fea68ff9640 1 -- 172.21.15.40:0/2472799557 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c0043d0 con 0x7fea6c0b8b40 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.274+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c145900 con 0x7fea6c0b8b40 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.274+0000 7fea68ff9640 1 -- 172.21.15.40:0/2472799557 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c003850 con 0x7fea6c0b8b40 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.274+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c1475c0 con 0x7fea6c0b8b40 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.275+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c066390 con 0x7fea6c0b8b40 2023-12-20T04:23:24.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.275+0000 7fea68ff9640 1 -- 172.21.15.40:0/2472799557 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea5c0039b0 con 0x7fea6c0b8b40 2023-12-20T04:23:24.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.276+0000 7fea68ff9640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fea5806a430 0x7fea5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.276+0000 7fea68ff9640 1 -- 172.21.15.40:0/2472799557 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fea5c0aa4c0 con 0x7fea6c0b8b40 2023-12-20T04:23:24.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.276+0000 7fea6b7fe640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fea5806a430 0x7fea5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.276+0000 7fea6b7fe640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fea5806a430 0x7fea5806c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea6c1dd5e0 tx=0x7fea60009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:24.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.280+0000 7fea68ff9640 1 -- 172.21.15.40:0/2472799557 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fea5c075f40 con 0x7fea6c0b8b40 2023-12-20T04:23:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.459+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea6c04e840 con 0x7fea6c0b8b40 2023-12-20T04:23:24.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.459+0000 7fea68ff9640 1 -- 172.21.15.40:0/2472799557 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fea5c079560 con 0x7fea6c0b8b40 2023-12-20T04:23:24.460 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:24.460 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-12-20T04:23:24.460 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:23:24.461 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-12-20T04:23:24.461 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-12-20T04:23:24.461 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:23:24.461 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-12-20T04:23:24.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fea5806a430 msgr2=0x7fea5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fea5806a430 0x7fea5806c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea6c1dd5e0 tx=0x7fea60009040 comp rx=0 tx=0).stop 2023-12-20T04:23:24.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0b8b40 msgr2=0x7fea6c0b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0b8b40 0x7fea6c0b0f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0097d0 tx=0x7fea5c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 shutdown_connections 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fea5806a430 0x7fea5806c8f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea6c144e30 0x7fea6c0aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fea6c0bab80 0x7fea6c1e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 --2- 172.21.15.40:0/2472799557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea6c0b8b40 0x7fea6c0b0f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 >> 172.21.15.40:0/2472799557 conn(0x7fea6c0c0200 msgr2=0x7fea6c0c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 shutdown_connections 2023-12-20T04:23:24.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.461+0000 7fea723b9640 1 -- 172.21.15.40:0/2472799557 wait complete. 2023-12-20T04:23:24.472 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:23:24.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:23:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.581+0000 7f95961cb640 1 Processor -- start 2023-12-20T04:23:24.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.581+0000 7f95961cb640 1 -- start start 2023-12-20T04:23:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f95961cb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95900bc660 0x7f959014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f95961cb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959014b6c0 con 0x7f95900b79a0 2023-12-20T04:23:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f95961cb640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95900b8ba0 con 0x7f959014b290 2023-12-20T04:23:24.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f95961cb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95900bcab0 con 0x7f95900bc660 2023-12-20T04:23:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f958effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95900bc660 0x7f959014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f958f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f95900b79a0 0x7f95900b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50036/0 (socket says 172.21.15.40:50036) 2023-12-20T04:23:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f958f7fe640 1 -- 172.21.15.40:0/872630742 learned_addr learned my addr 172.21.15.40:0/872630742 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f958effd640 1 -- 172.21.15.40:0/872630742 >> v1:172.21.15.69:6789/0 conn(0x7f959014b290 legacy=0x7f9590155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f958effd640 1 -- 172.21.15.40:0/872630742 >> v1:172.21.15.40:6789/0 conn(0x7f95900b79a0 legacy=0x7f95900b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f958effd640 1 -- 172.21.15.40:0/872630742 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900b8e80 con 0x7f95900bc660 2023-12-20T04:23:24.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.582+0000 7f958e7fc640 1 -- 172.21.15.40:0/872630742 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239056861 0 0) 0x7f959014b6c0 con 0x7f95900b79a0 2023-12-20T04:23:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.583+0000 7f958effd640 1 --2- 172.21.15.40:0/872630742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900bc660 0x7f959014ad50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95840097d0 tx=0x7f958402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58bea8d137bc1c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.583+0000 7f958e7fc640 1 -- 172.21.15.40:0/872630742 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584030610 con 0x7f95900bc660 2023-12-20T04:23:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.583+0000 7f958e7fc640 1 -- 172.21.15.40:0/872630742 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584030770 con 0x7f95900bc660 2023-12-20T04:23:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.583+0000 7f958e7fc640 1 -- 172.21.15.40:0/872630742 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584030b00 con 0x7f95900bc660 2023-12-20T04:23:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.584+0000 7f95961cb640 1 -- 172.21.15.40:0/872630742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900bc660 msgr2=0x7f959014ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.584+0000 7f95961cb640 1 --2- 172.21.15.40:0/872630742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900bc660 0x7f959014ad50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95840097d0 tx=0x7f958402b960 comp rx=0 tx=0).stop 2023-12-20T04:23:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.584+0000 7f95961cb640 1 -- 172.21.15.40:0/872630742 shutdown_connections 2023-12-20T04:23:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.584+0000 7f95961cb640 1 --2- 172.21.15.40:0/872630742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900bc660 0x7f959014ad50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.584+0000 7f95961cb640 1 -- 172.21.15.40:0/872630742 >> 172.21.15.40:0/872630742 conn(0x7f95900c0330 msgr2=0x7f95900c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.584+0000 7f95961cb640 1 -- 172.21.15.40:0/872630742 shutdown_connections 2023-12-20T04:23:24.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.584+0000 7f95961cb640 1 -- 172.21.15.40:0/872630742 wait complete. 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.585+0000 7f95961cb640 1 Processor -- start 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.585+0000 7f95961cb640 1 -- start start 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f95961cb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900b79a0 0x7f9590147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f95961cb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95900bc660 0x7f95901dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f95961cb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f959014b290 0x7f9590145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f95961cb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590149b10 con 0x7f95900b79a0 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f95961cb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590146040 con 0x7f95900bc660 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f95961cb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900bfee0 con 0x7f959014b290 2023-12-20T04:23:24.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900b79a0 0x7f9590147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900b79a0 0x7f9590147f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55096/0 (socket says 172.21.15.40:55096) 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 -- 172.21.15.40:0/2455286190 learned_addr learned my addr 172.21.15.40:0/2455286190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958ffff640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f959014b290 0x7f9590145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958effd640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95900bc660 0x7f95901dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 -- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f959014b290 msgr2=0x7f9590145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f959014b290 0x7f9590145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 -- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95900bc660 msgr2=0x7f95901dfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95900bc660 0x7f95901dfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 -- 172.21.15.40:0/2455286190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584009400 con 0x7f95900b79a0 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f958f7fe640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900b79a0 0x7f9590147f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f958000c3f0 tx=0x7f958000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f9577fff640 1 -- 172.21.15.40:0/2455286190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95800074e0 con 0x7f95900b79a0 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f9577fff640 1 -- 172.21.15.40:0/2455286190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580007640 con 0x7f95900b79a0 2023-12-20T04:23:24.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f9577fff640 1 -- 172.21.15.40:0/2455286190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580004a00 con 0x7f95900b79a0 2023-12-20T04:23:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.586+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9590147a20 con 0x7f95900b79a0 2023-12-20T04:23:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.587+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95900bb180 con 0x7f95900b79a0 2023-12-20T04:23:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.587+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95900bfd40 con 0x7f95900b79a0 2023-12-20T04:23:24.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.588+0000 7f9577fff640 1 -- 172.21.15.40:0/2455286190 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9580004b60 con 0x7f95900b79a0 2023-12-20T04:23:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.588+0000 7f9577fff640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f957c06a430 0x7f957c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.588+0000 7f9577fff640 1 -- 172.21.15.40:0/2455286190 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f95800883c0 con 0x7f95900b79a0 2023-12-20T04:23:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.588+0000 7f958effd640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f957c06a430 0x7f957c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:24.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.589+0000 7f958effd640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f957c06a430 0x7f957c06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9584036000 tx=0x7f9584008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:24.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.592+0000 7f9577fff640 1 -- 172.21.15.40:0/2455286190 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f95900bfd40 con 0x7f95900b79a0 2023-12-20T04:23:24.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:24.771+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f95900bfd40 con 0x7f95900b79a0 2023-12-20T04:23:25.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.265+0000 7f9577fff640 1 -- 172.21.15.40:0/2455286190 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f95900bfd40 con 0x7f95900b79a0 2023-12-20T04:23:25.266 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-12-20T04:23:25.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f957c06a430 msgr2=0x7f957c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:25.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f957c06a430 0x7f957c06c8f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9584036000 tx=0x7f9584008030 comp rx=0 tx=0).stop 2023-12-20T04:23:25.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900b79a0 msgr2=0x7f9590147f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:25.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900b79a0 0x7f9590147f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f958000c3f0 tx=0x7f958000c8b0 comp rx=0 tx=0).stop 2023-12-20T04:23:25.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 shutdown_connections 2023-12-20T04:23:25.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f957c06a430 0x7f957c06c8f0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9584036000 tx=0x7f9584008030 comp rx=0 tx=0).stop 2023-12-20T04:23:25.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f959014b290 0x7f9590145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:25.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95900bc660 0x7f95901dfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:25.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 --2- 172.21.15.40:0/2455286190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95900b79a0 0x7f9590147f40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:25.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.270+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 >> 172.21.15.40:0/2455286190 conn(0x7f95900c0330 msgr2=0x7f95900b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:25.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.271+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 shutdown_connections 2023-12-20T04:23:25.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.271+0000 7f95961cb640 1 -- 172.21.15.40:0/2455286190 wait complete. 2023-12-20T04:23:25.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:23:25.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.404+0000 7f9620fec640 1 Processor -- start 2023-12-20T04:23:25.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.404+0000 7f9620fec640 1 -- start start 2023-12-20T04:23:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.404+0000 7f9620fec640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f961c144ae0 0x7f961c0bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.404+0000 7f9620fec640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c0bd820 con 0x7f961c144ec0 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.404+0000 7f9620fec640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c14e4b0 con 0x7f961c14dfc0 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.404+0000 7f9620fec640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961c0b8f80 con 0x7f961c144ae0 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f9611d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f961c144ec0 0x7f961c0bd110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50038/0 (socket says 172.21.15.40:50038) 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f9611d9b640 1 -- 172.21.15.40:0/3636537185 learned_addr learned my addr 172.21.15.40:0/3636537185 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f961a59c640 1 --2- 172.21.15.40:0/3636537185 >> v2:172.21.15.69:3300/0 conn(0x7f961c144ae0 0x7f961c0bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f9619d9b640 1 -- 172.21.15.40:0/3636537185 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247170896 0 0) 0x7f961c0bd820 con 0x7f961c144ec0 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f9619d9b640 1 -- 172.21.15.40:0/3636537185 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95fc003520 con 0x7f961c144ec0 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f961a59c640 1 -- 172.21.15.40:0/3636537185 >> v1:172.21.15.69:6789/0 conn(0x7f961c14dfc0 legacy=0x7f961c155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f9619d9b640 1 -- 172.21.15.40:0/3636537185 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2443941238 0 0) 0x7f95fc003520 con 0x7f961c144ec0 2023-12-20T04:23:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f961a59c640 1 -- 172.21.15.40:0/3636537185 >> v1:172.21.15.40:6789/0 conn(0x7f961c144ec0 legacy=0x7f961c0bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.405+0000 7f961a59c640 1 -- 172.21.15.40:0/3636537185 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c0b9260 con 0x7f961c144ae0 2023-12-20T04:23:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.406+0000 7f961a59c640 1 --2- 172.21.15.40:0/3636537185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c144ae0 0x7f961c0bc680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f960c0097a0 tx=0x7f960c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa5e5358a3ee75ae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.406+0000 7f9619d9b640 1 -- 172.21.15.40:0/3636537185 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c02f050 con 0x7f961c144ae0 2023-12-20T04:23:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.406+0000 7f9619d9b640 1 -- 172.21.15.40:0/3636537185 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c031500 con 0x7f961c144ae0 2023-12-20T04:23:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.406+0000 7f9619d9b640 1 -- 172.21.15.40:0/3636537185 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604001670 con 0x7f961c144ae0 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.407+0000 7f9620fec640 1 -- 172.21.15.40:0/3636537185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c144ae0 msgr2=0x7f961c0bc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.407+0000 7f9620fec640 1 --2- 172.21.15.40:0/3636537185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c144ae0 0x7f961c0bc680 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f960c0097a0 tx=0x7f960c02b820 comp rx=0 tx=0).stop 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.407+0000 7f9620fec640 1 -- 172.21.15.40:0/3636537185 shutdown_connections 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.407+0000 7f9620fec640 1 --2- 172.21.15.40:0/3636537185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c144ae0 0x7f961c0bc680 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.407+0000 7f9620fec640 1 -- 172.21.15.40:0/3636537185 >> 172.21.15.40:0/3636537185 conn(0x7f961c0714b0 msgr2=0x7f961c0718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.407+0000 7f9620fec640 1 -- 172.21.15.40:0/3636537185 shutdown_connections 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.407+0000 7f9620fec640 1 -- 172.21.15.40:0/3636537185 wait complete. 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.408+0000 7f9620fec640 1 Processor -- start 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.408+0000 7f9620fec640 1 -- start start 2023-12-20T04:23:25.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f961c144ae0 0x7f961c0c0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f961c144ec0 0x7f961c1482b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c14dfc0 0x7f961c1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0c0b60 con 0x7f961c144ae0 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c146cf0 con 0x7f961c14dfc0 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c149fe0 con 0x7f961c144ec0 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f961c144ae0 0x7f961c0c0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f961c144ae0 0x7f961c0c0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55102/0 (socket says 172.21.15.40:55102) 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 -- 172.21.15.40:0/122206634 learned_addr learned my addr 172.21.15.40:0/122206634 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961ad9d640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c14dfc0 0x7f961c1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9611d9b640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f961c144ec0 0x7f961c1482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 -- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f961c144ec0 msgr2=0x7f961c1482b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f961c144ec0 0x7f961c1482b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 -- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c14dfc0 msgr2=0x7f961c1487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c14dfc0 0x7f961c1487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 -- 172.21.15.40:0/122206634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009400 con 0x7f961c144ae0 2023-12-20T04:23:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f961a59c640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f961c144ae0 0x7f961c0c0620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098c0 tx=0x7f960c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:25.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f96137fe640 1 -- 172.21.15.40:0/122206634 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0339c0 con 0x7f961c144ae0 2023-12-20T04:23:25.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c14ab40 con 0x7f961c144ae0 2023-12-20T04:23:25.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f96137fe640 1 -- 172.21.15.40:0/122206634 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c033b40 con 0x7f961c144ae0 2023-12-20T04:23:25.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f96137fe640 1 -- 172.21.15.40:0/122206634 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c03e480 con 0x7f961c144ae0 2023-12-20T04:23:25.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.409+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c14a7d0 con 0x7f961c144ae0 2023-12-20T04:23:25.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.410+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c0740a0 con 0x7f961c144ae0 2023-12-20T04:23:25.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.411+0000 7f96137fe640 1 -- 172.21.15.40:0/122206634 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f960c03a040 con 0x7f961c144ae0 2023-12-20T04:23:25.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.411+0000 7f96137fe640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f960006a430 0x7f960006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:25.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.411+0000 7f96137fe640 1 -- 172.21.15.40:0/122206634 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f960c0aa990 con 0x7f961c144ae0 2023-12-20T04:23:25.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.412+0000 7f9611d9b640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f960006a430 0x7f960006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:25.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.412+0000 7f9611d9b640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f960006a430 0x7f960006c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f961c1479b0 tx=0x7f9604001da0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:25.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.416+0000 7f96137fe640 1 -- 172.21.15.40:0/122206634 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f960c076210 con 0x7f961c144ae0 2023-12-20T04:23:25.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:25.592+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f961c144640 con 0x7f961c144ae0 2023-12-20T04:23:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.268+0000 7f96137fe640 1 -- 172.21.15.40:0/122206634 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f960c0380d0 con 0x7f961c144ae0 2023-12-20T04:23:26.269 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-12-20T04:23:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.274+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f960006a430 msgr2=0x7f960006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.274+0000 7f9620fec640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f960006a430 0x7f960006c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f961c1479b0 tx=0x7f9604001da0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.274+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f961c144ae0 msgr2=0x7f961c0c0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.274+0000 7f9620fec640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f961c144ae0 0x7f961c0c0620 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098c0 tx=0x7f960c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.276+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 shutdown_connections 2023-12-20T04:23:26.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.276+0000 7f9620fec640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f960006a430 0x7f960006c8f0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f961c1479b0 tx=0x7f9604001da0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.277+0000 7f9620fec640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f961c14dfc0 0x7f961c1487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.277+0000 7f9620fec640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f961c144ec0 0x7f961c1482b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.277+0000 7f9620fec640 1 --2- 172.21.15.40:0/122206634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f961c144ae0 0x7f961c0c0620 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.277+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 >> 172.21.15.40:0/122206634 conn(0x7f961c0714b0 msgr2=0x7f961c0b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:26.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.280+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 shutdown_connections 2023-12-20T04:23:26.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.281+0000 7f9620fec640 1 -- 172.21.15.40:0/122206634 wait complete. 2023-12-20T04:23:26.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:23:26.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.412+0000 7faa99c5c640 1 Processor -- start 2023-12-20T04:23:26.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.412+0000 7faa99c5c640 1 -- start start 2023-12-20T04:23:26.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.412+0000 7faa99c5c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 0x7faa940be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.412+0000 7faa99c5c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa940bfa50 con 0x7faa9406a950 2023-12-20T04:23:26.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.412+0000 7faa99c5c640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9406b040 con 0x7faa940bb140 2023-12-20T04:23:26.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.412+0000 7faa99c5c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa940bbda0 con 0x7faa940bf510 2023-12-20T04:23:26.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa93fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faa9406a950 0x7faa94155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52790/0 (socket says 172.21.15.40:52790) 2023-12-20T04:23:26.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa93fff640 1 -- 172.21.15.40:0/3057341504 learned_addr learned my addr 172.21.15.40:0/3057341504 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa92ffd640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 0x7faa940be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081465045 0 0) 0x7faa940bfa50 con 0x7faa9406a950 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa80003520 con 0x7faa9406a950 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451299809 0 0) 0x7faa9406b040 con 0x7faa940bb140 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa940bfa50 con 0x7faa940bb140 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 298353897 0 0) 0x7faa80003520 con 0x7faa9406a950 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 msgr2=0x7faa940be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 0x7faa940be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 >> v1:172.21.15.69:6789/0 conn(0x7faa940bb140 legacy=0x7faa940bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940bb520 con 0x7faa9406a950 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7faa8c0019f0 con 0x7faa9406a950 2023-12-20T04:23:26.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 >> v1:172.21.15.40:6789/0 conn(0x7faa9406a950 legacy=0x7faa94155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa80003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 0x7faa800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa80004d00 0x7faa80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8000ba30 con 0x7faa80003b30 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8000bb70 con 0x7faa80004d00 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8000bce0 con 0x7faa940bf510 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.413+0000 7faa937fe640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa80003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa92ffd640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 0x7faa800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa93fff640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa80004d00 0x7faa80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa937fe640 1 -- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 msgr2=0x7faa800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa937fe640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940bf510 0x7faa800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa937fe640 1 -- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa80004d00 msgr2=0x7faa80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa937fe640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa80004d00 0x7faa80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa937fe640 1 -- 172.21.15.40:0/3057341504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80003520 con 0x7faa80003b30 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.414+0000 7faa937fe640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa80003f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa840018d0 tx=0x7faa800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1688ddf78d2628cf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840052d0 con 0x7faa80003b30 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84005430 con 0x7faa80003b30 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa927fc640 1 -- 172.21.15.40:0/3057341504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84003810 con 0x7faa80003b30 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa99c5c640 1 -- 172.21.15.40:0/3057341504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 msgr2=0x7faa80003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa99c5c640 1 --2- 172.21.15.40:0/3057341504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa80003f30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa840018d0 tx=0x7faa800057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa93fff640 1 -- 172.21.15.40:0/3057341504 reap_dead start 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa99c5c640 1 -- 172.21.15.40:0/3057341504 shutdown_connections 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa99c5c640 1 -- 172.21.15.40:0/3057341504 >> 172.21.15.40:0/3057341504 conn(0x7faa940bcfd0 msgr2=0x7faa940bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa99c5c640 1 -- 172.21.15.40:0/3057341504 shutdown_connections 2023-12-20T04:23:26.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.415+0000 7faa99c5c640 1 -- 172.21.15.40:0/3057341504 wait complete. 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.416+0000 7faa99c5c640 1 Processor -- start 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.416+0000 7faa99c5c640 1 -- start start 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa99c5c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa940b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa99c5c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa940a2260 0x7faa940a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa99c5c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940a0ad0 0x7faa941dff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa99c5c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa940b6a00 con 0x7faa80003b30 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa99c5c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa940a1450 con 0x7faa940a2260 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa99c5c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa940a2750 con 0x7faa940a0ad0 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa940b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa940b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56998/0 (socket says 172.21.15.40:56998) 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 -- 172.21.15.40:0/3985917852 learned_addr learned my addr 172.21.15.40:0/3985917852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa92ffd640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa940a2260 0x7faa940a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa93fff640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940a0ad0 0x7faa941dff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 -- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940a0ad0 msgr2=0x7faa941dff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940a0ad0 0x7faa941dff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 -- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa940a2260 msgr2=0x7faa940a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa940a2260 0x7faa940a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa937fe640 1 -- 172.21.15.40:0/3985917852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940a29e0 con 0x7faa80003b30 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa92ffd640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa940a2260 0x7faa940a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.417+0000 7faa93fff640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940a0ad0 0x7faa941dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.418+0000 7faa937fe640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa940b64c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa84005040 tx=0x7faa840012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.418+0000 7faa8bfff640 1 -- 172.21.15.40:0/3985917852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84007450 con 0x7faa80003b30 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.418+0000 7faa8bfff640 1 -- 172.21.15.40:0/3985917852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa840075b0 con 0x7faa80003b30 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.418+0000 7faa8bfff640 1 -- 172.21.15.40:0/3985917852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa840037f0 con 0x7faa80003b30 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.418+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa940a2cc0 con 0x7faa80003b30 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.418+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa940a3110 con 0x7faa80003b30 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.419+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa940740a0 con 0x7faa80003b30 2023-12-20T04:23:26.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.419+0000 7faa8bfff640 1 -- 172.21.15.40:0/3985917852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa84003950 con 0x7faa80003b30 2023-12-20T04:23:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.420+0000 7faa8bfff640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faa7406a430 0x7faa7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.420+0000 7faa8bfff640 1 -- 172.21.15.40:0/3985917852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7faa840aa700 con 0x7faa80003b30 2023-12-20T04:23:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.420+0000 7faa92ffd640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faa7406a430 0x7faa7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.420+0000 7faa92ffd640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faa7406a430 0x7faa7406c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa9414f110 tx=0x7faa7c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:26.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.424+0000 7faa8bfff640 1 -- 172.21.15.40:0/3985917852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faa84075e00 con 0x7faa80003b30 2023-12-20T04:23:26.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:23:26.429 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:23:26.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:23:26.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.639+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faa940ba4a0 con 0x7faa80003b30 2023-12-20T04:23:26.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.648+0000 7faa8bfff640 1 -- 172.21.15.40:0/3985917852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7faa8404b0c0 con 0x7faa80003b30 2023-12-20T04:23:26.648 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2023-12-20T04:23:26.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faa7406a430 msgr2=0x7faa7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faa7406a430 0x7faa7406c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa9414f110 tx=0x7faa7c008040 comp rx=0 tx=0).stop 2023-12-20T04:23:26.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 msgr2=0x7faa940b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa940b64c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa84005040 tx=0x7faa840012d0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 shutdown_connections 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faa7406a430 0x7faa7406c8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7faa940a0ad0 0x7faa941dff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa940a2260 0x7faa940a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 --2- 172.21.15.40:0/3985917852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faa80003b30 0x7faa940b64c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 >> 172.21.15.40:0/3985917852 conn(0x7faa940bcfd0 msgr2=0x7faa94072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.651+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 shutdown_connections 2023-12-20T04:23:26.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.652+0000 7faa99c5c640 1 -- 172.21.15.40:0/3985917852 wait complete. 2023-12-20T04:23:26.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:26.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.781+0000 7f41a8f88640 1 Processor -- start 2023-12-20T04:23:26.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.781+0000 7f41a8f88640 1 -- start start 2023-12-20T04:23:26.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a8f88640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f41a4144ea0 0x7f41a4156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a8f88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40bc6b0 con 0x7f41a40bcdd0 2023-12-20T04:23:26.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a8f88640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40a59f0 con 0x7f41a40b6690 2023-12-20T04:23:26.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a8f88640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a40bc0a0 con 0x7f41a4144ea0 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a259c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f41a40bcdd0 0x7f41a40b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52806/0 (socket says 172.21.15.40:52806) 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a259c640 1 -- 172.21.15.40:0/458381862 learned_addr learned my addr 172.21.15.40:0/458381862 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/458381862 >> v2:172.21.15.69:3300/0 conn(0x7f41a4144ea0 0x7f41a4156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959916961 0 0) 0x7f41a40bc6b0 con 0x7f41a40bcdd0 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4190003520 con 0x7f41a40bcdd0 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1462363460 0 0) 0x7f4190003520 con 0x7f41a40bcdd0 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 >> v2:172.21.15.69:3300/0 conn(0x7f41a4144ea0 msgr2=0x7f41a4156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 --2- 172.21.15.40:0/458381862 >> v2:172.21.15.69:3300/0 conn(0x7f41a4144ea0 0x7f41a4156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 >> v1:172.21.15.69:6789/0 conn(0x7f41a40b6690 legacy=0x7f41a4144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a40bc340 con 0x7f41a40bcdd0 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f4194001670 con 0x7f41a40bcdd0 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 >> v1:172.21.15.40:6789/0 conn(0x7f41a40bcdd0 legacy=0x7f41a40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4190003970 0x7f4190003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41900047c0 0x7f4190004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4190005180 0x7f419000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40bc0a0 con 0x7f4190005180 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419000c030 con 0x7f41900047c0 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419000c1f0 con 0x7f4190003970 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4190005180 0x7f419000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.782+0000 7f419bfff640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41900047c0 0x7f4190004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.783+0000 7f41a259c640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4190003970 0x7f4190003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.783+0000 7f41a2d9d640 1 -- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4190003970 msgr2=0x7f4190003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.783+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4190003970 0x7f4190003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.783+0000 7f41a2d9d640 1 -- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41900047c0 msgr2=0x7f4190004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:26.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.783+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41900047c0 0x7f4190004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.783+0000 7f41a2d9d640 1 -- 172.21.15.40:0/458381862 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190003520 con 0x7f4190005180 2023-12-20T04:23:26.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.783+0000 7f41a2d9d640 1 -- 172.21.15.40:0/458381862 reap_dead start 2023-12-20T04:23:26.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4190005180 0x7f419000b980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f419c009fc0 tx=0x7f41900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb62d0d05b9190c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:26.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c02cc60 con 0x7f4190005180 2023-12-20T04:23:26.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c00f040 con 0x7f4190005180 2023-12-20T04:23:26.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a1d9b640 1 -- 172.21.15.40:0/458381862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c003990 con 0x7f4190005180 2023-12-20T04:23:26.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a8f88640 1 -- 172.21.15.40:0/458381862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4190005180 msgr2=0x7f419000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a8f88640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4190005180 0x7f419000b980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f419c009fc0 tx=0x7f41900057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a8f88640 1 -- 172.21.15.40:0/458381862 shutdown_connections 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a8f88640 1 --2- 172.21.15.40:0/458381862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4190005180 0x7f419000b980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a8f88640 1 -- 172.21.15.40:0/458381862 >> 172.21.15.40:0/458381862 conn(0x7f41a4071e60 msgr2=0x7f41a40c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a8f88640 1 -- 172.21.15.40:0/458381862 shutdown_connections 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.784+0000 7f41a8f88640 1 -- 172.21.15.40:0/458381862 wait complete. 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.785+0000 7f41a8f88640 1 Processor -- start 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.785+0000 7f41a8f88640 1 -- start start 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a8f88640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4190005180 0x7f41a41d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a8f88640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41a41df7f0 0x7f41a41dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a8f88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41a41e2d20 0x7f41a41e31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a8f88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a41d2350 con 0x7f41a41e2d20 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a8f88640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a414b490 con 0x7f4190005180 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a8f88640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40bf6e0 con 0x7f41a41df7f0 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41a41e2d20 0x7f41a41e31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41a41e2d20 0x7f41a41e31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57024/0 (socket says 172.21.15.40:57024) 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 -- 172.21.15.40:0/1079499346 learned_addr learned my addr 172.21.15.40:0/1079499346 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f419bfff640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41a41df7f0 0x7f41a41dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a259c640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4190005180 0x7f41a41d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 -- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41a41df7f0 msgr2=0x7f41a41dfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41a41df7f0 0x7f41a41dfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 -- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4190005180 msgr2=0x7f41a41d1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4190005180 0x7f41a41d1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a2d9d640 1 -- 172.21.15.40:0/1079499346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a40c0380 con 0x7f41a41e2d20 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f41a259c640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4190005180 0x7f41a41d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.786+0000 7f419bfff640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41a41df7f0 0x7f41a41dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.787+0000 7f41a2d9d640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41a41e2d20 0x7f41a41e31a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f419c02c6d0 tx=0x7f419c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.787+0000 7f419affd640 1 -- 172.21.15.40:0/1079499346 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c003da0 con 0x7f41a41e2d20 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.787+0000 7f419affd640 1 -- 172.21.15.40:0/1079499346 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c035950 con 0x7f41a41e2d20 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.787+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a41e0190 con 0x7f41a41e2d20 2023-12-20T04:23:26.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.787+0000 7f419affd640 1 -- 172.21.15.40:0/1079499346 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c035d40 con 0x7f41a41e2d20 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.787+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a40bf370 con 0x7f41a41e2d20 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.788+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a40bf1d0 con 0x7f41a41e2d20 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.788+0000 7f419affd640 1 -- 172.21.15.40:0/1079499346 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f419c004030 con 0x7f41a41e2d20 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.789+0000 7f419affd640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f418406a430 0x7f418406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.789+0000 7f419affd640 1 -- 172.21.15.40:0/1079499346 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f419c0ab630 con 0x7f41a41e2d20 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.789+0000 7f41a259c640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f418406a430 0x7f418406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.789+0000 7f41a259c640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f418406a430 0x7f418406c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4194001050 tx=0x7f4194009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:26.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.793+0000 7f419affd640 1 -- 172.21.15.40:0/1079499346 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f41a40bf1d0 con 0x7f41a41e2d20 2023-12-20T04:23:26.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.971+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41a40bf890 con 0x7f41a41e2d20 2023-12-20T04:23:26.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.972+0000 7f419affd640 1 -- 172.21.15.40:0/1079499346 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16002 (secure 0 0 0) 0x7f41a40bf890 con 0x7f41a41e2d20 2023-12-20T04:23:26.973 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:26.973 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:26.641223+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f418406a430 msgr2=0x7f418406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f418406a430 0x7f418406c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4194001050 tx=0x7f4194009040 comp rx=0 tx=0).stop 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41a41e2d20 msgr2=0x7f41a41e31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41a41e2d20 0x7f41a41e31a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f419c02c6d0 tx=0x7f419c009750 comp rx=0 tx=0).stop 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 shutdown_connections 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f418406a430 0x7f418406c8f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41a41e2d20 0x7f41a41e31a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f41a41df7f0 0x7f41a41dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 --2- 172.21.15.40:0/1079499346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4190005180 0x7f41a41d1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:26.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 >> 172.21.15.40:0/1079499346 conn(0x7f41a4071e60 msgr2=0x7f41a4140950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 shutdown_connections 2023-12-20T04:23:26.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:26.974+0000 7f41a8f88640 1 -- 172.21.15.40:0/1079499346 wait complete. 2023-12-20T04:23:26.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.090+0000 7fc91390a640 1 Processor -- start 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.091+0000 7fc91390a640 1 -- start start 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.091+0000 7fc91390a640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc90c0ba700 0x7fc90c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.091+0000 7fc91390a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c14af90 con 0x7fc90c070ff0 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.091+0000 7fc91390a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90c071d10 con 0x7fc90c0ba0e0 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.091+0000 7fc91390a640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90c0b8630 con 0x7fc90c0ba700 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.091+0000 7fc9116a6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc90c070ff0 0x7fc90c0b7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52808/0 (socket says 172.21.15.40:52808) 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.091+0000 7fc9116a6640 1 -- 172.21.15.40:0/2446600057 learned_addr learned my addr 172.21.15.40:0/2446600057 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:27.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc911ea7640 1 --2- 172.21.15.40:0/2446600057 >> v2:172.21.15.69:3300/0 conn(0x7fc90c0ba700 0x7fc90c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625290030 0 0) 0x7fc90c14af90 con 0x7fc90c070ff0 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f8003520 con 0x7fc90c070ff0 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903613764 0 0) 0x7fc8f8003520 con 0x7fc90c070ff0 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 >> v2:172.21.15.69:3300/0 conn(0x7fc90c0ba700 msgr2=0x7fc90c14aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 --2- 172.21.15.40:0/2446600057 >> v2:172.21.15.69:3300/0 conn(0x7fc90c0ba700 0x7fc90c14aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 >> v1:172.21.15.69:6789/0 conn(0x7fc90c0ba0e0 legacy=0x7fc90c153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c071750 con 0x7fc90c070ff0 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7fc908001670 con 0x7fc90c070ff0 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 >> v1:172.21.15.40:6789/0 conn(0x7fc90c070ff0 legacy=0x7fc90c0b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8003970 0x7fc8f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8f80047c0 0x7fc8f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f8005180 0x7fc8f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c0b8630 con 0x7fc8f8005180 2023-12-20T04:23:27.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f800c120 con 0x7fc8f8003970 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f800c2e0 con 0x7fc8f80047c0 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc911ea7640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f8005180 0x7fc8f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc9116a6640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8003970 0x7fc8f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc910ea5640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8f80047c0 0x7fc8f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc911ea7640 1 -- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8f80047c0 msgr2=0x7fc8f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc911ea7640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8f80047c0 0x7fc8f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc911ea7640 1 -- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8003970 msgr2=0x7fc8f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc911ea7640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8003970 0x7fc8f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.092+0000 7fc911ea7640 1 -- 172.21.15.40:0/2446600057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f8003520 con 0x7fc8f8005180 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.093+0000 7fc911ea7640 1 -- 172.21.15.40:0/2446600057 reap_dead start 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.093+0000 7fc911ea7640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f8005180 0x7fc8f800b980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc904009f90 tx=0x7fc8f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28247e25471a122b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.093+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90402cc20 con 0x7fc8f8005180 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.093+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90400f040 con 0x7fc8f8005180 2023-12-20T04:23:27.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.093+0000 7fc903fff640 1 -- 172.21.15.40:0/2446600057 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904034440 con 0x7fc8f8005180 2023-12-20T04:23:27.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.094+0000 7fc91390a640 1 -- 172.21.15.40:0/2446600057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f8005180 msgr2=0x7fc8f800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.094+0000 7fc91390a640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f8005180 0x7fc8f800b980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc904009f90 tx=0x7fc8f80057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.094+0000 7fc91390a640 1 -- 172.21.15.40:0/2446600057 shutdown_connections 2023-12-20T04:23:27.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.094+0000 7fc91390a640 1 --2- 172.21.15.40:0/2446600057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8f8005180 0x7fc8f800b980 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.094+0000 7fc91390a640 1 -- 172.21.15.40:0/2446600057 >> 172.21.15.40:0/2446600057 conn(0x7fc90c0be120 msgr2=0x7fc90c0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:27.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.094+0000 7fc91390a640 1 -- 172.21.15.40:0/2446600057 shutdown_connections 2023-12-20T04:23:27.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.094+0000 7fc91390a640 1 -- 172.21.15.40:0/2446600057 wait complete. 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.095+0000 7fc91390a640 1 Processor -- start 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.095+0000 7fc91390a640 1 -- start start 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc91390a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8005180 0x7fc90c1d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc91390a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc90c1454c0 0x7fc90c1d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc91390a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc90c145940 0x7fc90c140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc91390a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c1d12a0 con 0x7fc90c145940 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc91390a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c1d2200 con 0x7fc8f8005180 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc91390a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90c147500 con 0x7fc90c1454c0 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc90c145940 0x7fc90c140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc90c145940 0x7fc90c140910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57040/0 (socket says 172.21.15.40:57040) 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 -- 172.21.15.40:0/1805305796 learned_addr learned my addr 172.21.15.40:0/1805305796 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc9116a6640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8005180 0x7fc90c1d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc910ea5640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc90c1454c0 0x7fc90c1d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 -- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc90c1454c0 msgr2=0x7fc90c1d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc90c1454c0 0x7fc90c1d2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 -- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8005180 msgr2=0x7fc90c1d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8005180 0x7fc90c1d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 -- 172.21.15.40:0/1805305796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c1d1bb0 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc911ea7640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc90c145940 0x7fc90c140910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc90402c690 tx=0x7fc904009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc901ffb640 1 -- 172.21.15.40:0/1805305796 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904035e60 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc901ffb640 1 -- 172.21.15.40:0/1805305796 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90403d3f0 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c1d1e90 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.096+0000 7fc901ffb640 1 -- 172.21.15.40:0/1805305796 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90403d7a0 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.097+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc90c1480a0 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.098+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90c04e840 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.098+0000 7fc901ffb640 1 -- 172.21.15.40:0/1805305796 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc90403b040 con 0x7fc90c145940 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.098+0000 7fc901ffb640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc8f006a430 0x7fc8f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.099+0000 7fc901ffb640 1 -- 172.21.15.40:0/1805305796 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9040aa530 con 0x7fc90c145940 2023-12-20T04:23:27.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.099+0000 7fc9116a6640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc8f006a430 0x7fc8f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.099+0000 7fc9116a6640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc8f006a430 0x7fc8f006c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc908000f60 tx=0x7fc908000ef0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:27.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.103+0000 7fc901ffb640 1 -- 172.21.15.40:0/1805305796 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc904075c60 con 0x7fc90c145940 2023-12-20T04:23:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.279+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc90c1d2020 con 0x7fc90c145940 2023-12-20T04:23:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.280+0000 7fc901ffb640 1 -- 172.21.15.40:0/1805305796 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16002 (secure 0 0 0) 0x7fc904079280 con 0x7fc90c145940 2023-12-20T04:23:27.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:26.641223+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.282+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc8f006a430 msgr2=0x7fc8f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.282+0000 7fc91390a640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc8f006a430 0x7fc8f006c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc908000f60 tx=0x7fc908000ef0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.282+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc90c145940 msgr2=0x7fc90c140910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.282+0000 7fc91390a640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc90c145940 0x7fc90c140910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc90402c690 tx=0x7fc904009750 comp rx=0 tx=0).stop 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.282+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 shutdown_connections 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.282+0000 7fc91390a640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc8f006a430 0x7fc8f006c8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.282+0000 7fc91390a640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc90c145940 0x7fc90c140910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.283+0000 7fc91390a640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc90c1454c0 0x7fc90c1d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.283+0000 7fc91390a640 1 --2- 172.21.15.40:0/1805305796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f8005180 0x7fc90c1d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.283+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 >> 172.21.15.40:0/1805305796 conn(0x7fc90c0be120 msgr2=0x7fc90c0bd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.283+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 shutdown_connections 2023-12-20T04:23:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.283+0000 7fc91390a640 1 -- 172.21.15.40:0/1805305796 wait complete. 2023-12-20T04:23:27.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:23:27.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.402+0000 7fb0892bd640 1 Processor -- start 2023-12-20T04:23:27.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.402+0000 7fb0892bd640 1 -- start start 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0892bd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb0840bb140 0x7fb0840be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0892bd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb0840bf510 0x7fb0840bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0892bd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840bfa50 con 0x7fb08406a950 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0892bd640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0840bbda0 con 0x7fb0840bf510 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0892bd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08406b040 con 0x7fb0840bb140 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0827fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb08406a950 0x7fb0840bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52812/0 (socket says 172.21.15.40:52812) 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0827fc640 1 -- 172.21.15.40:0/2116689103 learned_addr learned my addr 172.21.15.40:0/2116689103 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:27.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb082ffd640 1 --2- 172.21.15.40:0/2116689103 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb0840bb140 0x7fb0840be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0837fe640 1 --2- 172.21.15.40:0/2116689103 >> v2:172.21.15.69:3300/0 conn(0x7fb0840bf510 0x7fb0840bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb081ffb640 1 -- 172.21.15.40:0/2116689103 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513688203 0 0) 0x7fb0840bfa50 con 0x7fb08406a950 2023-12-20T04:23:27.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb081ffb640 1 -- 172.21.15.40:0/2116689103 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb070003520 con 0x7fb08406a950 2023-12-20T04:23:27.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb082ffd640 1 -- 172.21.15.40:0/2116689103 >> v2:172.21.15.69:3300/0 conn(0x7fb0840bf510 msgr2=0x7fb0840bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:27.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb082ffd640 1 --2- 172.21.15.40:0/2116689103 >> v2:172.21.15.69:3300/0 conn(0x7fb0840bf510 0x7fb0840bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb082ffd640 1 -- 172.21.15.40:0/2116689103 >> v1:172.21.15.40:6789/0 conn(0x7fb08406a950 legacy=0x7fb0840bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb082ffd640 1 -- 172.21.15.40:0/2116689103 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840bb520 con 0x7fb0840bb140 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.403+0000 7fb0837fe640 1 --2- 172.21.15.40:0/2116689103 >> v2:172.21.15.69:3300/0 conn(0x7fb0840bf510 0x7fb0840bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.404+0000 7fb082ffd640 1 --2- 172.21.15.40:0/2116689103 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb0840bb140 0x7fb0840be350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0097a0 tx=0x7fb07c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee230bd2c531e8c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.404+0000 7fb081ffb640 1 -- 172.21.15.40:0/2116689103 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c02e070 con 0x7fb0840bb140 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.404+0000 7fb081ffb640 1 -- 172.21.15.40:0/2116689103 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0315a0 con 0x7fb0840bb140 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.404+0000 7fb081ffb640 1 -- 172.21.15.40:0/2116689103 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c031910 con 0x7fb0840bb140 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 -- 172.21.15.40:0/2116689103 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb0840bb140 msgr2=0x7fb0840be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2116689103 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb0840bb140 0x7fb0840be350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0097a0 tx=0x7fb07c02b840 comp rx=0 tx=0).stop 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 -- 172.21.15.40:0/2116689103 shutdown_connections 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2116689103 >> v2:172.21.15.69:3300/0 conn(0x7fb0840bf510 0x7fb0840bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2116689103 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb0840bb140 0x7fb0840be350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 -- 172.21.15.40:0/2116689103 >> 172.21.15.40:0/2116689103 conn(0x7fb0840bcfd0 msgr2=0x7fb0840bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 -- 172.21.15.40:0/2116689103 shutdown_connections 2023-12-20T04:23:27.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.405+0000 7fb0892bd640 1 -- 172.21.15.40:0/2116689103 wait complete. 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.406+0000 7fb0892bd640 1 Processor -- start 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.406+0000 7fb0892bd640 1 -- start start 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0892bd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb08406a950 0x7fb0840a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0892bd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0840bb140 0x7fb08409a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0892bd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0840bf510 0x7fb0840b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0892bd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0840a2bb0 con 0x7fb0840bb140 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0892bd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08409a2d0 con 0x7fb0840bf510 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0892bd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08409b2e0 con 0x7fb08406a950 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0840bb140 0x7fb08409a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0840bb140 0x7fb08409a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57054/0 (socket says 172.21.15.40:57054) 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 -- 172.21.15.40:0/2416775826 learned_addr learned my addr 172.21.15.40:0/2416775826 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb082ffd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb08406a950 0x7fb0840a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0837fe640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0840bf510 0x7fb0840b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 -- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb08406a950 msgr2=0x7fb0840a2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb08406a950 0x7fb0840a2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 -- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0840bf510 msgr2=0x7fb0840b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0840bf510 0x7fb0840b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 -- 172.21.15.40:0/2416775826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009a70 con 0x7fb0840bb140 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0837fe640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0840bf510 0x7fb0840b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0827fc640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0840bb140 0x7fb08409a880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c410 tx=0x7fb06c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb07b7fe640 1 -- 172.21.15.40:0/2416775826 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c005ce0 con 0x7fb0840bb140 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb07b7fe640 1 -- 172.21.15.40:0/2416775826 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c005e40 con 0x7fb0840bb140 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c009400 con 0x7fb0840bb140 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.407+0000 7fb07b7fe640 1 -- 172.21.15.40:0/2416775826 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0072f0 con 0x7fb0840bb140 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.408+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb084099d10 con 0x7fb0840bb140 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.409+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0840740a0 con 0x7fb0840bb140 2023-12-20T04:23:27.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.409+0000 7fb07b7fe640 1 -- 172.21.15.40:0/2416775826 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb06c007450 con 0x7fb0840bb140 2023-12-20T04:23:27.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.409+0000 7fb07b7fe640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb06406a460 0x7fb06406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:27.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.409+0000 7fb07b7fe640 1 -- 172.21.15.40:0/2416775826 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb06c087ed0 con 0x7fb0840bb140 2023-12-20T04:23:27.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.409+0000 7fb082ffd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb06406a460 0x7fb06406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:27.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.410+0000 7fb082ffd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb06406a460 0x7fb06406c920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb07c036000 tx=0x7fb07c03d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:27.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.414+0000 7fb07b7fe640 1 -- 172.21.15.40:0/2416775826 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb06c0570a0 con 0x7fb0840bb140 2023-12-20T04:23:27.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:27.626+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb0840ba4a0 con 0x7fb0840bb140 2023-12-20T04:23:28.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.287+0000 7fb07b7fe640 1 -- 172.21.15.40:0/2416775826 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb06c056c30 con 0x7fb0840bb140 2023-12-20T04:23:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb06406a460 msgr2=0x7fb06406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb06406a460 0x7fb06406c920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb07c036000 tx=0x7fb07c03d040 comp rx=0 tx=0).stop 2023-12-20T04:23:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0840bb140 msgr2=0x7fb08409a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0840bb140 0x7fb08409a880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb06c00c410 tx=0x7fb06c00c8d0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 shutdown_connections 2023-12-20T04:23:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb06406a460 0x7fb06406c920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0840bf510 0x7fb0840b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0840bb140 0x7fb08409a880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 --2- 172.21.15.40:0/2416775826 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb08406a950 0x7fb0840a2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 >> 172.21.15.40:0/2416775826 conn(0x7fb0840bcfd0 msgr2=0x7fb0840a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 shutdown_connections 2023-12-20T04:23:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.290+0000 7fb0892bd640 1 -- 172.21.15.40:0/2416775826 wait complete. 2023-12-20T04:23:28.304 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:23:28.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:23:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.418+0000 7f6e85916640 1 Processor -- start 2023-12-20T04:23:28.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.418+0000 7f6e85916640 1 -- start start 2023-12-20T04:23:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e85916640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bf510 0x7f6e800be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e85916640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6e8006a950 0x7f6e800bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e85916640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e800bfa50 con 0x7f6e800bb140 2023-12-20T04:23:28.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e85916640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e800bbda0 con 0x7f6e8006a950 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e85916640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8006b040 con 0x7f6e800bf510 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e800bb140 0x7f6e800bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52822/0 (socket says 172.21.15.40:52822) 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7effd640 1 -- 172.21.15.40:0/3406920440 learned_addr learned my addr 172.21.15.40:0/3406920440 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e77fff640 1 --2- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bf510 0x7f6e800be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7f7fe640 1 --2- 172.21.15.40:0/3406920440 >> v2:172.21.15.69:3300/0 conn(0x7f6e8006a950 0x7f6e800bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7e7fc640 1 -- 172.21.15.40:0/3406920440 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645711738 0 0) 0x7f6e800bfa50 con 0x7f6e800bb140 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7e7fc640 1 -- 172.21.15.40:0/3406920440 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e6c003520 con 0x7f6e800bb140 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7e7fc640 1 -- 172.21.15.40:0/3406920440 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1563996522 0 0) 0x7f6e6c003520 con 0x7f6e800bb140 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7f7fe640 1 -- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bf510 msgr2=0x7f6e800be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7f7fe640 1 --2- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bf510 0x7f6e800be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7f7fe640 1 -- 172.21.15.40:0/3406920440 >> v1:172.21.15.40:6789/0 conn(0x7f6e800bb140 legacy=0x7f6e800bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:28.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e7f7fe640 1 -- 172.21.15.40:0/3406920440 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e800bb520 con 0x7f6e8006a950 2023-12-20T04:23:28.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.419+0000 7f6e77fff640 1 --2- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bf510 0x7f6e800be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:28.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.420+0000 7f6e7f7fe640 1 --2- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e8006a950 0x7f6e800bfee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009d90 tx=0x7f6e7802bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab058183411d3dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.420+0000 7f6e7e7fc640 1 -- 172.21.15.40:0/3406920440 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70001670 con 0x7f6e8006a950 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.420+0000 7f6e7e7fc640 1 -- 172.21.15.40:0/3406920440 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7802c810 con 0x7f6e8006a950 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.420+0000 7f6e7e7fc640 1 -- 172.21.15.40:0/3406920440 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7802cb80 con 0x7f6e8006a950 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 -- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e8006a950 msgr2=0x7f6e800bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 --2- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e8006a950 0x7f6e800bfee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009d90 tx=0x7f6e7802bce0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 -- 172.21.15.40:0/3406920440 shutdown_connections 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 --2- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e8006a950 0x7f6e800bfee0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 --2- 172.21.15.40:0/3406920440 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bf510 0x7f6e800be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 -- 172.21.15.40:0/3406920440 >> 172.21.15.40:0/3406920440 conn(0x7f6e800bcfd0 msgr2=0x7f6e800bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 -- 172.21.15.40:0/3406920440 shutdown_connections 2023-12-20T04:23:28.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.421+0000 7f6e85916640 1 -- 172.21.15.40:0/3406920440 wait complete. 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.422+0000 7f6e85916640 1 Processor -- start 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.422+0000 7f6e85916640 1 -- start start 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e8006a950 0x7f6e80149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bb140 0x7f6e80142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e800bf510 0x7f6e801dfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801e0190 con 0x7f6e8006a950 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800b3950 con 0x7f6e800bf510 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8014a870 con 0x7f6e800bb140 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e8006a950 0x7f6e80149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e8006a950 0x7f6e80149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57060/0 (socket says 172.21.15.40:57060) 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 -- 172.21.15.40:0/2583403816 learned_addr learned my addr 172.21.15.40:0/2583403816 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7f7fe640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e800bf510 0x7f6e801dfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e77fff640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bb140 0x7f6e80142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:28.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 -- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bb140 msgr2=0x7f6e80142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bb140 0x7f6e80142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 -- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e800bf510 msgr2=0x7f6e801dfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e800bf510 0x7f6e801dfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 -- 172.21.15.40:0/2583403816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009400 con 0x7f6e8006a950 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7f7fe640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e800bf510 0x7f6e801dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7effd640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e8006a950 0x7f6e80149480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c780 tx=0x7f6e7000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7cff9640 1 -- 172.21.15.40:0/2583403816 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70005ad0 con 0x7f6e8006a950 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7cff9640 1 -- 172.21.15.40:0/2583403816 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e70005c30 con 0x7f6e8006a950 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e78009a70 con 0x7f6e8006a950 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e7cff9640 1 -- 172.21.15.40:0/2583403816 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70007070 con 0x7f6e8006a950 2023-12-20T04:23:28.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.423+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e80142440 con 0x7f6e8006a950 2023-12-20T04:23:28.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.424+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e80141fc0 con 0x7f6e8006a950 2023-12-20T04:23:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.425+0000 7f6e7cff9640 1 -- 172.21.15.40:0/2583403816 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e700071d0 con 0x7f6e8006a950 2023-12-20T04:23:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.425+0000 7f6e7cff9640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e6006a430 0x7f6e6006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.425+0000 7f6e7cff9640 1 -- 172.21.15.40:0/2583403816 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e70088520 con 0x7f6e8006a950 2023-12-20T04:23:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.425+0000 7f6e77fff640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e6006a430 0x7f6e6006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:28.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.426+0000 7f6e77fff640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e6006a430 0x7f6e6006c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e800be710 tx=0x7f6e68008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:28.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.429+0000 7f6e7cff9640 1 -- 172.21.15.40:0/2583403816 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6e80141fc0 con 0x7f6e8006a950 2023-12-20T04:23:28.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:28.644+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6e80141fc0 con 0x7f6e8006a950 2023-12-20T04:23:29.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.292+0000 7f6e7cff9640 1 -- 172.21.15.40:0/2583403816 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6e80141fc0 con 0x7f6e8006a950 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e6006a430 msgr2=0x7f6e6006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e6006a430 0x7f6e6006c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e800be710 tx=0x7f6e68008040 comp rx=0 tx=0).stop 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e8006a950 msgr2=0x7f6e80149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e8006a950 0x7f6e80149480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000c780 tx=0x7f6e7000cc40 comp rx=0 tx=0).stop 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 shutdown_connections 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e6006a430 0x7f6e6006c8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e800bf510 0x7f6e801dfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e800bb140 0x7f6e80142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 --2- 172.21.15.40:0/2583403816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e8006a950 0x7f6e80149480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 >> 172.21.15.40:0/2583403816 conn(0x7f6e800bcfd0 msgr2=0x7f6e800a48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:29.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 shutdown_connections 2023-12-20T04:23:29.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.295+0000 7f6e85916640 1 -- 172.21.15.40:0/2583403816 wait complete. 2023-12-20T04:23:29.309 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:23:29.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.420+0000 7f5ca2318640 1 Processor -- start 2023-12-20T04:23:29.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.420+0000 7f5ca2318640 1 -- start start 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5ca2318640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 0x7f5c9c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5ca2318640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c0711c0 con 0x7f5c9c06af20 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5ca2318640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c070370 con 0x7f5c9c0b3a30 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5ca2318640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b4110 con 0x7f5c9c141c60 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5c9bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5c9c06af20 0x7f5c9c1477d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52830/0 (socket says 172.21.15.40:52830) 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5c9bfff640 1 -- 172.21.15.40:0/1489108270 learned_addr learned my addr 172.21.15.40:0/1489108270 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 0x7f5c9c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002454108 0 0) 0x7f5c9c0711c0 con 0x7f5c9c06af20 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.421+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c84003520 con 0x7f5c9c06af20 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148796268 0 0) 0x7f5c84003520 con 0x7f5c9c06af20 2023-12-20T04:23:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 msgr2=0x7f5c9c06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 0x7f5c9c06fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 >> v1:172.21.15.69:6789/0 conn(0x7f5c9c0b3a30 legacy=0x7f5c9c141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c070b70 con 0x7f5c9c06af20 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f5c90001670 con 0x7f5c9c06af20 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 >> v1:172.21.15.40:6789/0 conn(0x7f5c9c06af20 legacy=0x7f5c9c1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 0x7f5c840039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c84003ee0 0x7f5c840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c84004d00 0x7f5c84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8400b9b0 con 0x7f5c84004d00 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8400bb20 con 0x7f5c84003ee0 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8400bce0 con 0x7f5c9c141c60 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c84004d00 0x7f5c84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9bfff640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 0x7f5c840039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5c9b7fe640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c84003ee0 0x7f5c840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 msgr2=0x7f5c840039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c141c60 0x7f5c840039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c84003ee0 msgr2=0x7f5c840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c84003ee0 0x7f5c840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.422+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1489108270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c84003520 con 0x7f5c84004d00 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.423+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c84004d00 0x7f5c84005180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009fc0 tx=0x7f5c840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c5c0c4d4d0e904 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.423+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9402cc20 con 0x7f5c84004d00 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.423+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9400f040 con 0x7f5c84004d00 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.423+0000 7f5c9affd640 1 -- 172.21.15.40:0/1489108270 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94034440 con 0x7f5c84004d00 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.424+0000 7f5ca2318640 1 -- 172.21.15.40:0/1489108270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c84004d00 msgr2=0x7f5c84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.424+0000 7f5ca2318640 1 --2- 172.21.15.40:0/1489108270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c84004d00 0x7f5c84005180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009fc0 tx=0x7f5c840057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.424+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1489108270 reap_dead start 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.424+0000 7f5ca2318640 1 -- 172.21.15.40:0/1489108270 shutdown_connections 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.424+0000 7f5ca2318640 1 -- 172.21.15.40:0/1489108270 >> 172.21.15.40:0/1489108270 conn(0x7f5c9c0bcf60 msgr2=0x7f5c9c0bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.424+0000 7f5ca2318640 1 -- 172.21.15.40:0/1489108270 shutdown_connections 2023-12-20T04:23:29.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.424+0000 7f5ca2318640 1 -- 172.21.15.40:0/1489108270 wait complete. 2023-12-20T04:23:29.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.425+0000 7f5ca2318640 1 Processor -- start 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.425+0000 7f5ca2318640 1 -- start start 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c0b7a10 0x7f5c9c0b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c9c1470c0 0x7f5c9c1cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c9c1cf320 0x7f5c9c146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b8650 con 0x7f5c9c1cf320 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c1d0a50 con 0x7f5c9c1470c0 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c1cf7a0 con 0x7f5c9c0b7a10 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c9c1cf320 0x7f5c9c146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c9c1cf320 0x7f5c9c146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57080/0 (socket says 172.21.15.40:57080) 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1246797469 learned_addr learned my addr 172.21.15.40:0/1246797469 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5c9bfff640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c0b7a10 0x7f5c9c0b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5c9b7fe640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c9c1470c0 0x7f5c9c1cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c0b7a10 msgr2=0x7f5c9c0b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c0b7a10 0x7f5c9c0b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c9c1470c0 msgr2=0x7f5c9c1cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c9c1470c0 0x7f5c9c1cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 -- 172.21.15.40:0/1246797469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c1d0720 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca08b5640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c9c1cf320 0x7f5c9c146080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c94037040 tx=0x7f5c94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5c98ff9640 1 -- 172.21.15.40:0/1246797469 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94034d50 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5c98ff9640 1 -- 172.21.15.40:0/1246797469 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c94003990 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9c147520 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5c98ff9640 1 -- 172.21.15.40:0/1246797469 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c94003d40 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.426+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c145c10 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.427+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c1d08b0 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.428+0000 7f5c98ff9640 1 -- 172.21.15.40:0/1246797469 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c94004030 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.428+0000 7f5c98ff9640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5c8806a430 0x7f5c8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.428+0000 7f5c98ff9640 1 -- 172.21.15.40:0/1246797469 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c940aa020 con 0x7f5c9c1cf320 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.428+0000 7f5c9bfff640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5c8806a430 0x7f5c8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.429+0000 7f5c9bfff640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5c8806a430 0x7f5c8806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c90004840 tx=0x7f5c90000bc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:29.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.433+0000 7f5c98ff9640 1 -- 172.21.15.40:0/1246797469 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5c9c1d08b0 con 0x7f5c9c1cf320 2023-12-20T04:23:29.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.644+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c9c1d08b0 con 0x7f5c9c1cf320 2023-12-20T04:23:29.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.644+0000 7f5c98ff9640 1 -- 172.21.15.40:0/1246797469 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7f5c9c1d08b0 con 0x7f5c9c1cf320 2023-12-20T04:23:29.645 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:29.645 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:29.646 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:29.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5c8806a430 msgr2=0x7f5c8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5c8806a430 0x7f5c8806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c90004840 tx=0x7f5c90000bc0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c9c1cf320 msgr2=0x7f5c9c146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c9c1cf320 0x7f5c9c146080 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5c94037040 tx=0x7f5c94009750 comp rx=0 tx=0).stop 2023-12-20T04:23:29.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 shutdown_connections 2023-12-20T04:23:29.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5c8806a430 0x7f5c8806c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5c9c1cf320 0x7f5c9c146080 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c9c1470c0 0x7f5c9c1cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 --2- 172.21.15.40:0/1246797469 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5c9c0b7a10 0x7f5c9c0b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 >> 172.21.15.40:0/1246797469 conn(0x7f5c9c0bcf60 msgr2=0x7f5c9c147da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:29.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 shutdown_connections 2023-12-20T04:23:29.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.646+0000 7f5ca2318640 1 -- 172.21.15.40:0/1246797469 wait complete. 2023-12-20T04:23:29.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:29.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.762+0000 7fbf1e2c4640 1 Processor -- start 2023-12-20T04:23:29.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.762+0000 7fbf1e2c4640 1 -- start start 2023-12-20T04:23:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf1e2c4640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf180b6690 0x7fbf18144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf1e2c4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf18144cd0 0x7fbf18155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf1e2c4640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf180bc6b0 con 0x7fbf180bcdd0 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf1e2c4640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf180a59f0 con 0x7fbf180b6690 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf1e2c4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180bc0a0 con 0x7fbf18144cd0 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf177fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf180b6690 0x7fbf18144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf1c861640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf18144cd0 0x7fbf18155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf177fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf180b6690 0x7fbf18144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35770/0 (socket says 172.21.15.40:35770) 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf1c861640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf18144cd0 0x7fbf18155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54420/0 (socket says 172.21.15.40:54420) 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf177fe640 1 -- 172.21.15.40:0/3457368159 learned_addr learned my addr 172.21.15.40:0/3457368159 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.763+0000 7fbf17fff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbf180bcdd0 0x7fbf180b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43852/0 (socket says 172.21.15.40:43852) 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.764+0000 7fbf16ffd640 1 -- 172.21.15.40:0/3457368159 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131564211 0 0) 0x7fbf180bc6b0 con 0x7fbf180bcdd0 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.764+0000 7fbf1c861640 1 -- 172.21.15.40:0/3457368159 >> v2:172.21.15.69:3300/0 conn(0x7fbf180b6690 msgr2=0x7fbf18144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.764+0000 7fbf1c861640 1 --2- 172.21.15.40:0/3457368159 >> v2:172.21.15.69:3300/0 conn(0x7fbf180b6690 0x7fbf18144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.764+0000 7fbf1c861640 1 -- 172.21.15.40:0/3457368159 >> v1:172.21.15.69:6789/0 conn(0x7fbf180bcdd0 legacy=0x7fbf180b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.764+0000 7fbf1c861640 1 -- 172.21.15.40:0/3457368159 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180bc340 con 0x7fbf18144cd0 2023-12-20T04:23:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.764+0000 7fbf177fe640 1 --2- 172.21.15.40:0/3457368159 >> v2:172.21.15.69:3300/0 conn(0x7fbf180b6690 0x7fbf18144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.764+0000 7fbf1c861640 1 --2- 172.21.15.40:0/3457368159 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf18144cd0 0x7fbf18155340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009d90 tx=0x7fbf1002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7563016798822d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf16ffd640 1 -- 172.21.15.40:0/3457368159 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1002cce0 con 0x7fbf18144cd0 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf16ffd640 1 -- 172.21.15.40:0/3457368159 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1002ce40 con 0x7fbf18144cd0 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf16ffd640 1 -- 172.21.15.40:0/3457368159 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10034660 con 0x7fbf18144cd0 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/3457368159 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf18144cd0 msgr2=0x7fbf18155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/3457368159 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf18144cd0 0x7fbf18155340 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009d90 tx=0x7fbf1002bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/3457368159 shutdown_connections 2023-12-20T04:23:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/3457368159 >> v2:172.21.15.69:3300/0 conn(0x7fbf180b6690 0x7fbf18144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/3457368159 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf18144cd0 0x7fbf18155340 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/3457368159 >> 172.21.15.40:0/3457368159 conn(0x7fbf18071e60 msgr2=0x7fbf180c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/3457368159 shutdown_connections 2023-12-20T04:23:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.765+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/3457368159 wait complete. 2023-12-20T04:23:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.766+0000 7fbf1e2c4640 1 Processor -- start 2023-12-20T04:23:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.766+0000 7fbf1e2c4640 1 -- start start 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf1e2c4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf180b6690 0x7fbf180bf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf1e2c4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf180bcdd0 0x7fbf1814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf1e2c4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf18144cd0 0x7fbf181d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf1e2c4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1814ba30 con 0x7fbf180b6690 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf1e2c4640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180bf880 con 0x7fbf18144cd0 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf1e2c4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf181d2dc0 con 0x7fbf180bcdd0 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf180b6690 0x7fbf180bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf180b6690 0x7fbf180bf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57092/0 (socket says 172.21.15.40:57092) 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 -- 172.21.15.40:0/894180684 learned_addr learned my addr 172.21.15.40:0/894180684 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf177fe640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf180bcdd0 0x7fbf1814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf1c861640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf18144cd0 0x7fbf181d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 -- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf180bcdd0 msgr2=0x7fbf1814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf180bcdd0 0x7fbf1814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 -- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf18144cd0 msgr2=0x7fbf181d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf18144cd0 0x7fbf181d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.767+0000 7fbf17fff640 1 -- 172.21.15.40:0/894180684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf080094d0 con 0x7fbf180b6690 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf177fe640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf180bcdd0 0x7fbf1814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf1c861640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf18144cd0 0x7fbf181d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf17fff640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf180b6690 0x7fbf180bf340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c4d0 tx=0x7fbf0c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf14ff9640 1 -- 172.21.15.40:0/894180684 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0074e0 con 0x7fbf180b6690 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf14ff9640 1 -- 172.21.15.40:0/894180684 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c007660 con 0x7fbf180b6690 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf14ff9640 1 -- 172.21.15.40:0/894180684 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c004a20 con 0x7fbf180b6690 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf10009a70 con 0x7fbf180b6690 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.768+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf181d4a70 con 0x7fbf180b6690 2023-12-20T04:23:29.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.769+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1804e840 con 0x7fbf180b6690 2023-12-20T04:23:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.770+0000 7fbf14ff9640 1 -- 172.21.15.40:0/894180684 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf0c004b80 con 0x7fbf180b6690 2023-12-20T04:23:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.770+0000 7fbf14ff9640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf0406a430 0x7fbf0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.770+0000 7fbf14ff9640 1 -- 172.21.15.40:0/894180684 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c087ad0 con 0x7fbf180b6690 2023-12-20T04:23:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.770+0000 7fbf177fe640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf0406a430 0x7fbf0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:29.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.771+0000 7fbf177fe640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf0406a430 0x7fbf0406c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf180bb280 tx=0x7fbf08008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:29.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.774+0000 7fbf14ff9640 1 -- 172.21.15.40:0/894180684 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbf0c0530d0 con 0x7fbf180b6690 2023-12-20T04:23:29.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.950+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf180b87b0 con 0x7fbf180b6690 2023-12-20T04:23:29.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.951+0000 7fbf14ff9640 1 -- 172.21.15.40:0/894180684 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fbf0c0566f0 con 0x7fbf180b6690 2023-12-20T04:23:29.952 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:29.953 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:29.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf0406a430 msgr2=0x7fbf0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf0406a430 0x7fbf0406c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf180bb280 tx=0x7fbf08008040 comp rx=0 tx=0).stop 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf180b6690 msgr2=0x7fbf180bf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf180b6690 0x7fbf180bf340 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00c4d0 tx=0x7fbf0c00c990 comp rx=0 tx=0).stop 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 shutdown_connections 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf0406a430 0x7fbf0406c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf18144cd0 0x7fbf181d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf180bcdd0 0x7fbf1814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 --2- 172.21.15.40:0/894180684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf180b6690 0x7fbf180bf340 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 >> 172.21.15.40:0/894180684 conn(0x7fbf18071e60 msgr2=0x7fbf181416d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 shutdown_connections 2023-12-20T04:23:29.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:29.953+0000 7fbf1e2c4640 1 -- 172.21.15.40:0/894180684 wait complete. 2023-12-20T04:23:29.965 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:23:29.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:23:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.070+0000 7f7da3041640 1 Processor -- start 2023-12-20T04:23:30.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.070+0000 7f7da3041640 1 -- start start 2023-12-20T04:23:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7da3041640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d9c0b6690 0x7f7d9c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7da3041640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0bc6b0 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7da3041640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0a59f0 con 0x7f7d9c144cd0 2023-12-20T04:23:30.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7da3041640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c0bc0a0 con 0x7f7d9c0b6690 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7d9bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d9c0b6690 0x7f7d9c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7da0ddd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7d9c0bcdd0 0x7f7d9c0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52832/0 (socket says 172.21.15.40:52832) 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7da0ddd640 1 -- 172.21.15.40:0/1060534704 learned_addr learned my addr 172.21.15.40:0/1060534704 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7d9bfff640 1 -- 172.21.15.40:0/1060534704 >> v1:172.21.15.69:6789/0 conn(0x7f7d9c144cd0 legacy=0x7f7d9c155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7d9bfff640 1 -- 172.21.15.40:0/1060534704 >> v1:172.21.15.40:6789/0 conn(0x7f7d9c0bcdd0 legacy=0x7f7d9c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7d9b7fe640 1 -- 172.21.15.40:0/1060534704 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776441676 0 0) 0x7f7d9c0bc6b0 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.071+0000 7f7d9bfff640 1 -- 172.21.15.40:0/1060534704 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c0bc340 con 0x7f7d9c0b6690 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7d9bfff640 1 --2- 172.21.15.40:0/1060534704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0b6690 0x7f7d9c144790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0a5b80 tx=0x7f7d8802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31515f48e573b0f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7d9b7fe640 1 -- 172.21.15.40:0/1060534704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88030610 con 0x7f7d9c0b6690 2023-12-20T04:23:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7d9b7fe640 1 -- 172.21.15.40:0/1060534704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d88030770 con 0x7f7d9c0b6690 2023-12-20T04:23:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7d9b7fe640 1 -- 172.21.15.40:0/1060534704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88030b00 con 0x7f7d9c0b6690 2023-12-20T04:23:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7da3041640 1 -- 172.21.15.40:0/1060534704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0b6690 msgr2=0x7f7d9c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7da3041640 1 --2- 172.21.15.40:0/1060534704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0b6690 0x7f7d9c144790 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0a5b80 tx=0x7f7d8802b960 comp rx=0 tx=0).stop 2023-12-20T04:23:30.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7da3041640 1 -- 172.21.15.40:0/1060534704 shutdown_connections 2023-12-20T04:23:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.072+0000 7f7da3041640 1 --2- 172.21.15.40:0/1060534704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0b6690 0x7f7d9c144790 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.073+0000 7f7da3041640 1 -- 172.21.15.40:0/1060534704 >> 172.21.15.40:0/1060534704 conn(0x7f7d9c071e60 msgr2=0x7f7d9c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.073+0000 7f7da3041640 1 -- 172.21.15.40:0/1060534704 shutdown_connections 2023-12-20T04:23:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.073+0000 7f7da3041640 1 -- 172.21.15.40:0/1060534704 wait complete. 2023-12-20T04:23:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 Processor -- start 2023-12-20T04:23:30.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 -- start start 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7d9c0b6690 0x7f7d9c148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0bcdd0 0x7f7d9c14ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c144cd0 0x7f7d9c13e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c13e930 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c14a8b0 con 0x7f7d9c144cd0 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7da3041640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c145f90 con 0x7f7d9c0b6690 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0bcdd0 0x7f7d9c14ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7d9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0bcdd0 0x7f7d9c14ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57104/0 (socket says 172.21.15.40:57104) 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.074+0000 7f7d9bfff640 1 -- 172.21.15.40:0/1915695026 learned_addr learned my addr 172.21.15.40:0/1915695026 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7da15de640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c144cd0 0x7f7d9c13e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7da0ddd640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7d9c0b6690 0x7f7d9c148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d9bfff640 1 -- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7d9c0b6690 msgr2=0x7f7d9c148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d9bfff640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7d9c0b6690 0x7f7d9c148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d9bfff640 1 -- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c144cd0 msgr2=0x7f7d9c13e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d9bfff640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c144cd0 0x7f7d9c13e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d9bfff640 1 -- 172.21.15.40:0/1915695026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88009400 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d9bfff640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0bcdd0 0x7f7d9c14ad40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009890 tx=0x7f7d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d997fa640 1 -- 172.21.15.40:0/1915695026 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88039c90 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d997fa640 1 -- 172.21.15.40:0/1915695026 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8803f040 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c146d30 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7d997fa640 1 -- 172.21.15.40:0/1915695026 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d88006e10 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.075+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c14a540 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.076+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c14a3a0 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.077+0000 7f7d997fa640 1 -- 172.21.15.40:0/1915695026 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d88004030 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.077+0000 7f7d997fa640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7d8006a460 0x7f7d8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.077+0000 7f7d997fa640 1 -- 172.21.15.40:0/1915695026 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d880aa950 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.077+0000 7f7da0ddd640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7d8006a460 0x7f7d8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.078+0000 7f7da0ddd640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7d8006a460 0x7f7d8006c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000f60 tx=0x7f7d90007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.081+0000 7f7d997fa640 1 -- 172.21.15.40:0/1915695026 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7d9c14a3a0 con 0x7f7d9c0bcdd0 2023-12-20T04:23:30.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.254+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d9c0bd1b0 con 0x7f7d8006a460 2023-12-20T04:23:30.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.262+0000 7f7d997fa640 1 -- 172.21.15.40:0/1915695026 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249806 (secure 0 0 0) 0x7f7d90004c70 con 0x7f7d8006a460 2023-12-20T04:23:30.265 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:30.266 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.264+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7d8006a460 msgr2=0x7f7d8006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.264+0000 7f7da3041640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7d8006a460 0x7f7d8006c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000f60 tx=0x7f7d90007d50 comp rx=0 tx=0).stop 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.264+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0bcdd0 msgr2=0x7f7d9c14ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.264+0000 7f7da3041640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0bcdd0 0x7f7d9c14ad40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009890 tx=0x7f7d880046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 shutdown_connections 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7d8006a460 0x7f7d8006c920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d9c144cd0 0x7f7d9c13e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d9c0bcdd0 0x7f7d9c14ad40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 --2- 172.21.15.40:0/1915695026 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7d9c0b6690 0x7f7d9c148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 >> 172.21.15.40:0/1915695026 conn(0x7f7d9c071e60 msgr2=0x7f7d9c0b8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:30.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 shutdown_connections 2023-12-20T04:23:30.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.265+0000 7f7da3041640 1 -- 172.21.15.40:0/1915695026 wait complete. 2023-12-20T04:23:30.276 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-20T04:23:28.527006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219180,"kb_used_data":2376,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755540,"statfs":{"total":773094113280,"available":772869672960,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000881"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-20T04:23:17.466729+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:23:17.466729+0000","last_peered":"2023-12-20T04:23:17.466729+0000","last_clean":"2023-12-20T04:23:17.466729+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:23:17.466729+0000","last_undegraded":"2023-12-20T04:23:17.466729+0000","last_fullsized":"2023-12-20T04:23:17.466729+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:26.263750+0000","last_change":"2023-12-20T04:23:26.263750+0000","last_active":"2023-12-20T04:23:26.263750+0000","last_peered":"2023-12-20T04:23:26.263750+0000","last_clean":"2023-12-20T04:23:26.263750+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:26.263750+0000","last_undegraded":"2023-12-20T04:23:26.263750+0000","last_fullsized":"2023-12-20T04:23:26.263750+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:23:25.259003+0000","last_change":"2023-12-20T04:23:25.259003+0000","last_active":"2023-12-20T04:23:25.259003+0000","last_peered":"2023-12-20T04:23:25.259003+0000","last_clean":"2023-12-20T04:23:25.259003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:23:25.259003+0000","last_undegraded":"2023-12-20T04:23:25.259003+0000","last_fullsized":"2023-12-20T04:23:25.259003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:23:30.280 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:23:30.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.422+0000 7f344ac0b640 1 Processor -- start 2023-12-20T04:23:30.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.422+0000 7f344ac0b640 1 -- start start 2023-12-20T04:23:30.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.422+0000 7f344ac0b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34440bcdd0 0x7f34440b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.422+0000 7f344ac0b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3444144ea0 0x7f3444155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.422+0000 7f344ac0b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34440bc6b0 con 0x7f34440b64c0 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.422+0000 7f344ac0b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440b6900 con 0x7f34440bcdd0 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.422+0000 7f344ac0b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34440a59f0 con 0x7f3444144ea0 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34489a7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34440bcdd0 0x7f34440b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34489a7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34440bcdd0 0x7f34440b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57108/0 (socket says 172.21.15.40:57108) 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34489a7640 1 -- 172.21.15.40:0/1598567088 learned_addr learned my addr 172.21.15.40:0/1598567088 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34491a8640 1 --2- 172.21.15.40:0/1598567088 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3444144ea0 0x7f3444155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34489a7640 1 -- 172.21.15.40:0/1598567088 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3444144ea0 msgr2=0x7f3444155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34489a7640 1 --2- 172.21.15.40:0/1598567088 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3444144ea0 0x7f3444155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34489a7640 1 -- 172.21.15.40:0/1598567088 >> v1:172.21.15.69:6789/0 conn(0x7f34440b64c0 legacy=0x7f3444144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.423+0000 7f34489a7640 1 -- 172.21.15.40:0/1598567088 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440bc0a0 con 0x7f34440bcdd0 2023-12-20T04:23:30.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f34489a7640 1 --2- 172.21.15.40:0/1598567088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440bcdd0 0x7f34440b5f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3438009870 tx=0x7f343802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef2b6a945a23cf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f34437fe640 1 -- 172.21.15.40:0/1598567088 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438030840 con 0x7f34440bcdd0 2023-12-20T04:23:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f34437fe640 1 -- 172.21.15.40:0/1598567088 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34380309a0 con 0x7f34440bcdd0 2023-12-20T04:23:30.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f34437fe640 1 -- 172.21.15.40:0/1598567088 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438030d30 con 0x7f34440bcdd0 2023-12-20T04:23:30.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f344ac0b640 1 -- 172.21.15.40:0/1598567088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440bcdd0 msgr2=0x7f34440b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f344ac0b640 1 --2- 172.21.15.40:0/1598567088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440bcdd0 0x7f34440b5f80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3438009870 tx=0x7f343802b980 comp rx=0 tx=0).stop 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f344ac0b640 1 -- 172.21.15.40:0/1598567088 shutdown_connections 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f344ac0b640 1 --2- 172.21.15.40:0/1598567088 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3444144ea0 0x7f3444155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f344ac0b640 1 --2- 172.21.15.40:0/1598567088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440bcdd0 0x7f34440b5f80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f344ac0b640 1 -- 172.21.15.40:0/1598567088 >> 172.21.15.40:0/1598567088 conn(0x7f3444071e60 msgr2=0x7f34440c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.424+0000 7f344ac0b640 1 -- 172.21.15.40:0/1598567088 shutdown_connections 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.425+0000 7f344ac0b640 1 -- 172.21.15.40:0/1598567088 wait complete. 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.425+0000 7f344ac0b640 1 Processor -- start 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f344ac0b640 1 -- start start 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f344ac0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440b64c0 0x7f344414a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f344ac0b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34440bcdd0 0x7f34441494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f344ac0b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3444144ea0 0x7f3444149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f344ac0b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34441d11f0 con 0x7f34440b64c0 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f344ac0b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34441482e0 con 0x7f3444144ea0 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f344ac0b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3444149040 con 0x7f34440bcdd0 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f34489a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440b64c0 0x7f344414a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f34489a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440b64c0 0x7f344414a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57118/0 (socket says 172.21.15.40:57118) 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.426+0000 7f34489a7640 1 -- 172.21.15.40:0/926287860 learned_addr learned my addr 172.21.15.40:0/926287860 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34491a8640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3444144ea0 0x7f3444149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f3443fff640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34440bcdd0 0x7f34441494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34489a7640 1 -- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34440bcdd0 msgr2=0x7f34441494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34489a7640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34440bcdd0 0x7f34441494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34489a7640 1 -- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3444144ea0 msgr2=0x7f3444149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34489a7640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3444144ea0 0x7f3444149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34489a7640 1 -- 172.21.15.40:0/926287860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380094d0 con 0x7f34440b64c0 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f3443fff640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34440bcdd0 0x7f34441494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34489a7640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440b64c0 0x7f344414a6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3438000c00 tx=0x7f3438004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34417fa640 1 -- 172.21.15.40:0/926287860 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34380307f0 con 0x7f34440b64c0 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34417fa640 1 -- 172.21.15.40:0/926287860 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3438043400 con 0x7f34440b64c0 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f344414ac00 con 0x7f34440b64c0 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f34417fa640 1 -- 172.21.15.40:0/926287860 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34380437b0 con 0x7f34440b64c0 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.427+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344414aec0 con 0x7f34440b64c0 2023-12-20T04:23:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.428+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344404e840 con 0x7f34440b64c0 2023-12-20T04:23:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.429+0000 7f34417fa640 1 -- 172.21.15.40:0/926287860 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3438043910 con 0x7f34440b64c0 2023-12-20T04:23:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.429+0000 7f34417fa640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.429+0000 7f34417fa640 1 -- 172.21.15.40:0/926287860 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f343803e070 con 0x7f34440b64c0 2023-12-20T04:23:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.429+0000 7f3443fff640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.430+0000 7f3443fff640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f342806a430 0x7f342806c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3430006fd0 tx=0x7f3430008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.433+0000 7f34417fa640 1 -- 172.21.15.40:0/926287860 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3438077120 con 0x7f34440b64c0 2023-12-20T04:23:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.606+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34440b5500 con 0x7f342806a430 2023-12-20T04:23:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.614+0000 7f34417fa640 1 -- 172.21.15.40:0/926287860 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264646 (secure 0 0 0) 0x7f3430009e20 con 0x7f342806a430 2023-12-20T04:23:30.617 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:23:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.616+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f342806a430 msgr2=0x7f342806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.616+0000 7f344ac0b640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f342806a430 0x7f342806c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3430006fd0 tx=0x7f3430008040 comp rx=0 tx=0).stop 2023-12-20T04:23:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440b64c0 msgr2=0x7f344414a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440b64c0 0x7f344414a6c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3438000c00 tx=0x7f3438004730 comp rx=0 tx=0).stop 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 shutdown_connections 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3444144ea0 0x7f3444149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f34440bcdd0 0x7f34441494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 --2- 172.21.15.40:0/926287860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34440b64c0 0x7f344414a6c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 >> 172.21.15.40:0/926287860 conn(0x7f3444071e60 msgr2=0x7f34440b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 shutdown_connections 2023-12-20T04:23:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.617+0000 7f344ac0b640 1 -- 172.21.15.40:0/926287860 wait complete. 2023-12-20T04:23:30.628 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-20T04:23:30.527419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218440,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.262151"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061624+0000","last_change":"2023-12-20T04:23:26.666498+0000","last_active":"2023-12-20T04:23:28.061624+0000","last_peered":"2023-12-20T04:23:28.061624+0000","last_clean":"2023-12-20T04:23:28.061624+0000","last_became_active":"2023-12-20T04:23:26.666246+0000","last_became_peered":"2023-12-20T04:23:26.666246+0000","last_unstale":"2023-12-20T04:23:28.061624+0000","last_undegraded":"2023-12-20T04:23:28.061624+0000","last_fullsized":"2023-12-20T04:23:28.061624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:11.658501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646532+0000","last_change":"2023-12-20T04:23:26.668502+0000","last_active":"2023-12-20T04:23:27.646532+0000","last_peered":"2023-12-20T04:23:27.646532+0000","last_clean":"2023-12-20T04:23:27.646532+0000","last_became_active":"2023-12-20T04:23:26.668226+0000","last_became_peered":"2023-12-20T04:23:26.668226+0000","last_unstale":"2023-12-20T04:23:27.646532+0000","last_undegraded":"2023-12-20T04:23:27.646532+0000","last_fullsized":"2023-12-20T04:23:27.646532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692326+0000","last_change":"2023-12-20T04:23:26.657999+0000","last_active":"2023-12-20T04:23:28.692326+0000","last_peered":"2023-12-20T04:23:28.692326+0000","last_clean":"2023-12-20T04:23:28.692326+0000","last_became_active":"2023-12-20T04:23:26.657747+0000","last_became_peered":"2023-12-20T04:23:26.657747+0000","last_unstale":"2023-12-20T04:23:28.692326+0000","last_undegraded":"2023-12-20T04:23:28.692326+0000","last_fullsized":"2023-12-20T04:23:28.692326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693115+0000","last_change":"2023-12-20T04:23:26.667729+0000","last_active":"2023-12-20T04:23:28.693115+0000","last_peered":"2023-12-20T04:23:28.693115+0000","last_clean":"2023-12-20T04:23:28.693115+0000","last_became_active":"2023-12-20T04:23:26.667465+0000","last_became_peered":"2023-12-20T04:23:26.667465+0000","last_unstale":"2023-12-20T04:23:28.693115+0000","last_undegraded":"2023-12-20T04:23:28.693115+0000","last_fullsized":"2023-12-20T04:23:28.693115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:00.052684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061201+0000","last_change":"2023-12-20T04:23:26.663765+0000","last_active":"2023-12-20T04:23:28.061201+0000","last_peered":"2023-12-20T04:23:28.061201+0000","last_clean":"2023-12-20T04:23:28.061201+0000","last_became_active":"2023-12-20T04:23:26.661392+0000","last_became_peered":"2023-12-20T04:23:26.661392+0000","last_unstale":"2023-12-20T04:23:28.061201+0000","last_undegraded":"2023-12-20T04:23:28.061201+0000","last_fullsized":"2023-12-20T04:23:28.061201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:50:16.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692819+0000","last_change":"2023-12-20T04:23:26.668637+0000","last_active":"2023-12-20T04:23:28.692819+0000","last_peered":"2023-12-20T04:23:28.692819+0000","last_clean":"2023-12-20T04:23:28.692819+0000","last_became_active":"2023-12-20T04:23:26.668371+0000","last_became_peered":"2023-12-20T04:23:26.668371+0000","last_unstale":"2023-12-20T04:23:28.692819+0000","last_undegraded":"2023-12-20T04:23:28.692819+0000","last_fullsized":"2023-12-20T04:23:28.692819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:50:16.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061136+0000","last_change":"2023-12-20T04:23:26.660691+0000","last_active":"2023-12-20T04:23:28.061136+0000","last_peered":"2023-12-20T04:23:28.061136+0000","last_clean":"2023-12-20T04:23:28.061136+0000","last_became_active":"2023-12-20T04:23:26.660437+0000","last_became_peered":"2023-12-20T04:23:26.660437+0000","last_unstale":"2023-12-20T04:23:28.061136+0000","last_undegraded":"2023-12-20T04:23:28.061136+0000","last_fullsized":"2023-12-20T04:23:28.061136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:06:36.081600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579534+0000","last_change":"2023-12-20T04:23:26.670148+0000","last_active":"2023-12-20T04:23:28.579534+0000","last_peered":"2023-12-20T04:23:28.579534+0000","last_clean":"2023-12-20T04:23:28.579534+0000","last_became_active":"2023-12-20T04:23:26.669968+0000","last_became_peered":"2023-12-20T04:23:26.669968+0000","last_unstale":"2023-12-20T04:23:28.579534+0000","last_undegraded":"2023-12-20T04:23:28.579534+0000","last_fullsized":"2023-12-20T04:23:28.579534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061628+0000","last_change":"2023-12-20T04:23:26.671820+0000","last_active":"2023-12-20T04:23:28.061628+0000","last_peered":"2023-12-20T04:23:28.061628+0000","last_clean":"2023-12-20T04:23:28.061628+0000","last_became_active":"2023-12-20T04:23:26.671447+0000","last_became_peered":"2023-12-20T04:23:26.671447+0000","last_unstale":"2023-12-20T04:23:28.061628+0000","last_undegraded":"2023-12-20T04:23:28.061628+0000","last_fullsized":"2023-12-20T04:23:28.061628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648899+0000","last_change":"2023-12-20T04:23:26.667769+0000","last_active":"2023-12-20T04:23:27.648899+0000","last_peered":"2023-12-20T04:23:27.648899+0000","last_clean":"2023-12-20T04:23:27.648899+0000","last_became_active":"2023-12-20T04:23:26.667520+0000","last_became_peered":"2023-12-20T04:23:26.667520+0000","last_unstale":"2023-12-20T04:23:27.648899+0000","last_undegraded":"2023-12-20T04:23:27.648899+0000","last_fullsized":"2023-12-20T04:23:27.648899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648667+0000","last_change":"2023-12-20T04:23:26.668385+0000","last_active":"2023-12-20T04:23:27.648667+0000","last_peered":"2023-12-20T04:23:27.648667+0000","last_clean":"2023-12-20T04:23:27.648667+0000","last_became_active":"2023-12-20T04:23:26.668091+0000","last_became_peered":"2023-12-20T04:23:26.668091+0000","last_unstale":"2023-12-20T04:23:27.648667+0000","last_undegraded":"2023-12-20T04:23:27.648667+0000","last_fullsized":"2023-12-20T04:23:27.648667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648548+0000","last_change":"2023-12-20T04:23:26.664617+0000","last_active":"2023-12-20T04:23:27.648548+0000","last_peered":"2023-12-20T04:23:27.648548+0000","last_clean":"2023-12-20T04:23:27.648548+0000","last_became_active":"2023-12-20T04:23:26.664369+0000","last_became_peered":"2023-12-20T04:23:26.664369+0000","last_unstale":"2023-12-20T04:23:27.648548+0000","last_undegraded":"2023-12-20T04:23:27.648548+0000","last_fullsized":"2023-12-20T04:23:27.648548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:27.375983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.580024+0000","last_change":"2023-12-20T04:23:26.668361+0000","last_active":"2023-12-20T04:23:28.580024+0000","last_peered":"2023-12-20T04:23:28.580024+0000","last_clean":"2023-12-20T04:23:28.580024+0000","last_became_active":"2023-12-20T04:23:26.668035+0000","last_became_peered":"2023-12-20T04:23:26.668035+0000","last_unstale":"2023-12-20T04:23:28.580024+0000","last_undegraded":"2023-12-20T04:23:28.580024+0000","last_fullsized":"2023-12-20T04:23:28.580024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692172+0000","last_change":"2023-12-20T04:23:26.666583+0000","last_active":"2023-12-20T04:23:28.692172+0000","last_peered":"2023-12-20T04:23:28.692172+0000","last_clean":"2023-12-20T04:23:28.692172+0000","last_became_active":"2023-12-20T04:23:26.666196+0000","last_became_peered":"2023-12-20T04:23:26.666196+0000","last_unstale":"2023-12-20T04:23:28.692172+0000","last_undegraded":"2023-12-20T04:23:28.692172+0000","last_fullsized":"2023-12-20T04:23:28.692172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646250+0000","last_change":"2023-12-20T04:23:26.664551+0000","last_active":"2023-12-20T04:23:27.646250+0000","last_peered":"2023-12-20T04:23:27.646250+0000","last_clean":"2023-12-20T04:23:27.646250+0000","last_became_active":"2023-12-20T04:23:26.663982+0000","last_became_peered":"2023-12-20T04:23:26.663982+0000","last_unstale":"2023-12-20T04:23:27.646250+0000","last_undegraded":"2023-12-20T04:23:27.646250+0000","last_fullsized":"2023-12-20T04:23:27.646250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692742+0000","last_change":"2023-12-20T04:23:26.669630+0000","last_active":"2023-12-20T04:23:28.692742+0000","last_peered":"2023-12-20T04:23:28.692742+0000","last_clean":"2023-12-20T04:23:28.692742+0000","last_became_active":"2023-12-20T04:23:26.669031+0000","last_became_peered":"2023-12-20T04:23:26.669031+0000","last_unstale":"2023-12-20T04:23:28.692742+0000","last_undegraded":"2023-12-20T04:23:28.692742+0000","last_fullsized":"2023-12-20T04:23:28.692742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:50.192488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693333+0000","last_change":"2023-12-20T04:23:26.671539+0000","last_active":"2023-12-20T04:23:28.693333+0000","last_peered":"2023-12-20T04:23:28.693333+0000","last_clean":"2023-12-20T04:23:28.693333+0000","last_became_active":"2023-12-20T04:23:26.671276+0000","last_became_peered":"2023-12-20T04:23:26.671276+0000","last_unstale":"2023-12-20T04:23:28.693333+0000","last_undegraded":"2023-12-20T04:23:28.693333+0000","last_fullsized":"2023-12-20T04:23:28.693333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:25.045988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177902+0000","last_change":"2023-12-20T04:23:26.657248+0000","last_active":"2023-12-20T04:23:28.177902+0000","last_peered":"2023-12-20T04:23:28.177902+0000","last_clean":"2023-12-20T04:23:28.177902+0000","last_became_active":"2023-12-20T04:23:26.657002+0000","last_became_peered":"2023-12-20T04:23:26.657002+0000","last_unstale":"2023-12-20T04:23:28.177902+0000","last_undegraded":"2023-12-20T04:23:28.177902+0000","last_fullsized":"2023-12-20T04:23:28.177902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:04.276683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061570+0000","last_change":"2023-12-20T04:23:26.663917+0000","last_active":"2023-12-20T04:23:28.061570+0000","last_peered":"2023-12-20T04:23:28.061570+0000","last_clean":"2023-12-20T04:23:28.061570+0000","last_became_active":"2023-12-20T04:23:26.662376+0000","last_became_peered":"2023-12-20T04:23:26.662376+0000","last_unstale":"2023-12-20T04:23:28.061570+0000","last_undegraded":"2023-12-20T04:23:28.061570+0000","last_fullsized":"2023-12-20T04:23:28.061570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:50.192488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648277+0000","last_change":"2023-12-20T04:23:26.663614+0000","last_active":"2023-12-20T04:23:27.648277+0000","last_peered":"2023-12-20T04:23:27.648277+0000","last_clean":"2023-12-20T04:23:27.648277+0000","last_became_active":"2023-12-20T04:23:26.663349+0000","last_became_peered":"2023-12-20T04:23:26.663349+0000","last_unstale":"2023-12-20T04:23:27.648277+0000","last_undegraded":"2023-12-20T04:23:27.648277+0000","last_fullsized":"2023-12-20T04:23:27.648277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692303+0000","last_change":"2023-12-20T04:23:26.662123+0000","last_active":"2023-12-20T04:23:28.692303+0000","last_peered":"2023-12-20T04:23:28.692303+0000","last_clean":"2023-12-20T04:23:28.692303+0000","last_became_active":"2023-12-20T04:23:26.661842+0000","last_became_peered":"2023-12-20T04:23:26.661842+0000","last_unstale":"2023-12-20T04:23:28.692303+0000","last_undegraded":"2023-12-20T04:23:28.692303+0000","last_fullsized":"2023-12-20T04:23:28.692303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692896+0000","last_change":"2023-12-20T04:23:26.672102+0000","last_active":"2023-12-20T04:23:28.692896+0000","last_peered":"2023-12-20T04:23:28.692896+0000","last_clean":"2023-12-20T04:23:28.692896+0000","last_became_active":"2023-12-20T04:23:26.671824+0000","last_became_peered":"2023-12-20T04:23:26.671824+0000","last_unstale":"2023-12-20T04:23:28.692896+0000","last_undegraded":"2023-12-20T04:23:28.692896+0000","last_fullsized":"2023-12-20T04:23:28.692896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:11.658501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579664+0000","last_change":"2023-12-20T04:23:26.665844+0000","last_active":"2023-12-20T04:23:28.579664+0000","last_peered":"2023-12-20T04:23:28.579664+0000","last_clean":"2023-12-20T04:23:28.579664+0000","last_became_active":"2023-12-20T04:23:26.664538+0000","last_became_peered":"2023-12-20T04:23:26.664538+0000","last_unstale":"2023-12-20T04:23:28.579664+0000","last_undegraded":"2023-12-20T04:23:28.579664+0000","last_fullsized":"2023-12-20T04:23:28.579664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692840+0000","last_change":"2023-12-20T04:23:26.667407+0000","last_active":"2023-12-20T04:23:28.692840+0000","last_peered":"2023-12-20T04:23:28.692840+0000","last_clean":"2023-12-20T04:23:28.692840+0000","last_became_active":"2023-12-20T04:23:26.667140+0000","last_became_peered":"2023-12-20T04:23:26.667140+0000","last_unstale":"2023-12-20T04:23:28.692840+0000","last_undegraded":"2023-12-20T04:23:28.692840+0000","last_fullsized":"2023-12-20T04:23:28.692840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:18:25.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579721+0000","last_change":"2023-12-20T04:23:26.663904+0000","last_active":"2023-12-20T04:23:28.579721+0000","last_peered":"2023-12-20T04:23:28.579721+0000","last_clean":"2023-12-20T04:23:28.579721+0000","last_became_active":"2023-12-20T04:23:26.663613+0000","last_became_peered":"2023-12-20T04:23:26.663613+0000","last_unstale":"2023-12-20T04:23:28.579721+0000","last_undegraded":"2023-12-20T04:23:28.579721+0000","last_fullsized":"2023-12-20T04:23:28.579721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648900+0000","last_change":"2023-12-20T04:23:26.662650+0000","last_active":"2023-12-20T04:23:27.648900+0000","last_peered":"2023-12-20T04:23:27.648900+0000","last_clean":"2023-12-20T04:23:27.648900+0000","last_became_active":"2023-12-20T04:23:26.662377+0000","last_became_peered":"2023-12-20T04:23:26.662377+0000","last_unstale":"2023-12-20T04:23:27.648900+0000","last_undegraded":"2023-12-20T04:23:27.648900+0000","last_fullsized":"2023-12-20T04:23:27.648900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646456+0000","last_change":"2023-12-20T04:23:26.666772+0000","last_active":"2023-12-20T04:23:27.646456+0000","last_peered":"2023-12-20T04:23:27.646456+0000","last_clean":"2023-12-20T04:23:27.646456+0000","last_became_active":"2023-12-20T04:23:26.666531+0000","last_became_peered":"2023-12-20T04:23:26.666531+0000","last_unstale":"2023-12-20T04:23:27.646456+0000","last_undegraded":"2023-12-20T04:23:27.646456+0000","last_fullsized":"2023-12-20T04:23:27.646456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579870+0000","last_change":"2023-12-20T04:23:26.663285+0000","last_active":"2023-12-20T04:23:28.579870+0000","last_peered":"2023-12-20T04:23:28.579870+0000","last_clean":"2023-12-20T04:23:28.579870+0000","last_became_active":"2023-12-20T04:23:26.662878+0000","last_became_peered":"2023-12-20T04:23:26.662878+0000","last_unstale":"2023-12-20T04:23:28.579870+0000","last_undegraded":"2023-12-20T04:23:28.579870+0000","last_fullsized":"2023-12-20T04:23:28.579870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692402+0000","last_change":"2023-12-20T04:23:26.658130+0000","last_active":"2023-12-20T04:23:28.692402+0000","last_peered":"2023-12-20T04:23:28.692402+0000","last_clean":"2023-12-20T04:23:28.692402+0000","last_became_active":"2023-12-20T04:23:26.657806+0000","last_became_peered":"2023-12-20T04:23:26.657806+0000","last_unstale":"2023-12-20T04:23:28.692402+0000","last_undegraded":"2023-12-20T04:23:28.692402+0000","last_fullsized":"2023-12-20T04:23:28.692402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692986+0000","last_change":"2023-12-20T04:23:26.667214+0000","last_active":"2023-12-20T04:23:28.692986+0000","last_peered":"2023-12-20T04:23:28.692986+0000","last_clean":"2023-12-20T04:23:28.692986+0000","last_became_active":"2023-12-20T04:23:26.666941+0000","last_became_peered":"2023-12-20T04:23:26.666941+0000","last_unstale":"2023-12-20T04:23:28.692986+0000","last_undegraded":"2023-12-20T04:23:28.692986+0000","last_fullsized":"2023-12-20T04:23:28.692986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177740+0000","last_change":"2023-12-20T04:23:26.661015+0000","last_active":"2023-12-20T04:23:28.177740+0000","last_peered":"2023-12-20T04:23:28.177740+0000","last_clean":"2023-12-20T04:23:28.177740+0000","last_became_active":"2023-12-20T04:23:26.660710+0000","last_became_peered":"2023-12-20T04:23:26.660710+0000","last_unstale":"2023-12-20T04:23:28.177740+0000","last_undegraded":"2023-12-20T04:23:28.177740+0000","last_fullsized":"2023-12-20T04:23:28.177740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:14.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648277+0000","last_change":"2023-12-20T04:23:26.661715+0000","last_active":"2023-12-20T04:23:27.648277+0000","last_peered":"2023-12-20T04:23:27.648277+0000","last_clean":"2023-12-20T04:23:27.648277+0000","last_became_active":"2023-12-20T04:23:26.660262+0000","last_became_peered":"2023-12-20T04:23:26.660262+0000","last_unstale":"2023-12-20T04:23:27.648277+0000","last_undegraded":"2023-12-20T04:23:27.648277+0000","last_fullsized":"2023-12-20T04:23:27.648277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648886+0000","last_change":"2023-12-20T04:23:26.666784+0000","last_active":"2023-12-20T04:23:27.648886+0000","last_peered":"2023-12-20T04:23:27.648886+0000","last_clean":"2023-12-20T04:23:27.648886+0000","last_became_active":"2023-12-20T04:23:26.666421+0000","last_became_peered":"2023-12-20T04:23:26.666421+0000","last_unstale":"2023-12-20T04:23:27.648886+0000","last_undegraded":"2023-12-20T04:23:27.648886+0000","last_fullsized":"2023-12-20T04:23:27.648886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:20.915118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579911+0000","last_change":"2023-12-20T04:23:26.282457+0000","last_active":"2023-12-20T04:23:28.579911+0000","last_peered":"2023-12-20T04:23:28.579911+0000","last_clean":"2023-12-20T04:23:28.579911+0000","last_became_active":"2023-12-20T04:23:26.281316+0000","last_became_peered":"2023-12-20T04:23:26.281316+0000","last_unstale":"2023-12-20T04:23:28.579911+0000","last_undegraded":"2023-12-20T04:23:28.579911+0000","last_fullsized":"2023-12-20T04:23:28.579911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692426+0000","last_change":"2023-12-20T04:23:26.663926+0000","last_active":"2023-12-20T04:23:28.692426+0000","last_peered":"2023-12-20T04:23:28.692426+0000","last_clean":"2023-12-20T04:23:28.692426+0000","last_became_active":"2023-12-20T04:23:26.663675+0000","last_became_peered":"2023-12-20T04:23:26.663675+0000","last_unstale":"2023-12-20T04:23:28.692426+0000","last_undegraded":"2023-12-20T04:23:28.692426+0000","last_fullsized":"2023-12-20T04:23:28.692426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648259+0000","last_change":"2023-12-20T04:23:26.277616+0000","last_active":"2023-12-20T04:23:27.648259+0000","last_peered":"2023-12-20T04:23:27.648259+0000","last_clean":"2023-12-20T04:23:27.648259+0000","last_became_active":"2023-12-20T04:23:26.277349+0000","last_became_peered":"2023-12-20T04:23:26.277349+0000","last_unstale":"2023-12-20T04:23:27.648259+0000","last_undegraded":"2023-12-20T04:23:27.648259+0000","last_fullsized":"2023-12-20T04:23:27.648259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579656+0000","last_change":"2023-12-20T04:23:26.279099+0000","last_active":"2023-12-20T04:23:28.579656+0000","last_peered":"2023-12-20T04:23:28.579656+0000","last_clean":"2023-12-20T04:23:28.579656+0000","last_became_active":"2023-12-20T04:23:26.278619+0000","last_became_peered":"2023-12-20T04:23:26.278619+0000","last_unstale":"2023-12-20T04:23:28.579656+0000","last_undegraded":"2023-12-20T04:23:28.579656+0000","last_fullsized":"2023-12-20T04:23:28.579656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579626+0000","last_change":"2023-12-20T04:23:26.662251+0000","last_active":"2023-12-20T04:23:28.579626+0000","last_peered":"2023-12-20T04:23:28.579626+0000","last_clean":"2023-12-20T04:23:28.579626+0000","last_became_active":"2023-12-20T04:23:26.661973+0000","last_became_peered":"2023-12-20T04:23:26.661973+0000","last_unstale":"2023-12-20T04:23:28.579626+0000","last_undegraded":"2023-12-20T04:23:28.579626+0000","last_fullsized":"2023-12-20T04:23:28.579626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692924+0000","last_change":"2023-12-20T04:23:26.283773+0000","last_active":"2023-12-20T04:23:28.692924+0000","last_peered":"2023-12-20T04:23:28.692924+0000","last_clean":"2023-12-20T04:23:28.692924+0000","last_became_active":"2023-12-20T04:23:26.283502+0000","last_became_peered":"2023-12-20T04:23:26.283502+0000","last_unstale":"2023-12-20T04:23:28.692924+0000","last_undegraded":"2023-12-20T04:23:28.692924+0000","last_fullsized":"2023-12-20T04:23:28.692924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646247+0000","last_change":"2023-12-20T04:23:26.664741+0000","last_active":"2023-12-20T04:23:27.646247+0000","last_peered":"2023-12-20T04:23:27.646247+0000","last_clean":"2023-12-20T04:23:27.646247+0000","last_became_active":"2023-12-20T04:23:26.664295+0000","last_became_peered":"2023-12-20T04:23:26.664295+0000","last_unstale":"2023-12-20T04:23:27.646247+0000","last_undegraded":"2023-12-20T04:23:27.646247+0000","last_fullsized":"2023-12-20T04:23:27.646247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648893+0000","last_change":"2023-12-20T04:23:26.285849+0000","last_active":"2023-12-20T04:23:27.648893+0000","last_peered":"2023-12-20T04:23:27.648893+0000","last_clean":"2023-12-20T04:23:27.648893+0000","last_became_active":"2023-12-20T04:23:26.285531+0000","last_became_peered":"2023-12-20T04:23:26.285531+0000","last_unstale":"2023-12-20T04:23:27.648893+0000","last_undegraded":"2023-12-20T04:23:27.648893+0000","last_fullsized":"2023-12-20T04:23:27.648893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693176+0000","last_change":"2023-12-20T04:23:26.671630+0000","last_active":"2023-12-20T04:23:28.693176+0000","last_peered":"2023-12-20T04:23:28.693176+0000","last_clean":"2023-12-20T04:23:28.693176+0000","last_became_active":"2023-12-20T04:23:26.671345+0000","last_became_peered":"2023-12-20T04:23:26.671345+0000","last_unstale":"2023-12-20T04:23:28.693176+0000","last_undegraded":"2023-12-20T04:23:28.693176+0000","last_fullsized":"2023-12-20T04:23:28.693176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:15.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693213+0000","last_change":"2023-12-20T04:23:26.284968+0000","last_active":"2023-12-20T04:23:28.693213+0000","last_peered":"2023-12-20T04:23:28.693213+0000","last_clean":"2023-12-20T04:23:28.693213+0000","last_became_active":"2023-12-20T04:23:26.283961+0000","last_became_peered":"2023-12-20T04:23:26.283961+0000","last_unstale":"2023-12-20T04:23:28.693213+0000","last_undegraded":"2023-12-20T04:23:28.693213+0000","last_fullsized":"2023-12-20T04:23:28.693213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692449+0000","last_change":"2023-12-20T04:23:26.668101+0000","last_active":"2023-12-20T04:23:28.692449+0000","last_peered":"2023-12-20T04:23:28.692449+0000","last_clean":"2023-12-20T04:23:28.692449+0000","last_became_active":"2023-12-20T04:23:26.667868+0000","last_became_peered":"2023-12-20T04:23:26.667868+0000","last_unstale":"2023-12-20T04:23:28.692449+0000","last_undegraded":"2023-12-20T04:23:28.692449+0000","last_fullsized":"2023-12-20T04:23:28.692449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:51:34.130960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646469+0000","last_change":"2023-12-20T04:23:26.285125+0000","last_active":"2023-12-20T04:23:27.646469+0000","last_peered":"2023-12-20T04:23:27.646469+0000","last_clean":"2023-12-20T04:23:27.646469+0000","last_became_active":"2023-12-20T04:23:26.284858+0000","last_became_peered":"2023-12-20T04:23:26.284858+0000","last_unstale":"2023-12-20T04:23:27.646469+0000","last_undegraded":"2023-12-20T04:23:27.646469+0000","last_fullsized":"2023-12-20T04:23:27.646469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:13.196722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648778+0000","last_change":"2023-12-20T04:23:26.662730+0000","last_active":"2023-12-20T04:23:27.648778+0000","last_peered":"2023-12-20T04:23:27.648778+0000","last_clean":"2023-12-20T04:23:27.648778+0000","last_became_active":"2023-12-20T04:23:26.662433+0000","last_became_peered":"2023-12-20T04:23:26.662433+0000","last_unstale":"2023-12-20T04:23:27.648778+0000","last_undegraded":"2023-12-20T04:23:27.648778+0000","last_fullsized":"2023-12-20T04:23:27.648778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:04.276683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648317+0000","last_change":"2023-12-20T04:23:26.281774+0000","last_active":"2023-12-20T04:23:27.648317+0000","last_peered":"2023-12-20T04:23:27.648317+0000","last_clean":"2023-12-20T04:23:27.648317+0000","last_became_active":"2023-12-20T04:23:26.281481+0000","last_became_peered":"2023-12-20T04:23:26.281481+0000","last_unstale":"2023-12-20T04:23:27.648317+0000","last_undegraded":"2023-12-20T04:23:27.648317+0000","last_fullsized":"2023-12-20T04:23:27.648317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061436+0000","last_change":"2023-12-20T04:23:26.658159+0000","last_active":"2023-12-20T04:23:28.061436+0000","last_peered":"2023-12-20T04:23:28.061436+0000","last_clean":"2023-12-20T04:23:28.061436+0000","last_became_active":"2023-12-20T04:23:26.657870+0000","last_became_peered":"2023-12-20T04:23:26.657870+0000","last_unstale":"2023-12-20T04:23:28.061436+0000","last_undegraded":"2023-12-20T04:23:28.061436+0000","last_fullsized":"2023-12-20T04:23:28.061436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:25.045988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692465+0000","last_change":"2023-12-20T04:23:26.286048+0000","last_active":"2023-12-20T04:23:28.692465+0000","last_peered":"2023-12-20T04:23:28.692465+0000","last_clean":"2023-12-20T04:23:28.692465+0000","last_became_active":"2023-12-20T04:23:26.285776+0000","last_became_peered":"2023-12-20T04:23:26.285776+0000","last_unstale":"2023-12-20T04:23:28.692465+0000","last_undegraded":"2023-12-20T04:23:28.692465+0000","last_fullsized":"2023-12-20T04:23:28.692465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692226+0000","last_change":"2023-12-20T04:23:26.658401+0000","last_active":"2023-12-20T04:23:28.692226+0000","last_peered":"2023-12-20T04:23:28.692226+0000","last_clean":"2023-12-20T04:23:28.692226+0000","last_became_active":"2023-12-20T04:23:26.658117+0000","last_became_peered":"2023-12-20T04:23:26.658117+0000","last_unstale":"2023-12-20T04:23:28.692226+0000","last_undegraded":"2023-12-20T04:23:28.692226+0000","last_fullsized":"2023-12-20T04:23:28.692226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693041+0000","last_change":"2023-12-20T04:23:26.288724+0000","last_active":"2023-12-20T04:23:28.693041+0000","last_peered":"2023-12-20T04:23:28.693041+0000","last_clean":"2023-12-20T04:23:28.693041+0000","last_became_active":"2023-12-20T04:23:26.288544+0000","last_became_peered":"2023-12-20T04:23:26.288544+0000","last_unstale":"2023-12-20T04:23:28.693041+0000","last_undegraded":"2023-12-20T04:23:28.693041+0000","last_fullsized":"2023-12-20T04:23:28.693041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061274+0000","last_change":"2023-12-20T04:23:26.664506+0000","last_active":"2023-12-20T04:23:28.061274+0000","last_peered":"2023-12-20T04:23:28.061274+0000","last_clean":"2023-12-20T04:23:28.061274+0000","last_became_active":"2023-12-20T04:23:26.664257+0000","last_became_peered":"2023-12-20T04:23:26.664257+0000","last_unstale":"2023-12-20T04:23:28.061274+0000","last_undegraded":"2023-12-20T04:23:28.061274+0000","last_fullsized":"2023-12-20T04:23:28.061274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:26.732551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648216+0000","last_change":"2023-12-20T04:23:26.278212+0000","last_active":"2023-12-20T04:23:27.648216+0000","last_peered":"2023-12-20T04:23:27.648216+0000","last_clean":"2023-12-20T04:23:27.648216+0000","last_became_active":"2023-12-20T04:23:26.277934+0000","last_became_peered":"2023-12-20T04:23:26.277934+0000","last_unstale":"2023-12-20T04:23:27.648216+0000","last_undegraded":"2023-12-20T04:23:27.648216+0000","last_fullsized":"2023-12-20T04:23:27.648216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648152+0000","last_change":"2023-12-20T04:23:26.661558+0000","last_active":"2023-12-20T04:23:27.648152+0000","last_peered":"2023-12-20T04:23:27.648152+0000","last_clean":"2023-12-20T04:23:27.648152+0000","last_became_active":"2023-12-20T04:23:26.659798+0000","last_became_peered":"2023-12-20T04:23:26.659798+0000","last_unstale":"2023-12-20T04:23:27.648152+0000","last_undegraded":"2023-12-20T04:23:27.648152+0000","last_fullsized":"2023-12-20T04:23:27.648152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177704+0000","last_change":"2023-12-20T04:23:26.284487+0000","last_active":"2023-12-20T04:23:28.177704+0000","last_peered":"2023-12-20T04:23:28.177704+0000","last_clean":"2023-12-20T04:23:28.177704+0000","last_became_active":"2023-12-20T04:23:26.283900+0000","last_became_peered":"2023-12-20T04:23:26.283900+0000","last_unstale":"2023-12-20T04:23:28.177704+0000","last_undegraded":"2023-12-20T04:23:28.177704+0000","last_fullsized":"2023-12-20T04:23:28.177704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061185+0000","last_change":"2023-12-20T04:23:26.665136+0000","last_active":"2023-12-20T04:23:28.061185+0000","last_peered":"2023-12-20T04:23:28.061185+0000","last_clean":"2023-12-20T04:23:28.061185+0000","last_became_active":"2023-12-20T04:23:26.664875+0000","last_became_peered":"2023-12-20T04:23:26.664875+0000","last_unstale":"2023-12-20T04:23:28.061185+0000","last_undegraded":"2023-12-20T04:23:28.061185+0000","last_fullsized":"2023-12-20T04:23:28.061185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:15.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648681+0000","last_change":"2023-12-20T04:23:26.284637+0000","last_active":"2023-12-20T04:23:27.648681+0000","last_peered":"2023-12-20T04:23:27.648681+0000","last_clean":"2023-12-20T04:23:27.648681+0000","last_became_active":"2023-12-20T04:23:26.284372+0000","last_became_peered":"2023-12-20T04:23:26.284372+0000","last_unstale":"2023-12-20T04:23:27.648681+0000","last_undegraded":"2023-12-20T04:23:27.648681+0000","last_fullsized":"2023-12-20T04:23:27.648681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:00:36.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061596+0000","last_change":"2023-12-20T04:23:26.663644+0000","last_active":"2023-12-20T04:23:28.061596+0000","last_peered":"2023-12-20T04:23:28.061596+0000","last_clean":"2023-12-20T04:23:28.061596+0000","last_became_active":"2023-12-20T04:23:26.663233+0000","last_became_peered":"2023-12-20T04:23:26.663233+0000","last_unstale":"2023-12-20T04:23:28.061596+0000","last_undegraded":"2023-12-20T04:23:28.061596+0000","last_fullsized":"2023-12-20T04:23:28.061596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177928+0000","last_change":"2023-12-20T04:23:26.292362+0000","last_active":"2023-12-20T04:23:28.177928+0000","last_peered":"2023-12-20T04:23:28.177928+0000","last_clean":"2023-12-20T04:23:28.177928+0000","last_became_active":"2023-12-20T04:23:26.291998+0000","last_became_peered":"2023-12-20T04:23:26.291998+0000","last_unstale":"2023-12-20T04:23:28.177928+0000","last_undegraded":"2023-12-20T04:23:28.177928+0000","last_fullsized":"2023-12-20T04:23:28.177928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061688+0000","last_change":"2023-12-20T04:23:26.663859+0000","last_active":"2023-12-20T04:23:28.061688+0000","last_peered":"2023-12-20T04:23:28.061688+0000","last_clean":"2023-12-20T04:23:28.061688+0000","last_became_active":"2023-12-20T04:23:26.663615+0000","last_became_peered":"2023-12-20T04:23:26.663615+0000","last_unstale":"2023-12-20T04:23:28.061688+0000","last_undegraded":"2023-12-20T04:23:28.061688+0000","last_fullsized":"2023-12-20T04:23:28.061688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646520+0000","last_change":"2023-12-20T04:23:26.278555+0000","last_active":"2023-12-20T04:23:27.646520+0000","last_peered":"2023-12-20T04:23:27.646520+0000","last_clean":"2023-12-20T04:23:27.646520+0000","last_became_active":"2023-12-20T04:23:26.278297+0000","last_became_peered":"2023-12-20T04:23:26.278297+0000","last_unstale":"2023-12-20T04:23:27.646520+0000","last_undegraded":"2023-12-20T04:23:27.646520+0000","last_fullsized":"2023-12-20T04:23:27.646520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693278+0000","last_change":"2023-12-20T04:23:26.673127+0000","last_active":"2023-12-20T04:23:28.693278+0000","last_peered":"2023-12-20T04:23:28.693278+0000","last_clean":"2023-12-20T04:23:28.693278+0000","last_became_active":"2023-12-20T04:23:26.672852+0000","last_became_peered":"2023-12-20T04:23:26.672852+0000","last_unstale":"2023-12-20T04:23:28.693278+0000","last_undegraded":"2023-12-20T04:23:28.693278+0000","last_fullsized":"2023-12-20T04:23:28.693278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177875+0000","last_change":"2023-12-20T04:23:26.284610+0000","last_active":"2023-12-20T04:23:28.177875+0000","last_peered":"2023-12-20T04:23:28.177875+0000","last_clean":"2023-12-20T04:23:28.177875+0000","last_became_active":"2023-12-20T04:23:26.284222+0000","last_became_peered":"2023-12-20T04:23:26.284222+0000","last_unstale":"2023-12-20T04:23:28.177875+0000","last_undegraded":"2023-12-20T04:23:28.177875+0000","last_fullsized":"2023-12-20T04:23:28.177875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061438+0000","last_change":"2023-12-20T04:23:26.667851+0000","last_active":"2023-12-20T04:23:28.061438+0000","last_peered":"2023-12-20T04:23:28.061438+0000","last_clean":"2023-12-20T04:23:28.061438+0000","last_became_active":"2023-12-20T04:23:26.667603+0000","last_became_peered":"2023-12-20T04:23:26.667603+0000","last_unstale":"2023-12-20T04:23:28.061438+0000","last_undegraded":"2023-12-20T04:23:28.061438+0000","last_fullsized":"2023-12-20T04:23:28.061438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:00.052684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:23:26.652599+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:23:26.652599+0000","last_peered":"2023-12-20T04:23:26.652599+0000","last_clean":"2023-12-20T04:23:26.652599+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:23:26.652599+0000","last_undegraded":"2023-12-20T04:23:26.652599+0000","last_fullsized":"2023-12-20T04:23:26.652599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692947+0000","last_change":"2023-12-20T04:23:26.284499+0000","last_active":"2023-12-20T04:23:28.692947+0000","last_peered":"2023-12-20T04:23:28.692947+0000","last_clean":"2023-12-20T04:23:28.692947+0000","last_became_active":"2023-12-20T04:23:26.284235+0000","last_became_peered":"2023-12-20T04:23:26.284235+0000","last_unstale":"2023-12-20T04:23:28.692947+0000","last_undegraded":"2023-12-20T04:23:28.692947+0000","last_fullsized":"2023-12-20T04:23:28.692947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579786+0000","last_change":"2023-12-20T04:23:26.673891+0000","last_active":"2023-12-20T04:23:28.579786+0000","last_peered":"2023-12-20T04:23:28.579786+0000","last_clean":"2023-12-20T04:23:28.579786+0000","last_became_active":"2023-12-20T04:23:26.673596+0000","last_became_peered":"2023-12-20T04:23:26.673596+0000","last_unstale":"2023-12-20T04:23:28.579786+0000","last_undegraded":"2023-12-20T04:23:28.579786+0000","last_fullsized":"2023-12-20T04:23:28.579786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061040+0000","last_change":"2023-12-20T04:23:26.285507+0000","last_active":"2023-12-20T04:23:28.061040+0000","last_peered":"2023-12-20T04:23:28.061040+0000","last_clean":"2023-12-20T04:23:28.061040+0000","last_became_active":"2023-12-20T04:23:26.285258+0000","last_became_peered":"2023-12-20T04:23:26.285258+0000","last_unstale":"2023-12-20T04:23:28.061040+0000","last_undegraded":"2023-12-20T04:23:28.061040+0000","last_fullsized":"2023-12-20T04:23:28.061040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692149+0000","last_change":"2023-12-20T04:23:26.664608+0000","last_active":"2023-12-20T04:23:28.692149+0000","last_peered":"2023-12-20T04:23:28.692149+0000","last_clean":"2023-12-20T04:23:28.692149+0000","last_became_active":"2023-12-20T04:23:26.664342+0000","last_became_peered":"2023-12-20T04:23:26.664342+0000","last_unstale":"2023-12-20T04:23:28.692149+0000","last_undegraded":"2023-12-20T04:23:28.692149+0000","last_fullsized":"2023-12-20T04:23:28.692149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:19.585364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177946+0000","last_change":"2023-12-20T04:23:26.292355+0000","last_active":"2023-12-20T04:23:28.177946+0000","last_peered":"2023-12-20T04:23:28.177946+0000","last_clean":"2023-12-20T04:23:28.177946+0000","last_became_active":"2023-12-20T04:23:26.292011+0000","last_became_peered":"2023-12-20T04:23:26.292011+0000","last_unstale":"2023-12-20T04:23:28.177946+0000","last_undegraded":"2023-12-20T04:23:28.177946+0000","last_fullsized":"2023-12-20T04:23:28.177946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646297+0000","last_change":"2023-12-20T04:23:26.664413+0000","last_active":"2023-12-20T04:23:27.646297+0000","last_peered":"2023-12-20T04:23:27.646297+0000","last_clean":"2023-12-20T04:23:27.646297+0000","last_became_active":"2023-12-20T04:23:26.664071+0000","last_became_peered":"2023-12-20T04:23:26.664071+0000","last_unstale":"2023-12-20T04:23:27.646297+0000","last_undegraded":"2023-12-20T04:23:27.646297+0000","last_fullsized":"2023-12-20T04:23:27.646297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693216+0000","last_change":"2023-12-20T04:23:26.284859+0000","last_active":"2023-12-20T04:23:28.693216+0000","last_peered":"2023-12-20T04:23:28.693216+0000","last_clean":"2023-12-20T04:23:28.693216+0000","last_became_active":"2023-12-20T04:23:26.284584+0000","last_became_peered":"2023-12-20T04:23:26.284584+0000","last_unstale":"2023-12-20T04:23:28.693216+0000","last_undegraded":"2023-12-20T04:23:28.693216+0000","last_fullsized":"2023-12-20T04:23:28.693216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648580+0000","last_change":"2023-12-20T04:23:26.660582+0000","last_active":"2023-12-20T04:23:27.648580+0000","last_peered":"2023-12-20T04:23:27.648580+0000","last_clean":"2023-12-20T04:23:27.648580+0000","last_became_active":"2023-12-20T04:23:26.660268+0000","last_became_peered":"2023-12-20T04:23:26.660268+0000","last_unstale":"2023-12-20T04:23:27.648580+0000","last_undegraded":"2023-12-20T04:23:27.648580+0000","last_fullsized":"2023-12-20T04:23:27.648580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:14.759440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646423+0000","last_change":"2023-12-20T04:23:26.284941+0000","last_active":"2023-12-20T04:23:27.646423+0000","last_peered":"2023-12-20T04:23:27.646423+0000","last_clean":"2023-12-20T04:23:27.646423+0000","last_became_active":"2023-12-20T04:23:26.284623+0000","last_became_peered":"2023-12-20T04:23:26.284623+0000","last_unstale":"2023-12-20T04:23:27.646423+0000","last_undegraded":"2023-12-20T04:23:27.646423+0000","last_fullsized":"2023-12-20T04:23:27.646423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693278+0000","last_change":"2023-12-20T04:23:26.672358+0000","last_active":"2023-12-20T04:23:28.693278+0000","last_peered":"2023-12-20T04:23:28.693278+0000","last_clean":"2023-12-20T04:23:28.693278+0000","last_became_active":"2023-12-20T04:23:26.672111+0000","last_became_peered":"2023-12-20T04:23:26.672111+0000","last_unstale":"2023-12-20T04:23:28.693278+0000","last_undegraded":"2023-12-20T04:23:28.693278+0000","last_fullsized":"2023-12-20T04:23:28.693278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061655+0000","last_change":"2023-12-20T04:23:26.292027+0000","last_active":"2023-12-20T04:23:28.061655+0000","last_peered":"2023-12-20T04:23:28.061655+0000","last_clean":"2023-12-20T04:23:28.061655+0000","last_became_active":"2023-12-20T04:23:26.291668+0000","last_became_peered":"2023-12-20T04:23:26.291668+0000","last_unstale":"2023-12-20T04:23:28.061655+0000","last_undegraded":"2023-12-20T04:23:28.061655+0000","last_fullsized":"2023-12-20T04:23:28.061655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:13.754694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646427+0000","last_change":"2023-12-20T04:23:26.665693+0000","last_active":"2023-12-20T04:23:27.646427+0000","last_peered":"2023-12-20T04:23:27.646427+0000","last_clean":"2023-12-20T04:23:27.646427+0000","last_became_active":"2023-12-20T04:23:26.665421+0000","last_became_peered":"2023-12-20T04:23:26.665421+0000","last_unstale":"2023-12-20T04:23:27.646427+0000","last_undegraded":"2023-12-20T04:23:27.646427+0000","last_fullsized":"2023-12-20T04:23:27.646427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646583+0000","last_change":"2023-12-20T04:23:26.280830+0000","last_active":"2023-12-20T04:23:27.646583+0000","last_peered":"2023-12-20T04:23:27.646583+0000","last_clean":"2023-12-20T04:23:27.646583+0000","last_became_active":"2023-12-20T04:23:26.280522+0000","last_became_peered":"2023-12-20T04:23:26.280522+0000","last_unstale":"2023-12-20T04:23:27.646583+0000","last_undegraded":"2023-12-20T04:23:27.646583+0000","last_fullsized":"2023-12-20T04:23:27.646583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:03.271936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579867+0000","last_change":"2023-12-20T04:23:26.669071+0000","last_active":"2023-12-20T04:23:28.579867+0000","last_peered":"2023-12-20T04:23:28.579867+0000","last_clean":"2023-12-20T04:23:28.579867+0000","last_became_active":"2023-12-20T04:23:26.668801+0000","last_became_peered":"2023-12-20T04:23:26.668801+0000","last_unstale":"2023-12-20T04:23:28.579867+0000","last_undegraded":"2023-12-20T04:23:28.579867+0000","last_fullsized":"2023-12-20T04:23:28.579867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648978+0000","last_change":"2023-12-20T04:23:26.282356+0000","last_active":"2023-12-20T04:23:27.648978+0000","last_peered":"2023-12-20T04:23:27.648978+0000","last_clean":"2023-12-20T04:23:27.648978+0000","last_became_active":"2023-12-20T04:23:26.282046+0000","last_became_peered":"2023-12-20T04:23:26.282046+0000","last_unstale":"2023-12-20T04:23:27.648978+0000","last_undegraded":"2023-12-20T04:23:27.648978+0000","last_fullsized":"2023-12-20T04:23:27.648978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692373+0000","last_change":"2023-12-20T04:23:26.666869+0000","last_active":"2023-12-20T04:23:28.692373+0000","last_peered":"2023-12-20T04:23:28.692373+0000","last_clean":"2023-12-20T04:23:28.692373+0000","last_became_active":"2023-12-20T04:23:26.666606+0000","last_became_peered":"2023-12-20T04:23:26.666606+0000","last_unstale":"2023-12-20T04:23:28.692373+0000","last_undegraded":"2023-12-20T04:23:28.692373+0000","last_fullsized":"2023-12-20T04:23:28.692373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061005+0000","last_change":"2023-12-20T04:23:26.291924+0000","last_active":"2023-12-20T04:23:28.061005+0000","last_peered":"2023-12-20T04:23:28.061005+0000","last_clean":"2023-12-20T04:23:28.061005+0000","last_became_active":"2023-12-20T04:23:26.291445+0000","last_became_peered":"2023-12-20T04:23:26.291445+0000","last_unstale":"2023-12-20T04:23:28.061005+0000","last_undegraded":"2023-12-20T04:23:28.061005+0000","last_fullsized":"2023-12-20T04:23:28.061005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:13.196722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648824+0000","last_change":"2023-12-20T04:23:26.661472+0000","last_active":"2023-12-20T04:23:27.648824+0000","last_peered":"2023-12-20T04:23:27.648824+0000","last_clean":"2023-12-20T04:23:27.648824+0000","last_became_active":"2023-12-20T04:23:26.661072+0000","last_became_peered":"2023-12-20T04:23:26.661072+0000","last_unstale":"2023-12-20T04:23:27.648824+0000","last_undegraded":"2023-12-20T04:23:27.648824+0000","last_fullsized":"2023-12-20T04:23:27.648824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:14.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646334+0000","last_change":"2023-12-20T04:23:26.286742+0000","last_active":"2023-12-20T04:23:27.646334+0000","last_peered":"2023-12-20T04:23:27.646334+0000","last_clean":"2023-12-20T04:23:27.646334+0000","last_became_active":"2023-12-20T04:23:26.286439+0000","last_became_peered":"2023-12-20T04:23:26.286439+0000","last_unstale":"2023-12-20T04:23:27.646334+0000","last_undegraded":"2023-12-20T04:23:27.646334+0000","last_fullsized":"2023-12-20T04:23:27.646334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579841+0000","last_change":"2023-12-20T04:23:26.665515+0000","last_active":"2023-12-20T04:23:28.579841+0000","last_peered":"2023-12-20T04:23:28.579841+0000","last_clean":"2023-12-20T04:23:28.579841+0000","last_became_active":"2023-12-20T04:23:26.664947+0000","last_became_peered":"2023-12-20T04:23:26.664947+0000","last_unstale":"2023-12-20T04:23:28.579841+0000","last_undegraded":"2023-12-20T04:23:28.579841+0000","last_fullsized":"2023-12-20T04:23:28.579841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:18:25.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646417+0000","last_change":"2023-12-20T04:23:26.280703+0000","last_active":"2023-12-20T04:23:27.646417+0000","last_peered":"2023-12-20T04:23:27.646417+0000","last_clean":"2023-12-20T04:23:27.646417+0000","last_became_active":"2023-12-20T04:23:26.280429+0000","last_became_peered":"2023-12-20T04:23:26.280429+0000","last_unstale":"2023-12-20T04:23:27.646417+0000","last_undegraded":"2023-12-20T04:23:27.646417+0000","last_fullsized":"2023-12-20T04:23:27.646417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579858+0000","last_change":"2023-12-20T04:23:26.664971+0000","last_active":"2023-12-20T04:23:28.579858+0000","last_peered":"2023-12-20T04:23:28.579858+0000","last_clean":"2023-12-20T04:23:28.579858+0000","last_became_active":"2023-12-20T04:23:26.664247+0000","last_became_peered":"2023-12-20T04:23:26.664247+0000","last_unstale":"2023-12-20T04:23:28.579858+0000","last_undegraded":"2023-12-20T04:23:28.579858+0000","last_fullsized":"2023-12-20T04:23:28.579858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061365+0000","last_change":"2023-12-20T04:23:26.292375+0000","last_active":"2023-12-20T04:23:28.061365+0000","last_peered":"2023-12-20T04:23:28.061365+0000","last_clean":"2023-12-20T04:23:28.061365+0000","last_became_active":"2023-12-20T04:23:26.292034+0000","last_became_peered":"2023-12-20T04:23:26.292034+0000","last_unstale":"2023-12-20T04:23:28.061365+0000","last_undegraded":"2023-12-20T04:23:28.061365+0000","last_fullsized":"2023-12-20T04:23:28.061365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648275+0000","last_change":"2023-12-20T04:23:26.663174+0000","last_active":"2023-12-20T04:23:27.648275+0000","last_peered":"2023-12-20T04:23:27.648275+0000","last_clean":"2023-12-20T04:23:27.648275+0000","last_became_active":"2023-12-20T04:23:26.662709+0000","last_became_peered":"2023-12-20T04:23:26.662709+0000","last_unstale":"2023-12-20T04:23:27.648275+0000","last_undegraded":"2023-12-20T04:23:27.648275+0000","last_fullsized":"2023-12-20T04:23:27.648275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693257+0000","last_change":"2023-12-20T04:23:26.667112+0000","last_active":"2023-12-20T04:23:28.693257+0000","last_peered":"2023-12-20T04:23:28.693257+0000","last_clean":"2023-12-20T04:23:28.693257+0000","last_became_active":"2023-12-20T04:23:26.666537+0000","last_became_peered":"2023-12-20T04:23:26.666537+0000","last_unstale":"2023-12-20T04:23:28.693257+0000","last_undegraded":"2023-12-20T04:23:28.693257+0000","last_fullsized":"2023-12-20T04:23:28.693257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061363+0000","last_change":"2023-12-20T04:23:26.287011+0000","last_active":"2023-12-20T04:23:28.061363+0000","last_peered":"2023-12-20T04:23:28.061363+0000","last_clean":"2023-12-20T04:23:28.061363+0000","last_became_active":"2023-12-20T04:23:26.286702+0000","last_became_peered":"2023-12-20T04:23:26.286702+0000","last_unstale":"2023-12-20T04:23:28.061363+0000","last_undegraded":"2023-12-20T04:23:28.061363+0000","last_fullsized":"2023-12-20T04:23:28.061363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693236+0000","last_change":"2023-12-20T04:23:26.670705+0000","last_active":"2023-12-20T04:23:28.693236+0000","last_peered":"2023-12-20T04:23:28.693236+0000","last_clean":"2023-12-20T04:23:28.693236+0000","last_became_active":"2023-12-20T04:23:26.670216+0000","last_became_peered":"2023-12-20T04:23:26.670216+0000","last_unstale":"2023-12-20T04:23:28.693236+0000","last_undegraded":"2023-12-20T04:23:28.693236+0000","last_fullsized":"2023-12-20T04:23:28.693236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061565+0000","last_change":"2023-12-20T04:23:26.287007+0000","last_active":"2023-12-20T04:23:28.061565+0000","last_peered":"2023-12-20T04:23:28.061565+0000","last_clean":"2023-12-20T04:23:28.061565+0000","last_became_active":"2023-12-20T04:23:26.286700+0000","last_became_peered":"2023-12-20T04:23:26.286700+0000","last_unstale":"2023-12-20T04:23:28.061565+0000","last_undegraded":"2023-12-20T04:23:28.061565+0000","last_fullsized":"2023-12-20T04:23:28.061565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:03.271936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692365+0000","last_change":"2023-12-20T04:23:26.668234+0000","last_active":"2023-12-20T04:23:28.692365+0000","last_peered":"2023-12-20T04:23:28.692365+0000","last_clean":"2023-12-20T04:23:28.692365+0000","last_became_active":"2023-12-20T04:23:26.667991+0000","last_became_peered":"2023-12-20T04:23:26.667991+0000","last_unstale":"2023-12-20T04:23:28.692365+0000","last_undegraded":"2023-12-20T04:23:28.692365+0000","last_fullsized":"2023-12-20T04:23:28.692365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:24:56.720868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579915+0000","last_change":"2023-12-20T04:23:26.284158+0000","last_active":"2023-12-20T04:23:28.579915+0000","last_peered":"2023-12-20T04:23:28.579915+0000","last_clean":"2023-12-20T04:23:28.579915+0000","last_became_active":"2023-12-20T04:23:26.283866+0000","last_became_peered":"2023-12-20T04:23:26.283866+0000","last_unstale":"2023-12-20T04:23:28.579915+0000","last_undegraded":"2023-12-20T04:23:28.579915+0000","last_fullsized":"2023-12-20T04:23:28.579915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579780+0000","last_change":"2023-12-20T04:23:26.669065+0000","last_active":"2023-12-20T04:23:28.579780+0000","last_peered":"2023-12-20T04:23:28.579780+0000","last_clean":"2023-12-20T04:23:28.579780+0000","last_became_active":"2023-12-20T04:23:26.668822+0000","last_became_peered":"2023-12-20T04:23:26.668822+0000","last_unstale":"2023-12-20T04:23:28.579780+0000","last_undegraded":"2023-12-20T04:23:28.579780+0000","last_fullsized":"2023-12-20T04:23:28.579780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692475+0000","last_change":"2023-12-20T04:23:26.289452+0000","last_active":"2023-12-20T04:23:28.692475+0000","last_peered":"2023-12-20T04:23:28.692475+0000","last_clean":"2023-12-20T04:23:28.692475+0000","last_became_active":"2023-12-20T04:23:26.289223+0000","last_became_peered":"2023-12-20T04:23:26.289223+0000","last_unstale":"2023-12-20T04:23:28.692475+0000","last_undegraded":"2023-12-20T04:23:28.692475+0000","last_fullsized":"2023-12-20T04:23:28.692475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:25.367497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:23:30.633 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:23:30.633 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-20T04:23:30.633 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-20T04:23:30.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-20T04:23:30.634 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-20T04:23:30.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.773+0000 7fe7485b1640 1 Processor -- start 2023-12-20T04:23:30.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.773+0000 7fe7485b1640 1 -- start start 2023-12-20T04:23:30.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe7485b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe7400b6690 0x7fe740144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe7485b1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe740144cd0 0x7fe740155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe7485b1640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7400bc6b0 con 0x7fe7400bcdd0 2023-12-20T04:23:30.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe7485b1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7400a59f0 con 0x7fe740144cd0 2023-12-20T04:23:30.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe7485b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400bc0a0 con 0x7fe7400b6690 2023-12-20T04:23:30.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe746b4e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe740144cd0 0x7fe740155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe745b4c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe7400b6690 0x7fe740144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe746b4e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe740144cd0 0x7fe740155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35792/0 (socket says 172.21.15.40:35792) 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe745b4c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe7400b6690 0x7fe740144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54462/0 (socket says 172.21.15.40:54462) 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe746b4e640 1 -- 172.21.15.40:0/1728331062 learned_addr learned my addr 172.21.15.40:0/1728331062 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe74634d640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe7400bcdd0 0x7fe7400b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43870/0 (socket says 172.21.15.40:43870) 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe746b4e640 1 -- 172.21.15.40:0/1728331062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe7400b6690 msgr2=0x7fe740144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.774+0000 7fe746b4e640 1 --2- 172.21.15.40:0/1728331062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe7400b6690 0x7fe740144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.775+0000 7fe746b4e640 1 -- 172.21.15.40:0/1728331062 >> v1:172.21.15.69:6789/0 conn(0x7fe7400bcdd0 legacy=0x7fe7400b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.775+0000 7fe746b4e640 1 -- 172.21.15.40:0/1728331062 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7400bc340 con 0x7fe740144cd0 2023-12-20T04:23:30.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.775+0000 7fe74534b640 1 -- 172.21.15.40:0/1728331062 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155055396 0 0) 0x7fe7400bc6b0 con 0x7fe7400bcdd0 2023-12-20T04:23:30.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.775+0000 7fe746b4e640 1 --2- 172.21.15.40:0/1728331062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe740144cd0 0x7fe740155340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe738009870 tx=0x7fe73802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4aa4d3abec2ff19 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.775+0000 7fe74534b640 1 -- 172.21.15.40:0/1728331062 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73802f840 con 0x7fe740144cd0 2023-12-20T04:23:30.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe74534b640 1 -- 172.21.15.40:0/1728331062 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73802f9a0 con 0x7fe740144cd0 2023-12-20T04:23:30.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe74534b640 1 -- 172.21.15.40:0/1728331062 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73802fd30 con 0x7fe740144cd0 2023-12-20T04:23:30.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 -- 172.21.15.40:0/1728331062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe740144cd0 msgr2=0x7fe740155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 --2- 172.21.15.40:0/1728331062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe740144cd0 0x7fe740155340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe738009870 tx=0x7fe73802ba20 comp rx=0 tx=0).stop 2023-12-20T04:23:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 -- 172.21.15.40:0/1728331062 shutdown_connections 2023-12-20T04:23:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 --2- 172.21.15.40:0/1728331062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe740144cd0 0x7fe740155340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 --2- 172.21.15.40:0/1728331062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe7400b6690 0x7fe740144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 -- 172.21.15.40:0/1728331062 >> 172.21.15.40:0/1728331062 conn(0x7fe740071e60 msgr2=0x7fe7400c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 -- 172.21.15.40:0/1728331062 shutdown_connections 2023-12-20T04:23:30.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.776+0000 7fe7485b1640 1 -- 172.21.15.40:0/1728331062 wait complete. 2023-12-20T04:23:30.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.777+0000 7fe7485b1640 1 Processor -- start 2023-12-20T04:23:30.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.777+0000 7fe7485b1640 1 -- start start 2023-12-20T04:23:30.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe7485b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7400b6690 0x7fe740146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe7485b1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7400bcdd0 0x7fe74013f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe7485b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe740144cd0 0x7fe7401d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe7485b1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74013fa10 con 0x7fe7400b6690 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe7485b1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401e3370 con 0x7fe7400bcdd0 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe7485b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401e35c0 con 0x7fe740144cd0 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7400b6690 0x7fe740146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7400b6690 0x7fe740146670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57134/0 (socket says 172.21.15.40:57134) 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 -- 172.21.15.40:0/2542979996 learned_addr learned my addr 172.21.15.40:0/2542979996 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe745b4c640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7400bcdd0 0x7fe74013f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe746b4e640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe740144cd0 0x7fe7401d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 -- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe740144cd0 msgr2=0x7fe7401d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe740144cd0 0x7fe7401d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 -- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7400bcdd0 msgr2=0x7fe74013f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7400bcdd0 0x7fe74013f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:30.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 -- 172.21.15.40:0/2542979996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380094d0 con 0x7fe7400b6690 2023-12-20T04:23:30.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.778+0000 7fe74634d640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7400b6690 0x7fe740146670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe73000c8c0 tx=0x7fe73000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.779+0000 7fe73effd640 1 -- 172.21.15.40:0/2542979996 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73000a640 con 0x7fe7400b6690 2023-12-20T04:23:30.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.779+0000 7fe73effd640 1 -- 172.21.15.40:0/2542979996 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73000a7c0 con 0x7fe7400b6690 2023-12-20T04:23:30.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.779+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7401e38a0 con 0x7fe7400b6690 2023-12-20T04:23:30.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.779+0000 7fe73effd640 1 -- 172.21.15.40:0/2542979996 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73000ab70 con 0x7fe7400b6690 2023-12-20T04:23:30.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.779+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7401d39f0 con 0x7fe7400b6690 2023-12-20T04:23:30.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.780+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7401e3dc0 con 0x7fe7400b6690 2023-12-20T04:23:30.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.780+0000 7fe73effd640 1 -- 172.21.15.40:0/2542979996 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe73000acd0 con 0x7fe7400b6690 2023-12-20T04:23:30.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.780+0000 7fe73effd640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe72c06a430 0x7fe72c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:30.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.781+0000 7fe73effd640 1 -- 172.21.15.40:0/2542979996 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7300880a0 con 0x7fe7400b6690 2023-12-20T04:23:30.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.781+0000 7fe745b4c640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe72c06a430 0x7fe72c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:30.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.781+0000 7fe745b4c640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe72c06a430 0x7fe72c06c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7400b8c70 tx=0x7fe734009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:30.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:30.785+0000 7fe73effd640 1 -- 172.21.15.40:0/2542979996 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe7300537d0 con 0x7fe7400b6690 2023-12-20T04:23:31.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.006+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe74004e840 con 0x7fe7400b6690 2023-12-20T04:23:31.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.009+0000 7fe73effd640 1 -- 172.21.15.40:0/2542979996 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169961 (secure 0 0 0) 0x7fe730056df0 con 0x7fe7400b6690 2023-12-20T04:23:31.012 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe72c06a430 msgr2=0x7fe72c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe72c06a430 0x7fe72c06c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe7400b8c70 tx=0x7fe734009190 comp rx=0 tx=0).stop 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7400b6690 msgr2=0x7fe740146670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7400b6690 0x7fe740146670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe73000c8c0 tx=0x7fe73000cd80 comp rx=0 tx=0).stop 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 shutdown_connections 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe72c06a430 0x7fe72c06c8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe740144cd0 0x7fe7401d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7400bcdd0 0x7fe74013f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 --2- 172.21.15.40:0/2542979996 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7400b6690 0x7fe740146670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 >> 172.21.15.40:0/2542979996 conn(0x7fe740071e60 msgr2=0x7fe7400b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 shutdown_connections 2023-12-20T04:23:31.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.012+0000 7fe7485b1640 1 -- 172.21.15.40:0/2542979996 wait complete. 2023-12-20T04:23:31.023 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":88850},{"type":"v1","addr":"172.21.15.69:6833","nonce":88850}]},"active_addr":"172.21.15.69:6833/88850","active_change":"2023-12-20T04:23:06.516514+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":606246599}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3285859374}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2352602094}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":219738230}]}]} 2023-12-20T04:23:31.027 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-20T04:23:31.027 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-20T04:23:31.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.131+0000 7fb93fb55640 1 Processor -- start 2023-12-20T04:23:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.132+0000 7fb93fb55640 1 -- start start 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.132+0000 7fb93fb55640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb9380b6690 0x7fb938144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.132+0000 7fb93fb55640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.132+0000 7fb93fb55640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9380bc6b0 con 0x7fb9380bcdd0 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.132+0000 7fb93fb55640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9380a59f0 con 0x7fb9380b6690 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.132+0000 7fb93fb55640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380bc0a0 con 0x7fb938144cd0 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93e0f2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d0f0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb9380b6690 0x7fb938144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d0f0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb9380b6690 0x7fb938144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35804/0 (socket says 172.21.15.40:35804) 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d8f1640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb9380bcdd0 0x7fb9380b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43872/0 (socket says 172.21.15.40:43872) 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93e0f2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54470/0 (socket says 172.21.15.40:54470) 2023-12-20T04:23:31.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d0f0640 1 -- 172.21.15.40:0/3306623229 learned_addr learned my addr 172.21.15.40:0/3306623229 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d0f0640 1 -- 172.21.15.40:0/3306623229 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 msgr2=0x7fb938155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d0f0640 1 --2- 172.21.15.40:0/3306623229 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d0f0640 1 -- 172.21.15.40:0/3306623229 >> v1:172.21.15.69:6789/0 conn(0x7fb9380bcdd0 legacy=0x7fb9380b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93c8ef640 1 -- 172.21.15.40:0/3306623229 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479793090 0 0) 0x7fb9380bc6b0 con 0x7fb9380bcdd0 2023-12-20T04:23:31.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.133+0000 7fb93d0f0640 1 -- 172.21.15.40:0/3306623229 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380bc340 con 0x7fb9380b6690 2023-12-20T04:23:31.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93d0f0640 1 --2- 172.21.15.40:0/3306623229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380b6690 0x7fb938144790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009870 tx=0x7fb92c02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629a3a416c68161 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93c8ef640 1 -- 172.21.15.40:0/3306623229 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c02f840 con 0x7fb9380b6690 2023-12-20T04:23:31.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93c8ef640 1 -- 172.21.15.40:0/3306623229 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c02f9a0 con 0x7fb9380b6690 2023-12-20T04:23:31.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93c8ef640 1 -- 172.21.15.40:0/3306623229 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c02fd30 con 0x7fb9380b6690 2023-12-20T04:23:31.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93fb55640 1 -- 172.21.15.40:0/3306623229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380b6690 msgr2=0x7fb938144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93fb55640 1 --2- 172.21.15.40:0/3306623229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380b6690 0x7fb938144790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009870 tx=0x7fb92c02ba20 comp rx=0 tx=0).stop 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93fb55640 1 -- 172.21.15.40:0/3306623229 shutdown_connections 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.134+0000 7fb93fb55640 1 --2- 172.21.15.40:0/3306623229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380b6690 0x7fb938144790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.135+0000 7fb93fb55640 1 --2- 172.21.15.40:0/3306623229 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.135+0000 7fb93fb55640 1 -- 172.21.15.40:0/3306623229 >> 172.21.15.40:0/3306623229 conn(0x7fb938071e60 msgr2=0x7fb9380c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.135+0000 7fb93fb55640 1 -- 172.21.15.40:0/3306623229 shutdown_connections 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.135+0000 7fb93fb55640 1 -- 172.21.15.40:0/3306623229 wait complete. 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 Processor -- start 2023-12-20T04:23:31.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 -- start start 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9380b6690 0x7fb93813e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380bcdd0 0x7fb938147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93813ee40 con 0x7fb9380b6690 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93814a4d0 con 0x7fb9380bcdd0 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93fb55640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93814b010 con 0x7fb938144cd0 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93d8f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9380b6690 0x7fb93813e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93d8f1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9380b6690 0x7fb93813e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57146/0 (socket says 172.21.15.40:57146) 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93d8f1640 1 -- 172.21.15.40:0/2799684851 learned_addr learned my addr 172.21.15.40:0/2799684851 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.136+0000 7fb93d0f0640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380bcdd0 0x7fb938147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93e0f2640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93d8f1640 1 -- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 msgr2=0x7fb938149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93d8f1640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93d8f1640 1 -- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380bcdd0 msgr2=0x7fb938147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93d8f1640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380bcdd0 0x7fb938147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93d8f1640 1 -- 172.21.15.40:0/2799684851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c0094d0 con 0x7fb9380b6690 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93d8f1640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9380b6690 0x7fb93813e900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c4d0 tx=0x7fb93000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb9367fc640 1 -- 172.21.15.40:0/2799684851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9300074e0 con 0x7fb9380b6690 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb9367fc640 1 -- 172.21.15.40:0/2799684851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb930007660 con 0x7fb9380b6690 2023-12-20T04:23:31.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93814b2f0 con 0x7fb9380b6690 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb9367fc640 1 -- 172.21.15.40:0/2799684851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930004a20 con 0x7fb9380b6690 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.137+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9381472b0 con 0x7fb9380b6690 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.138+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93804e840 con 0x7fb9380b6690 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.139+0000 7fb9367fc640 1 -- 172.21.15.40:0/2799684851 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb930004b80 con 0x7fb9380b6690 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.139+0000 7fb9367fc640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb92406a430 0x7fb92406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.139+0000 7fb9367fc640 1 -- 172.21.15.40:0/2799684851 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb930087da0 con 0x7fb9380b6690 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.139+0000 7fb93d0f0640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb92406a430 0x7fb92406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.140+0000 7fb93d0f0640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb92406a430 0x7fb92406c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb92c036000 tx=0x7fb92c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.143+0000 7fb9367fc640 1 -- 172.21.15.40:0/2799684851 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb930053440 con 0x7fb9380b6690 2023-12-20T04:23:31.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.320+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb93814b9e0 con 0x7fb9380b6690 2023-12-20T04:23:31.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.321+0000 7fb9367fc640 1 -- 172.21.15.40:0/2799684851 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fb930018090 con 0x7fb9380b6690 2023-12-20T04:23:31.322 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:31.322 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb92406a430 msgr2=0x7fb92406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb92406a430 0x7fb92406c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb92c036000 tx=0x7fb92c008030 comp rx=0 tx=0).stop 2023-12-20T04:23:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9380b6690 msgr2=0x7fb93813e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9380b6690 0x7fb93813e900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c4d0 tx=0x7fb93000c990 comp rx=0 tx=0).stop 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 shutdown_connections 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb92406a430 0x7fb92406c8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb938144cd0 0x7fb938149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9380bcdd0 0x7fb938147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 --2- 172.21.15.40:0/2799684851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9380b6690 0x7fb93813e900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 >> 172.21.15.40:0/2799684851 conn(0x7fb938071e60 msgr2=0x7fb938141b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 shutdown_connections 2023-12-20T04:23:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.323+0000 7fb93fb55640 1 -- 172.21.15.40:0/2799684851 wait complete. 2023-12-20T04:23:31.325 INFO:tasks.ceph.mds.b.smithi069.stderr:2023-12-20T04:23:31.325+0000 7f539c1f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:23:31.335 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-20T04:23:31.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.440+0000 7f4651df0640 1 Processor -- start 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.440+0000 7f4651df0640 1 -- start start 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f4651df0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f464c0b6690 0x7f464c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f4651df0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f4651df0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0bc6b0 con 0x7f464c0bcdd0 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f4651df0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0a59f0 con 0x7f464c0b6690 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f4651df0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0bc0a0 con 0x7f464c144cd0 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f464c0bcdd0 0x7f464c0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52844/0 (socket says 172.21.15.40:52844) 2023-12-20T04:23:31.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464b7fe640 1 -- 172.21.15.40:0/2961295575 learned_addr learned my addr 172.21.15.40:0/2961295575 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464bfff640 1 --2- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464affd640 1 --2- 172.21.15.40:0/2961295575 >> v2:172.21.15.69:3300/0 conn(0x7f464c0b6690 0x7f464c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464a7fc640 1 -- 172.21.15.40:0/2961295575 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771772021 0 0) 0x7f464c0bc6b0 con 0x7f464c0bcdd0 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464a7fc640 1 -- 172.21.15.40:0/2961295575 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4634003520 con 0x7f464c0bcdd0 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464affd640 1 -- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 msgr2=0x7f464c155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464affd640 1 --2- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464affd640 1 -- 172.21.15.40:0/2961295575 >> v1:172.21.15.40:6789/0 conn(0x7f464c0bcdd0 legacy=0x7f464c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464affd640 1 -- 172.21.15.40:0/2961295575 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0bc340 con 0x7f464c0b6690 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.441+0000 7f464bfff640 1 --2- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.442+0000 7f464affd640 1 --2- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 0x7f464c144790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46400097a0 tx=0x7f464002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22eb902622dbc41a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.442+0000 7f464a7fc640 1 -- 172.21.15.40:0/2961295575 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640030800 con 0x7f464c0b6690 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.442+0000 7f464a7fc640 1 -- 172.21.15.40:0/2961295575 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640030960 con 0x7f464c0b6690 2023-12-20T04:23:31.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.442+0000 7f464a7fc640 1 -- 172.21.15.40:0/2961295575 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640030cf0 con 0x7f464c0b6690 2023-12-20T04:23:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 -- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 msgr2=0x7f464c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 --2- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 0x7f464c144790 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46400097a0 tx=0x7f464002b940 comp rx=0 tx=0).stop 2023-12-20T04:23:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 -- 172.21.15.40:0/2961295575 shutdown_connections 2023-12-20T04:23:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 --2- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 --2- 172.21.15.40:0/2961295575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 0x7f464c144790 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 -- 172.21.15.40:0/2961295575 >> 172.21.15.40:0/2961295575 conn(0x7f464c071e60 msgr2=0x7f464c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 -- 172.21.15.40:0/2961295575 shutdown_connections 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.443+0000 7f4651df0640 1 -- 172.21.15.40:0/2961295575 wait complete. 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.444+0000 7f4651df0640 1 Processor -- start 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.444+0000 7f4651df0640 1 -- start start 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f4651df0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 0x7f464c145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f4651df0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c0bcdd0 0x7f464c1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f4651df0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c1e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f4651df0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c143730 con 0x7f464c0bcdd0 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f4651df0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c1d2fd0 con 0x7f464c0b6690 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f4651df0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c1d32b0 con 0x7f464c144cd0 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c0bcdd0 0x7f464c1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c0bcdd0 0x7f464c1431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57156/0 (socket says 172.21.15.40:57156) 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 -- 172.21.15.40:0/2266302747 learned_addr learned my addr 172.21.15.40:0/2266302747 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464b7fe640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 0x7f464c145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464bfff640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c1e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 -- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 msgr2=0x7f464c1e2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c1e2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 -- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 msgr2=0x7f464c145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 0x7f464c145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 -- 172.21.15.40:0/2266302747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009a70 con 0x7f464c0bcdd0 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464bfff640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c1e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.445+0000 7f464affd640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c0bcdd0 0x7f464c1431f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f464002bf50 tx=0x7f4640004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.446+0000 7f4633fff640 1 -- 172.21.15.40:0/2266302747 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464003e040 con 0x7f464c0bcdd0 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.446+0000 7f4633fff640 1 -- 172.21.15.40:0/2266302747 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640039cb0 con 0x7f464c0bcdd0 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.446+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4640009400 con 0x7f464c0bcdd0 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.446+0000 7f4633fff640 1 -- 172.21.15.40:0/2266302747 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640044630 con 0x7f464c0bcdd0 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.446+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c1d3870 con 0x7f464c0bcdd0 2023-12-20T04:23:31.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.447+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c04e840 con 0x7f464c0bcdd0 2023-12-20T04:23:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.447+0000 7f4633fff640 1 -- 172.21.15.40:0/2266302747 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f464004d3b0 con 0x7f464c0bcdd0 2023-12-20T04:23:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.447+0000 7f4633fff640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f463806a430 0x7f463806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.448+0000 7f4633fff640 1 -- 172.21.15.40:0/2266302747 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46400aaf60 con 0x7f464c0bcdd0 2023-12-20T04:23:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.448+0000 7f464b7fe640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f463806a430 0x7f463806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.448+0000 7f464b7fe640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f463806a430 0x7f463806c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f463c0011e0 tx=0x7f463c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.452+0000 7f4633fff640 1 -- 172.21.15.40:0/2266302747 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4640076670 con 0x7f464c0bcdd0 2023-12-20T04:23:31.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.630+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f464c1e29a0 con 0x7f464c0bcdd0 2023-12-20T04:23:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.631+0000 7f4633fff640 1 -- 172.21.15.40:0/2266302747 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f4640006e10 con 0x7f464c0bcdd0 2023-12-20T04:23:31.632 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f463806a430 msgr2=0x7f463806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f463806a430 0x7f463806c8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f463c0011e0 tx=0x7f463c009040 comp rx=0 tx=0).stop 2023-12-20T04:23:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c0bcdd0 msgr2=0x7f464c1431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c0bcdd0 0x7f464c1431f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f464002bf50 tx=0x7f4640004730 comp rx=0 tx=0).stop 2023-12-20T04:23:31.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 shutdown_connections 2023-12-20T04:23:31.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f463806a430 0x7f463806c8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f464c144cd0 0x7f464c1e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f464c0bcdd0 0x7f464c1431f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 --2- 172.21.15.40:0/2266302747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f464c0b6690 0x7f464c145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 >> 172.21.15.40:0/2266302747 conn(0x7f464c071e60 msgr2=0x7f464c0b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 shutdown_connections 2023-12-20T04:23:31.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.633+0000 7f4651df0640 1 -- 172.21.15.40:0/2266302747 wait complete. 2023-12-20T04:23:31.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-20T04:23:31.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-20T04:23:31.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-20T04:23:31.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-20T04:23:31.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-20T04:23:31.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-20T04:23:31.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-20T04:23:31.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-20T04:23:31.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.826+0000 7f7471687640 1 Processor -- start 2023-12-20T04:23:31.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.826+0000 7f7471687640 1 -- start start 2023-12-20T04:23:31.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.827+0000 7f7471687640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7464007140 0x7f746403b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.827+0000 7f7471687640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74640d0a10 0x7f74640d7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.827+0000 7f7471687640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746403aab0 con 0x7f74640d05d0 2023-12-20T04:23:31.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.827+0000 7f7471687640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746403a620 con 0x7f74640d0a10 2023-12-20T04:23:31.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.827+0000 7f7471687640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640d0e30 con 0x7f7464007140 2023-12-20T04:23:31.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f746b7fe640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f74640d05d0 0x7f74640c6e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43876/0 (socket says 172.21.15.40:43876) 2023-12-20T04:23:31.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f746b7fe640 1 -- 172.21.15.40:0/2801895507 learned_addr learned my addr 172.21.15.40:0/2801895507 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f7470e86640 1 --2- 172.21.15.40:0/2801895507 >> v2:172.21.15.40:3300/0 conn(0x7f74640d0a10 0x7f74640d7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f746bfff640 1 --2- 172.21.15.40:0/2801895507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7464007140 0x7f746403b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f7470e86640 1 -- 172.21.15.40:0/2801895507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7464007140 msgr2=0x7f746403b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f7470e86640 1 --2- 172.21.15.40:0/2801895507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7464007140 0x7f746403b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f7470e86640 1 -- 172.21.15.40:0/2801895507 >> v1:172.21.15.69:6789/0 conn(0x7f74640d05d0 legacy=0x7f74640c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.828+0000 7f7470e86640 1 -- 172.21.15.40:0/2801895507 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464039cf0 con 0x7f74640d0a10 2023-12-20T04:23:31.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.829+0000 7f7470e86640 1 --2- 172.21.15.40:0/2801895507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74640d0a10 0x7f74640d7960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f745800ba50 tx=0x7f745802dfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baa2d7b3478cd3c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7f88b2ffd640 1 Processor -- start 2023-12-20T04:23:31.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7f746affd640 1 -- 172.21.15.40:0/2801895507 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745802ed90 con 0x7f74640d0a10 2023-12-20T04:23:31.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7f746affd640 1 -- 172.21.15.40:0/2801895507 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458032070 con 0x7f74640d0a10 2023-12-20T04:23:31.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7f746affd640 1 -- 172.21.15.40:0/2801895507 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458038620 con 0x7f74640d0a10 2023-12-20T04:23:31.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7fa3f8718640 1 Processor -- start 2023-12-20T04:23:31.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7f88b2ffd640 1 -- start start 2023-12-20T04:23:31.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7fbe86dae640 1 Processor -- start 2023-12-20T04:23:31.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7fbe86dae640 1 -- start start 2023-12-20T04:23:31.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.830+0000 7fa3f8718640 1 -- start start 2023-12-20T04:23:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f88b2ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac06b530 0x7f88ac144a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f88b2ffd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f88ac0bc5a0 0x7f88ac14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f88b27fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f88ac14b1f0 0x7f88ac14df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52848/0 (socket says 172.21.15.40:52848) 2023-12-20T04:23:31.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f7471687640 1 -- 172.21.15.40:0/2801895507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74640d0a10 msgr2=0x7f74640d7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f7471687640 1 --2- 172.21.15.40:0/2801895507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74640d0a10 0x7f74640d7960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f745800ba50 tx=0x7f745802dfe0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f372bfff640 1 Processor -- start 2023-12-20T04:23:31.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f7471687640 1 -- 172.21.15.40:0/2801895507 shutdown_connections 2023-12-20T04:23:31.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f7471687640 1 --2- 172.21.15.40:0/2801895507 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74640d0a10 0x7f74640d7960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f7471687640 1 --2- 172.21.15.40:0/2801895507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7464007140 0x7f746403b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f7471687640 1 -- 172.21.15.40:0/2801895507 >> 172.21.15.40:0/2801895507 conn(0x7f746403ef10 msgr2=0x7f746403f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f372bfff640 1 -- start start 2023-12-20T04:23:31.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7fa4acbb9640 1 Processor -- start 2023-12-20T04:23:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7f7471687640 1 -- 172.21.15.40:0/2801895507 shutdown_connections 2023-12-20T04:23:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7f7471687640 1 -- 172.21.15.40:0/2801895507 wait complete. 2023-12-20T04:23:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe86dae640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbe780d9370 0x7fbe7803d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe86dae640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe7803c660 0x7fbe780dfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe86dae640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7802c470 con 0x7fbe7803b970 2023-12-20T04:23:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe86dae640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7802ca30 con 0x7fbe7803c660 2023-12-20T04:23:31.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe86dae640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780077f0 con 0x7fbe780d9370 2023-12-20T04:23:31.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f88b17fa640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f88ac0bc5a0 0x7f88ac14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f88b27fc640 1 -- 172.21.15.40:0/3997787021 learned_addr learned my addr 172.21.15.40:0/3997787021 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:31.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe8534b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe7803c660 0x7fbe780dfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.831+0000 7f88b1ffb640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac06b530 0x7f88ac144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe8534b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe7803c660 0x7fbe780dfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57168/0 (socket says 172.21.15.40:57168) 2023-12-20T04:23:31.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe8534b640 1 -- 172.21.15.40:0/2769176209 learned_addr learned my addr 172.21.15.40:0/2769176209 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f8718640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa3f006ae20 0x7fa3f006fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f8718640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f014bfc0 0x7fa3f014c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f8718640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa3f01521f0 0x7fa3f0152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f8718640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f0071120 con 0x7fa3f006ae20 2023-12-20T04:23:31.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f8718640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f014c940 con 0x7fa3f01521f0 2023-12-20T04:23:31.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f8718640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0065f40 con 0x7fa3f014bfc0 2023-12-20T04:23:31.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe84b4a640 1 --2- 172.21.15.40:0/2769176209 >> v2:172.21.15.69:3300/0 conn(0x7fbe780d9370 0x7fbe7803d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f6cb5640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa3f01521f0 0x7fa3f0152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f6cb5640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa3f01521f0 0x7fa3f0152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35844/0 (socket says 172.21.15.40:35844) 2023-12-20T04:23:31.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f6cb5640 1 -- 172.21.15.40:0/1144875043 learned_addr learned my addr 172.21.15.40:0/1144875043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f64b4640 1 --2- 172.21.15.40:0/1144875043 >> v2:172.21.15.40:3300/0 conn(0x7fa3f006ae20 0x7fa3f006fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa4acbb9640 1 -- start start 2023-12-20T04:23:31.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fa3f5cb3640 1 --2- 172.21.15.40:0/1144875043 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f014bfc0 0x7fa3f014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe8534b640 1 -- 172.21.15.40:0/2769176209 >> v2:172.21.15.69:3300/0 conn(0x7fbe780d9370 msgr2=0x7fbe7803d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe8534b640 1 --2- 172.21.15.40:0/2769176209 >> v2:172.21.15.69:3300/0 conn(0x7fbe780d9370 0x7fbe7803d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe8534b640 1 -- 172.21.15.40:0/2769176209 >> v1:172.21.15.69:6789/0 conn(0x7fbe7803b970 legacy=0x7fbe780070e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7fbe8534b640 1 -- 172.21.15.40:0/2769176209 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7803be00 con 0x7fbe7803c660 2023-12-20T04:23:31.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac14b6a0 con 0x7f88ac14b1f0 2023-12-20T04:23:31.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac0b6ca0 con 0x7f88ac0bc5a0 2023-12-20T04:23:31.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b5660 con 0x7f88ac06b530 2023-12-20T04:23:31.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.832+0000 7f372bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3724007350 0x7f372403ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f372b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3724040820 0x7f37240c8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52854/0 (socket says 172.21.15.40:52854) 2023-12-20T04:23:31.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f372b7fe640 1 -- 172.21.15.40:0/3851658798 learned_addr learned my addr 172.21.15.40:0/3851658798 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:31.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372403cb10 con 0x7f3724040820 2023-12-20T04:23:31.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372403ba20 con 0x7f372403c1e0 2023-12-20T04:23:31.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37240c9420 con 0x7f3724007350 2023-12-20T04:23:31.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f7471687640 1 Processor -- start 2023-12-20T04:23:31.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527037821 0 0) 0x7f371c001110 con 0x7f3724040820 2023-12-20T04:23:31.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3714003520 con 0x7f3724040820 2023-12-20T04:23:31.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f372affd640 1 --2- 172.21.15.40:0/3851658798 >> v2:172.21.15.40:3300/0 conn(0x7f3724007350 0x7f372403ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541089646 0 0) 0x7f88ac14b6a0 con 0x7f88ac14b1f0 2023-12-20T04:23:31.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8898003520 con 0x7f88ac14b1f0 2023-12-20T04:23:31.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7fa3f64b4640 1 -- 172.21.15.40:0/1144875043 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f014bfc0 msgr2=0x7fa3f014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7fa3f64b4640 1 --2- 172.21.15.40:0/1144875043 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f014bfc0 0x7fa3f014c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7fa3f64b4640 1 -- 172.21.15.40:0/1144875043 >> v2:172.21.15.69:3300/0 conn(0x7fa3f01521f0 msgr2=0x7fa3f0152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7fa3f64b4640 1 --2- 172.21.15.40:0/1144875043 >> v2:172.21.15.69:3300/0 conn(0x7fa3f01521f0 0x7fa3f0152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.833+0000 7fa3f64b4640 1 -- 172.21.15.40:0/1144875043 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f0071390 con 0x7fa3f006ae20 2023-12-20T04:23:31.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7fa4a659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa4a003b340 0x7fa4a003a080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52858/0 (socket says 172.21.15.40:52858) 2023-12-20T04:23:31.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7fa4a659c640 1 -- 172.21.15.40:0/4292244861 learned_addr learned my addr 172.21.15.40:0/4292244861 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:31.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7fa3f64b4640 1 --2- 172.21.15.40:0/1144875043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f006ae20 0x7fa3f006fc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0071f00 tx=0x7fa3e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22932ba6cde17864 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7fa4acbb9640 1 --2- 172.21.15.40:0/4292244861 >> v2:172.21.15.69:3300/0 conn(0x7fa4a00c7660 0x7fa4a00d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a0007640 con 0x7fa4a003b340 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970497063 0 0) 0x7f3714003520 con 0x7f3724040820 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 >> v2:172.21.15.40:3300/0 conn(0x7f3724007350 msgr2=0x7f372403ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 --2- 172.21.15.40:0/3851658798 >> v2:172.21.15.40:3300/0 conn(0x7f3724007350 0x7f372403ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 >> v1:172.21.15.69:6789/0 conn(0x7f372403c1e0 legacy=0x7f37240cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372403d2d0 con 0x7f3724040820 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f371c001800 con 0x7f3724040820 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 >> v1:172.21.15.40:6789/0 conn(0x7f3724040820 legacy=0x7f37240c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140039c0 0x7f3714003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37140047c0 0x7f3714004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140051f0 0x7f3714014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c9420 con 0x7f37140051f0 2023-12-20T04:23:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714014960 con 0x7f37140039c0 2023-12-20T04:23:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3714014b20 con 0x7f37140047c0 2023-12-20T04:23:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f372b7fe640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140051f0 0x7f3714014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7fa3f54b2640 1 -- 172.21.15.40:0/1144875043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0031830 con 0x7fa3f006ae20 2023-12-20T04:23:31.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a0006d10 con 0x7fa4a00d0640 2023-12-20T04:23:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f7471687640 1 -- start start 2023-12-20T04:23:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.834+0000 7f7471687640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7464007140 0x7f74640379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7471687640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74640d05d0 0x7f74640cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7471687640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74640d0a10 0x7f7464165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa3f54b2640 1 -- 172.21.15.40:0/1144875043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0031990 con 0x7fa3f006ae20 2023-12-20T04:23:31.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fbe8534b640 1 --2- 172.21.15.40:0/2769176209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780dfc30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe800726e0 tx=0x7fbe800a5970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fdb16b7521008a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7471687640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7464037f20 con 0x7f7464007140 2023-12-20T04:23:31.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00d0ff0 con 0x7fa4a00c7660 2023-12-20T04:23:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7471687640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74640cba80 con 0x7f74640d05d0 2023-12-20T04:23:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7471687640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74640cce70 con 0x7f74640d0a10 2023-12-20T04:23:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4a6d9d640 1 --2- 172.21.15.40:0/4292244861 >> v2:172.21.15.69:3300/0 conn(0x7fa4a00c7660 0x7fa4a00d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4a559a640 1 -- 172.21.15.40:0/4292244861 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273790605 0 0) 0x7fa4a0007640 con 0x7fa4a003b340 2023-12-20T04:23:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74640d0a10 0x7f7464165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74640d0a10 0x7f7464165950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54530/0 (socket says 172.21.15.40:54530) 2023-12-20T04:23:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 -- 172.21.15.40:0/2124873104 learned_addr learned my addr 172.21.15.40:0/2124873104 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fc72f53e640 1 Processor -- start 2023-12-20T04:23:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1349916283 0 0) 0x7f8898003520 con 0x7f88ac14b1f0 2023-12-20T04:23:31.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac06b530 msgr2=0x7f88ac144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f372affd640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140039c0 0x7f3714003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac06b530 0x7f88ac144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 >> v2:172.21.15.69:3300/0 conn(0x7f88ac0bc5a0 msgr2=0x7f88ac14acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 --2- 172.21.15.40:0/3997787021 >> v2:172.21.15.69:3300/0 conn(0x7f88ac0bc5a0 0x7f88ac14acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0b5e70 con 0x7f88ac14b1f0 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f88a40019f0 con 0x7f88ac14b1f0 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 >> v1:172.21.15.40:6789/0 conn(0x7f88ac14b1f0 legacy=0x7f88ac14df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8898003970 0x7f8898003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88980047c0 0x7f8898004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8898005180 0x7f889800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4a559a640 1 -- 172.21.15.40:0/4292244861 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa490003520 con 0x7fa4a003b340 2023-12-20T04:23:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b6ca0 con 0x7f8898003970 2023-12-20T04:23:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b5660 con 0x7f8898005180 2023-12-20T04:23:31.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889800bec0 con 0x7f88980047c0 2023-12-20T04:23:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fbe7f7fe640 1 -- 172.21.15.40:0/2769176209 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800aa8f0 con 0x7fbe7803c660 2023-12-20T04:23:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f372a7fc640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37140047c0 0x7f3714004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fbe7f7fe640 1 -- 172.21.15.40:0/2769176209 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe800aaa50 con 0x7fbe7803c660 2023-12-20T04:23:31.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fbe7f7fe640 1 -- 172.21.15.40:0/2769176209 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800aae60 con 0x7fbe7803c660 2023-12-20T04:23:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4a559a640 1 -- 172.21.15.40:0/4292244861 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107973904 0 0) 0x7fa4a0006d10 con 0x7fa4a00d0640 2023-12-20T04:23:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b27fc640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8898005180 0x7f889800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f88b17fa640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88980047c0 0x7f8898004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa3f54b2640 1 -- 172.21.15.40:0/1144875043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e0031d20 con 0x7fa3f006ae20 2023-12-20T04:23:31.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4a559a640 1 -- 172.21.15.40:0/4292244861 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4a0007640 con 0x7fa4a00d0640 2023-12-20T04:23:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 -- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74640d05d0 msgr2=0x7f74640cb540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-20T04:23:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4a6d9d640 1 -- 172.21.15.40:0/4292244861 >> v1:172.21.15.69:6789/0 conn(0x7fa4a00d0640 legacy=0x7fa4a00c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fa4a6d9d640 1 -- 172.21.15.40:0/4292244861 >> v1:172.21.15.40:6789/0 conn(0x7fa4a003b340 legacy=0x7fa4a003a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74640d05d0 0x7f74640cb540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 -- 172.21.15.40:0/2124873104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7464007140 msgr2=0x7f74640379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7464007140 0x7f74640379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7f7470e86640 1 -- 172.21.15.40:0/2124873104 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745800b6b0 con 0x7f74640d0a10 2023-12-20T04:23:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fa4a6d9d640 1 -- 172.21.15.40:0/4292244861 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a0006ff0 con 0x7fa4a00c7660 2023-12-20T04:23:31.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fe082e8f640 1 Processor -- start 2023-12-20T04:23:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f7470e86640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74640d0a10 0x7f7464165950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f745800bb70 tx=0x7f74580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f88b1ffb640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8898003970 0x7f8898003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fbe86dae640 1 -- 172.21.15.40:0/2769176209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 msgr2=0x7fbe780dfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fbe86dae640 1 --2- 172.21.15.40:0/2769176209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780dfc30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe800726e0 tx=0x7fbe800a5970 comp rx=0 tx=0).stop 2023-12-20T04:23:31.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fa3f8718640 1 -- 172.21.15.40:0/1144875043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f006ae20 msgr2=0x7fa3f006fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fa3f8718640 1 --2- 172.21.15.40:0/1144875043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f006ae20 0x7fa3f006fc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0071f00 tx=0x7fa3e002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.835+0000 7fc72f53e640 1 -- start start 2023-12-20T04:23:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458043640 con 0x7f74640d0a10 2023-12-20T04:23:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fc72f53e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7280b60b0 0x7fc7280b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fc72f53e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72806f490 con 0x7fc72814c590 2023-12-20T04:23:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fc72f53e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7280b9210 con 0x7fc72806fce0 2023-12-20T04:23:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fc72f53e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280b8600 con 0x7fc7280b60b0 2023-12-20T04:23:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f88b17fa640 1 -- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8898005180 msgr2=0x7f889800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f88b17fa640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8898005180 0x7f889800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7f88b17fa640 1 -- 172.21.15.40:0/3997787021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8898003970 msgr2=0x7f8898003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7f88b17fa640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8898003970 0x7f8898003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7f7471687640 1 -- 172.21.15.40:0/2124873104 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74640cd110 con 0x7f74640d0a10 2023-12-20T04:23:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa4a6d9d640 1 --2- 172.21.15.40:0/4292244861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00c7660 0x7fa4a00d0ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56ee12c2f4aaa41 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7f7471687640 1 -- 172.21.15.40:0/2124873104 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74640cd690 con 0x7f74640d0a10 2023-12-20T04:23:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74580437a0 con 0x7f74640d0a10 2023-12-20T04:23:31.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7fe082e8f640 1 -- start start 2023-12-20T04:23:31.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fc72dadb640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc72806fce0 0x7fc728070110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43900/0 (socket says 172.21.15.40:43900) 2023-12-20T04:23:31.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fc72dadb640 1 -- 172.21.15.40:0/2282697525 learned_addr learned my addr 172.21.15.40:0/2282697525 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:31.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7458043b10 con 0x7f74640d0a10 2023-12-20T04:23:31.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fbe86dae640 1 -- 172.21.15.40:0/2769176209 shutdown_connections 2023-12-20T04:23:31.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fbe86dae640 1 --2- 172.21.15.40:0/2769176209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780dfc30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa4a559a640 1 -- 172.21.15.40:0/4292244861 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49802f810 con 0x7fa4a00c7660 2023-12-20T04:23:31.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fbe86dae640 1 --2- 172.21.15.40:0/2769176209 >> v2:172.21.15.69:3300/0 conn(0x7fbe780d9370 0x7fbe7803d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fbe86dae640 1 -- 172.21.15.40:0/2769176209 >> 172.21.15.40:0/2769176209 conn(0x7fbe78043290 msgr2=0x7fbe780436a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe082e8f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe07c0b3900 0x7fe07c0bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe082e8f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c14abd0 0x7fe07c155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe082e8f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c0bae20 con 0x7fe07c06a470 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe082e8f640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0c1220 con 0x7fe07c0b3900 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe082e8f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0bf900 con 0x7fe07c14abd0 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f372a7fc640 1 -- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140039c0 msgr2=0x7f3714003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f372a7fc640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140039c0 0x7f3714003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f372a7fc640 1 -- 172.21.15.40:0/3851658798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140051f0 msgr2=0x7f3714014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f372a7fc640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37140051f0 0x7f3714014190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f372a7fc640 1 -- 172.21.15.40:0/3851658798 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714003520 con 0x7f37140047c0 2023-12-20T04:23:31.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.836+0000 7f372b7fe640 1 -- 172.21.15.40:0/3851658798 reap_dead start 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa4a559a640 1 -- 172.21.15.40:0/4292244861 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49802f970 con 0x7fa4a00c7660 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa4a559a640 1 -- 172.21.15.40:0/4292244861 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49802fd00 con 0x7fa4a00c7660 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa3f8718640 1 -- 172.21.15.40:0/1144875043 shutdown_connections 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa3f8718640 1 --2- 172.21.15.40:0/1144875043 >> v2:172.21.15.69:3300/0 conn(0x7fa3f01521f0 0x7fa3f0152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa3f8718640 1 --2- 172.21.15.40:0/1144875043 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f014bfc0 0x7fa3f014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa3f8718640 1 --2- 172.21.15.40:0/1144875043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f006ae20 0x7fa3f006fc60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fa3f8718640 1 -- 172.21.15.40:0/1144875043 >> 172.21.15.40:0/1144875043 conn(0x7fa3f00b8f20 msgr2=0x7fa3f00b9330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fa3f8718640 1 -- 172.21.15.40:0/1144875043 shutdown_connections 2023-12-20T04:23:31.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fbe86dae640 1 -- 172.21.15.40:0/2769176209 shutdown_connections 2023-12-20T04:23:31.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fbe86dae640 1 -- 172.21.15.40:0/2769176209 wait complete. 2023-12-20T04:23:31.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00c7660 msgr2=0x7fa4a00d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fa4acbb9640 1 --2- 172.21.15.40:0/4292244861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00c7660 0x7fa4a00d0ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4980097a0 tx=0x7fa49802b9f0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe07bfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe07c0b3900 0x7fe07c0bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe07bfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe07c0b3900 0x7fe07c0bb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35888/0 (socket says 172.21.15.40:35888) 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7fe080c2b640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe07c06a470 0x7fe07c148040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43904/0 (socket says 172.21.15.40:43904) 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe080c2b640 1 -- 172.21.15.40:0/1963661842 learned_addr learned my addr 172.21.15.40:0/1963661842 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860752229 0 0) 0x7fc72806f490 con 0x7fc72814c590 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc714003520 con 0x7fc72814c590 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118580955 0 0) 0x7fc7280b9210 con 0x7fc72806fce0 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72806f490 con 0x7fc72806fce0 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc72cad9640 1 --2- 172.21.15.40:0/2282697525 >> v2:172.21.15.40:3300/0 conn(0x7fc7280b60b0 0x7fc7280b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4033731228 0 0) 0x7fc714003520 con 0x7fc72814c590 2023-12-20T04:23:31.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 >> v2:172.21.15.40:3300/0 conn(0x7fc7280b60b0 msgr2=0x7fc7280b80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 --2- 172.21.15.40:0/2282697525 >> v2:172.21.15.40:3300/0 conn(0x7fc7280b60b0 0x7fc7280b80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 >> v1:172.21.15.69:6789/0 conn(0x7fc72806fce0 legacy=0x7fc728070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7280b64f0 con 0x7fc72814c590 2023-12-20T04:23:31.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.837+0000 7f88b17fa640 1 -- 172.21.15.40:0/3997787021 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898003520 con 0x7f88980047c0 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7fc724001670 con 0x7fc72814c590 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 >> v1:172.21.15.40:6789/0 conn(0x7fc72814c590 legacy=0x7fc7280b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714004b60 0x7fc714004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc714003760 0x7fc714003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc714004120 0x7fc71400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280b8600 con 0x7fc714004b60 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71400c050 con 0x7fc714004120 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71400c210 con 0x7fc714003760 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72cad9640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc714003760 0x7fc714003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72d2da640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714004b60 0x7fc714004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 shutdown_connections 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fa4acbb9640 1 --2- 172.21.15.40:0/4292244861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00c7660 0x7fa4a00d0ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe07b7fe640 1 -- 172.21.15.40:0/1963661842 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045764161 0 0) 0x7fe07c0bae20 con 0x7fe07c06a470 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe07b7fe640 1 -- 172.21.15.40:0/1963661842 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe064003520 con 0x7fe07c06a470 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe08142c640 1 --2- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c14abd0 0x7fe07c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe07bfff640 1 -- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c14abd0 msgr2=0x7fe07c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe07bfff640 1 --2- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c14abd0 0x7fe07c155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe07bfff640 1 -- 172.21.15.40:0/1963661842 >> v1:172.21.15.69:6789/0 conn(0x7fe07c06a470 legacy=0x7fe07c148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7fe07bfff640 1 -- 172.21.15.40:0/1963661842 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c14b080 con 0x7fe07c0b3900 2023-12-20T04:23:31.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 >> 172.21.15.40:0/4292244861 conn(0x7fa4a00061f0 msgr2=0x7fa4a0006600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7f372a7fc640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37140047c0 0x7f3714004c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3720003db0 tx=0x7f37140057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47b5aaa2b0d5caa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720032600 con 0x7f37140047c0 2023-12-20T04:23:31.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372002e050 con 0x7f37140047c0 2023-12-20T04:23:31.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f3729ffb640 1 -- 172.21.15.40:0/3851658798 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3720032a20 con 0x7f37140047c0 2023-12-20T04:23:31.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fbe86dae640 1 Processor -- start 2023-12-20T04:23:31.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fbe86dae640 1 -- start start 2023-12-20T04:23:31.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 shutdown_connections 2023-12-20T04:23:31.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fa4acbb9640 1 -- 172.21.15.40:0/4292244861 wait complete. 2023-12-20T04:23:31.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7458043c70 con 0x7f74640d0a10 2023-12-20T04:23:31.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72cad9640 1 -- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc714004120 msgr2=0x7fc71400ba00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-20T04:23:31.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72cad9640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc714004120 0x7fc71400ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72cad9640 1 -- 172.21.15.40:0/2282697525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714004b60 msgr2=0x7fc714004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:31.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72cad9640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714004b60 0x7fc714004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72cad9640 1 -- 172.21.15.40:0/2282697525 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7280b64f0 con 0x7fc714003760 2023-12-20T04:23:31.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fc72dadb640 1 -- 172.21.15.40:0/2282697525 reap_dead start 2023-12-20T04:23:31.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7fa3f8718640 1 -- 172.21.15.40:0/1144875043 wait complete. 2023-12-20T04:23:31.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37140047c0 msgr2=0x7f3714004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f372bfff640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37140047c0 0x7f3714004c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3720003db0 tx=0x7f37140057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 shutdown_connections 2023-12-20T04:23:31.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f372bfff640 1 --2- 172.21.15.40:0/3851658798 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f37140047c0 0x7f3714004c40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 >> 172.21.15.40:0/3851658798 conn(0x7f3724041000 msgr2=0x7f37240413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 shutdown_connections 2023-12-20T04:23:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7f88b17fa640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88980047c0 0x7f8898004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f889c009a90 tx=0x7f88980057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc124ac1798e12a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c02c6b0 con 0x7f88980047c0 2023-12-20T04:23:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c02c810 con 0x7f88980047c0 2023-12-20T04:23:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.838+0000 7f88b0ff9640 1 -- 172.21.15.40:0/3997787021 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c02cba0 con 0x7f88980047c0 2023-12-20T04:23:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88980047c0 msgr2=0x7f8898004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f88b2ffd640 1 --2- 172.21.15.40:0/3997787021 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88980047c0 0x7f8898004c40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f889c009a90 tx=0x7f88980057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f88b27fc640 1 -- 172.21.15.40:0/3997787021 reap_dead start 2023-12-20T04:23:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 shutdown_connections 2023-12-20T04:23:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 >> 172.21.15.40:0/3997787021 conn(0x7f88ac0c0090 msgr2=0x7f88ac0c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 shutdown_connections 2023-12-20T04:23:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7f88b2ffd640 1 -- 172.21.15.40:0/3997787021 wait complete. 2023-12-20T04:23:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.839+0000 7f7471687640 1 -- 172.21.15.40:0/2124873104 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f744c000fc0 con 0x7f74640d0a10 2023-12-20T04:23:31.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7f7468ff9640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f745006a500 0x7f745006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7f372bfff640 1 -- 172.21.15.40:0/3851658798 wait complete. 2023-12-20T04:23:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7f746bfff640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f745006a500 0x7f745006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7fbe86dae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7fe07bfff640 1 --2- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe07c0b3900 0x7fe07c0bb2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe074009dc0 tx=0x7fe0740346e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0513b6128e122cc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.840+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74580ad450 con 0x7f74640d0a10 2023-12-20T04:23:31.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fc72cad9640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc714003760 0x7fc714003be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc718009ac0 tx=0x7fc7140057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9356cadf80e965c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7f7468ff9640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7f7450072720 0x7f7450074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fe07b7fe640 1 -- 172.21.15.40:0/1963661842 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074007740 con 0x7fe07c0b3900 2023-12-20T04:23:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fe07b7fe640 1 -- 172.21.15.40:0/1963661842 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074037050 con 0x7fe07c0b3900 2023-12-20T04:23:31.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fe07b7fe640 1 -- 172.21.15.40:0/1963661842 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074007b00 con 0x7fe07c0b3900 2023-12-20T04:23:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57240/0 (socket says 172.21.15.40:57240) 2023-12-20T04:23:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 -- 172.21.15.40:0/1178972411 learned_addr learned my addr 172.21.15.40:0/1178972411 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 --> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74500751f0 con 0x7f7450072720 2023-12-20T04:23:31.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe86dae640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe780d9370 0x7fbe780ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7f746bfff640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f745006a500 0x7f745006c9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f746c072ab0 tx=0x7f746c06e040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe86dae640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbe780d8430 0x7fbe780c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe86dae640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780cab80 con 0x7fbe7803c660 2023-12-20T04:23:31.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe86dae640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780c62c0 con 0x7fbe780d9370 2023-12-20T04:23:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71802c6b0 con 0x7fc714003760 2023-12-20T04:23:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fa3f8718640 1 Processor -- start 2023-12-20T04:23:31.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71802c810 con 0x7fc714003760 2023-12-20T04:23:31.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fc71ffff640 1 -- 172.21.15.40:0/2282697525 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71802cba0 con 0x7fc714003760 2023-12-20T04:23:31.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7f746b7fe640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7f7450072720 0x7f7450074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fa3f8718640 1 -- start start 2023-12-20T04:23:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe86dae640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780c5990 con 0x7fbe780d8430 2023-12-20T04:23:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe7ffff640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe780d9370 0x7fbe780ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 -- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbe780d8430 msgr2=0x7fbe780c3c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-20T04:23:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbe780d8430 0x7fbe780c3c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 -- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe780d9370 msgr2=0x7fbe780ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe780d9370 0x7fbe780ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fbe84b4a640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe80072d50 con 0x7fbe7803c660 2023-12-20T04:23:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7fa4acbb9640 1 Processor -- start 2023-12-20T04:23:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.841+0000 7f88b2ffd640 1 Processor -- start 2023-12-20T04:23:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f88b2ffd640 1 -- start start 2023-12-20T04:23:31.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7fa4acbb9640 1 -- start start 2023-12-20T04:23:31.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7fbe84b4a640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780c8210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00eb70 tx=0x7fbe6c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f372bfff640 1 Processor -- start 2023-12-20T04:23:31.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f372bfff640 1 -- start start 2023-12-20T04:23:31.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f88b2ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88980047c0 0x7f88ac0b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7fc72f53e640 1 -- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc714003760 msgr2=0x7fc714003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7fc72f53e640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc714003760 0x7fc714003be0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc718009ac0 tx=0x7fc7140057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f88b2ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac1e3030 0x7f88ac1e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f88b2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88ac145370 0x7f88ac1457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f88b2ffd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b9f60 con 0x7f88ac145370 2023-12-20T04:23:31.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f88b2ffd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac1492b0 con 0x7f88980047c0 2023-12-20T04:23:31.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f88b2ffd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac14a3b0 con 0x7f88ac1e3030 2023-12-20T04:23:31.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74580af9b0 con 0x7f74640d0a10 2023-12-20T04:23:31.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b1ffb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88980047c0 0x7f88ac0b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88ac145370 0x7f88ac1457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88ac145370 0x7f88ac1457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57250/0 (socket says 172.21.15.40:57250) 2023-12-20T04:23:31.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4acbb9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a003b340 0x7fa4a00342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 -- 172.21.15.40:0/2319188123 learned_addr learned my addr 172.21.15.40:0/2319188123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fe082e8f640 1 -- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe07c0b3900 msgr2=0x7fe07c0bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fe082e8f640 1 --2- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe07c0b3900 0x7fe07c0bb2b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe074009dc0 tx=0x7fe0740346e0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4acbb9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4a00c7660 0x7fa4a0030b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fc72f53e640 1 -- 172.21.15.40:0/2282697525 shutdown_connections 2023-12-20T04:23:31.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4a659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a003b340 0x7fa4a00342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4a659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a003b340 0x7fa4a00342b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57258/0 (socket says 172.21.15.40:57258) 2023-12-20T04:23:31.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fc72f53e640 1 --2- 172.21.15.40:0/2282697525 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc714003760 0x7fc714003be0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fc72f53e640 1 -- 172.21.15.40:0/2282697525 >> 172.21.15.40:0/2282697525 conn(0x7fc728069ba0 msgr2=0x7fc728069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4a659c640 1 -- 172.21.15.40:0/1818152762 learned_addr learned my addr 172.21.15.40:0/1818152762 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4acbb9640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00d0640 0x7fa4a00cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b17fa640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac1e3030 0x7f88ac1e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00c8820 con 0x7fa4a003b340 2023-12-20T04:23:31.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa4a5d9b640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4a00c7660 0x7fa4a0030b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f746b7fe640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7f7450072720 0x7f7450074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f372bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140047c0 0x7f37240c1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 -- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac1e3030 msgr2=0x7f88ac1e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f88ac1e3030 0x7f88ac1e3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 -- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88980047c0 msgr2=0x7f88ac0b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88980047c0 0x7f88ac0b9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa3f8718640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3f006ae20 0x7fa3f0151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f88b27fc640 1 -- 172.21.15.40:0/2319188123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac1486e0 con 0x7f88ac145370 2023-12-20T04:23:31.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7f372bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37240c7220 0x7f372402a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fa3f8718640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f014bfc0 0x7fa3f01e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fe082e8f640 1 -- 172.21.15.40:0/1963661842 shutdown_connections 2023-12-20T04:23:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fe082e8f640 1 --2- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe07c0b3900 0x7fe07c0bb2b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fe082e8f640 1 --2- 172.21.15.40:0/1963661842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c14abd0 0x7fe07c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fe082e8f640 1 -- 172.21.15.40:0/1963661842 >> 172.21.15.40:0/1963661842 conn(0x7fe07c0c0270 msgr2=0x7fe07c0c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa3f64b4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3f006ae20 0x7fa3f0151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa3f64b4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3f006ae20 0x7fa3f0151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35932/0 (socket says 172.21.15.40:35932) 2023-12-20T04:23:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372bfff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f372402a550 0x7f37240cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140047c0 0x7f37240c1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fe082e8f640 1 -- 172.21.15.40:0/1963661842 shutdown_connections 2023-12-20T04:23:31.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4a6d9d640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00d0640 0x7fa4a00cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f88b27fc640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88ac145370 0x7f88ac1457f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0b6f00 tx=0x7f88a400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00caf90 con 0x7fa4a00d0640 2023-12-20T04:23:31.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0165640 con 0x7fa4a00c7660 2023-12-20T04:23:31.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fe082e8f640 1 -- 172.21.15.40:0/1963661842 wait complete. 2023-12-20T04:23:31.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== osd.3 v2:172.21.15.40:6824/89423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f74500751f0 con 0x7f7450072720 2023-12-20T04:23:31.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa3f64b4640 1 -- 172.21.15.40:0/1102896228 learned_addr learned my addr 172.21.15.40:0/1102896228 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37240c7220 0x7f372402a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37240c7220 0x7f372402a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57264/0 (socket says 172.21.15.40:57264) 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372bfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c3810 con 0x7f37240c7220 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372bfff640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c2390 con 0x7f37140047c0 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372bfff640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37240c7680 con 0x7f372402a550 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372a7fc640 1 -- 172.21.15.40:0/3297172677 learned_addr learned my addr 172.21.15.40:0/3297172677 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372b7fe640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f372402a550 0x7f37240cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f372affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140047c0 0x7f37240c1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35926/0 (socket says 172.21.15.40:35926) 2023-12-20T04:23:31.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa3f5cb3640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f014bfc0 0x7fa3f01e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00ed80 con 0x7fbe7803c660 2023-12-20T04:23:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.842+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00cc30 con 0x7fbe7803c660 2023-12-20T04:23:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00eee0 con 0x7fbe7803c660 2023-12-20T04:23:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.843+0000 7fbe86dae640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe780c5c70 con 0x7fbe7803c660 2023-12-20T04:23:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a400acd0 con 0x7f88ac145370 2023-12-20T04:23:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a400ae50 con 0x7f88ac145370 2023-12-20T04:23:31.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a4013630 con 0x7f88ac145370 2023-12-20T04:23:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4a6d9d640 1 -- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4a00c7660 msgr2=0x7fa4a0030b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7f88b2ffd640 1 -- 172.21.15.40:0/2319188123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac1e39d0 con 0x7f88ac145370 2023-12-20T04:23:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa3f8718640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f01521f0 0x7fa3f00b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4a6d9d640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa4a00c7660 0x7fa4a0030b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f372affd640 1 -- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f372402a550 msgr2=0x7f37240cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f372affd640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f372402a550 0x7f37240cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f372affd640 1 -- 172.21.15.40:0/3297172677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37240c7220 msgr2=0x7f372402a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f372affd640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37240c7220 0x7f372402a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f372affd640 1 -- 172.21.15.40:0/3297172677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37240c20b0 con 0x7f37140047c0 2023-12-20T04:23:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f372a7fc640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37240c7220 0x7f372402a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:31.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4a6d9d640 1 -- 172.21.15.40:0/1818152762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a003b340 msgr2=0x7fa4a00342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f8718640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0151fd0 con 0x7fa3f014bfc0 2023-12-20T04:23:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f8718640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00b50d0 con 0x7fa3f006ae20 2023-12-20T04:23:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f8718640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f01e7ba0 con 0x7fa3f01521f0 2023-12-20T04:23:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fe082e8f640 1 Processor -- start 2023-12-20T04:23:31.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f372affd640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140047c0 0x7f37240c1a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f372c04eda0 tx=0x7f372c066fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4a6d9d640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4a003b340 0x7fa4a00342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.844+0000 7fa4a6d9d640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498009400 con 0x7fa4a00d0640 2023-12-20T04:23:31.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa4a6d9d640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00d0640 0x7fa4a00cb700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa498033000 tx=0x7fa498004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49803f950 con 0x7fa4a00d0640 2023-12-20T04:23:31.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fe082e8f640 1 -- start start 2023-12-20T04:23:31.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f88b2ffd640 1 -- 172.21.15.40:0/2319188123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac148980 con 0x7f88ac145370 2023-12-20T04:23:31.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f6cb5640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f01521f0 0x7fa3f00b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f64b4640 1 -- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f01521f0 msgr2=0x7fa3f00b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f64b4640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3f01521f0 0x7fa3f00b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f64b4640 1 -- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f014bfc0 msgr2=0x7fa3f01e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f64b4640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3f014bfc0 0x7fa3f01e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7fa3f64b4640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0009400 con 0x7fa3f006ae20 2023-12-20T04:23:31.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fc72f53e640 1 -- 172.21.15.40:0/2282697525 shutdown_connections 2023-12-20T04:23:31.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c08f070 con 0x7f37140047c0 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.845+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c04eee0 con 0x7f37140047c0 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7f372bfff640 1 -- 172.21.15.40:0/3297172677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240c3a90 con 0x7f37140047c0 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c08f070 con 0x7f37140047c0 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fa3f64b4640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3f006ae20 0x7fa3f0151a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009890 tx=0x7fa3e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e003a630 con 0x7fa3f006ae20 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e003a790 con 0x7fa3f006ae20 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e003ab20 con 0x7fa3f006ae20 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fa3f8718640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f01e7e80 con 0x7fa3f006ae20 2023-12-20T04:23:31.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fa3f8718640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f01e78c0 con 0x7fa3f006ae20 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fbe86dae640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe780d7760 con 0x7fbe7803c660 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fbe86dae640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe780c5b00 con 0x7fbe7803c660 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a00c7f20 con 0x7fa4a00d0640 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a00cb1e0 con 0x7fa4a00d0640 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa498043070 con 0x7fa4a00d0640 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49803fcf0 con 0x7fa4a00d0640 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa49804a480 con 0x7fa4a00d0640 2023-12-20T04:23:31.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fa494ff9640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa48c000fc0 con 0x7fa4a00d0640 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fe082e8f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe07c06a470 0x7fe07c0b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fe082e8f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c0b3900 0x7fe07c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fe082e8f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe07c14abd0 0x7fe07c0b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fe082e8f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b4da0 con 0x7fe07c14abd0 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fe082e8f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c148bc0 con 0x7fe07c06a470 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fe08142c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe07c14abd0 0x7fe07c0b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fe082e8f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b5ef0 con 0x7fe07c0b3900 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fe08142c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe07c14abd0 0x7fe07c0b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57276/0 (socket says 172.21.15.40:57276) 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7fe08142c640 1 -- 172.21.15.40:0/2781617938 learned_addr learned my addr 172.21.15.40:0/2781617938 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fe08142c640 1 -- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c0b3900 msgr2=0x7fe07c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fe08142c640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe07c0b3900 0x7fe07c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fe08142c640 1 -- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe07c06a470 msgr2=0x7fe07c0b4860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-20T04:23:31.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fe08142c640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe07c06a470 0x7fe07c0b4860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fe08142c640 1 -- 172.21.15.40:0/2781617938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074009a70 con 0x7fe07c14abd0 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7fc72f53e640 1 -- 172.21.15.40:0/2282697525 wait complete. 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fc72f53e640 1 Processor -- start 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fc72f53e640 1 -- start start 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72f53e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714003760 0x7fc7280b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72f53e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7281e3980 0x7fc728145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72f53e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc7281e3de0 0x7fc728146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72f53e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280b4f10 con 0x7fc714003760 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72f53e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280a9c30 con 0x7fc7281e3980 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72f53e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280a8550 con 0x7fc7281e3de0 2023-12-20T04:23:31.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72d2da640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714003760 0x7fc7280b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72d2da640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714003760 0x7fc7280b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57290/0 (socket says 172.21.15.40:57290) 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72d2da640 1 -- 172.21.15.40:0/682465982 learned_addr learned my addr 172.21.15.40:0/682465982 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72dadb640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc7281e3de0 0x7fc728146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7fc72cad9640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7281e3980 0x7fc728145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.846+0000 7f372bfff640 1 -- 172.21.15.40:0/3297172677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37240c5b00 con 0x7f37140047c0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.847+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3724040c70 con 0x7f37140047c0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f372c0735d0 con 0x7f37140047c0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f37137fe640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f371806a4c0 0x7f371806c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f372a7fc640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f371806a4c0 0x7f371806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f372c0d0a90 con 0x7f37140047c0 2023-12-20T04:23:31.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f37137fe640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f37180731f0 0x7f3718075690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 --> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3718075d60 con 0x7f37180731f0 2023-12-20T04:23:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88a4013790 con 0x7f88ac145370 2023-12-20T04:23:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f88b2ffd640 1 -- 172.21.15.40:0/2319188123 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f88ac0b6430 con 0x7f88ac145370 2023-12-20T04:23:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f88a27fc640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f889006a480 0x7f889006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f88b1ffb640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f889006a480 0x7f889006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88a4058180 con 0x7f88ac145370 2023-12-20T04:23:31.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3e003ac80 con 0x7fa3f006ae20 2023-12-20T04:23:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f88a27fc640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f8890072620 0x7f8890074a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 --> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f88900750f0 con 0x7f8890072620 2023-12-20T04:23:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88a4053dc0 con 0x7f88ac145370 2023-12-20T04:23:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72d2da640 1 -- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc7281e3de0 msgr2=0x7fc728146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7f88b17fa640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f8890072620 0x7f8890074a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.848+0000 7fe08142c640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe07c14abd0 0x7fe07c0b1cb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe07000d600 tx=0x7fe07000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0700125f0 con 0x7fe07c14abd0 2023-12-20T04:23:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe070012750 con 0x7fe07c14abd0 2023-12-20T04:23:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070012ae0 con 0x7fe07c14abd0 2023-12-20T04:23:31.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa496ffd640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa48806a500 0x7fa48806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.849+0000 7f372b7fe640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f37180731f0 0x7f3718075690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f372c0d03f0 con 0x7f37140047c0 2023-12-20T04:23:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3f00af8d0 con 0x7fa3f006ae20 2023-12-20T04:23:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fe082e8f640 1 -- 172.21.15.40:0/2781617938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c0b64b0 con 0x7fe07c14abd0 2023-12-20T04:23:31.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa4a659c640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa48806a500 0x7fa48806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa3e6ffd640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa3d406a500 0x7fa3d406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fe082e8f640 1 -- 172.21.15.40:0/2781617938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c0b6a70 con 0x7fe07c14abd0 2023-12-20T04:23:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7f372b7fe640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f37180731f0 0x7f3718075690 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa498045070 con 0x7fa4a00d0640 2023-12-20T04:23:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa496ffd640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fa488072720 0x7fa488074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4880751f0 con 0x7fa488072720 2023-12-20T04:23:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4980b3240 con 0x7fa4a00d0640 2023-12-20T04:23:31.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbe6c013470 con 0x7fbe7803c660 2023-12-20T04:23:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3e00aa410 con 0x7fa3f006ae20 2023-12-20T04:23:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fa3e6ffd640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7fa3d4072720 0x7fa3d4074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fa4a5d9b640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fa488072720 0x7fa488074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fa3f6cb5640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7fa3d4072720 0x7fa3d4074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fbe7d7fa640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbe6406a500 0x7fbe6406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe6c0881f0 con 0x7fbe7803c660 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fbe7ffff640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbe6406a500 0x7fbe6406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fbe7d7fa640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7fbe640725b0 0x7fbe640749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe64075080 con 0x7fbe640725b0 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe6c089e90 con 0x7fbe7803c660 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7f88b1ffb640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f889006a480 0x7f889006c940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f88ac06bf40 tx=0x7f88a8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7f88b17fa640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f8890072620 0x7f8890074a40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fe082e8f640 1 -- 172.21.15.40:0/2781617938 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe05c000fc0 con 0x7fe07c14abd0 2023-12-20T04:23:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fa3f5cb3640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa3d406a500 0x7fa3d406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.851+0000 7fa4a5d9b640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fa488072720 0x7fa488074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fbe8534b640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7fbe640725b0 0x7fbe640749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== osd.6 v2:172.21.15.69:6800/89420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3718075d60 con 0x7f37180731f0 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7f372a7fc640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f371806a4c0 0x7f371806c980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f372415fae0 tx=0x7f3720009030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72d2da640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc7281e3de0 0x7fc728146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72d2da640 1 -- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7281e3980 msgr2=0x7fc728145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72d2da640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7281e3980 0x7fc728145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72d2da640 1 -- 172.21.15.40:0/682465982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72814f550 con 0x7fc714003760 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72d2da640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714003760 0x7fc7280b49d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc72400fb60 tx=0x7fc72400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72dadb640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc7281e3de0 0x7fc728146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.850+0000 7fc72cad9640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7281e3980 0x7fc728145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fc71dffb640 1 -- 172.21.15.40:0/682465982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400fe60 con 0x7fc714003760 2023-12-20T04:23:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fc71dffb640 1 -- 172.21.15.40:0/682465982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72400dc30 con 0x7fc714003760 2023-12-20T04:23:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fa3f6cb5640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7fa3d4072720 0x7fa3d4074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== osd.7 v2:172.21.15.69:6816/89432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f88900750f0 con 0x7f8890072620 2023-12-20T04:23:31.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fbe7ffff640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbe6406a500 0x7fbe6406c9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe780d83c0 tx=0x7fbe74009060 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fa3f5cb3640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa3d406a500 0x7fa3d406c9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8000ba0 tx=0x7fa3e8009630 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3d40751f0 con 0x7fa3d4072720 2023-12-20T04:23:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3e00ac970 con 0x7fa3f006ae20 2023-12-20T04:23:31.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.852+0000 7fbe8534b640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7fbe640725b0 0x7fbe640749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.853+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== osd.2 v2:172.21.15.40:6809/89424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa4880751f0 con 0x7fa488072720 2023-12-20T04:23:31.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.854+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== osd.0 v2:172.21.15.40:6800/89422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa3d40751f0 con 0x7fa3d4072720 2023-12-20T04:23:31.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.854+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== osd.1 v2:172.21.15.40:6808/89425 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbe64075080 con 0x7fbe640725b0 2023-12-20T04:23:31.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.854+0000 7fa4a659c640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa48806a500 0x7fa48806c9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa49c007ca0 tx=0x7fa49c007c30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.854+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe070012c40 con 0x7fe07c14abd0 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.855+0000 7fe0797fa640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe06806a500 0x7fe06806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.855+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe070088d10 con 0x7fe07c14abd0 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.855+0000 7fe0797fa640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fe0680726a0 0x7fe068074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.855+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 --> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe068075170 con 0x7fe0680726a0 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.853+0000 7fc71dffb640 1 -- 172.21.15.40:0/682465982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240050d0 con 0x7fc714003760 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.853+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72814f7d0 con 0x7fc714003760 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.853+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7280a81e0 con 0x7fc714003760 2023-12-20T04:23:31.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.855+0000 7fc71dffb640 1 -- 172.21.15.40:0/682465982 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc724005230 con 0x7fc714003760 2023-12-20T04:23:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.855+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe070012ef0 con 0x7fe07c14abd0 2023-12-20T04:23:31.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.855+0000 7fc71dffb640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc70c06a500 0x7fc70c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.856+0000 7fc71dffb640 1 -- 172.21.15.40:0/682465982 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc724088c50 con 0x7fc714003760 2023-12-20T04:23:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.856+0000 7fc72f53e640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7fc7281e6f50 0x7fc7281e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.856+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 --> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc72806ee40 con 0x7fc7281e6f50 2023-12-20T04:23:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.856+0000 7fc72cad9640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc70c06a500 0x7fc70c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.856+0000 7fc72dadb640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7fc7281e6f50 0x7fc7281e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.856+0000 7fe07bfff640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fe0680726a0 0x7fe068074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.857+0000 7fc72cad9640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc70c06a500 0x7fc70c06c9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc718036000 tx=0x7fc718030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.857+0000 7fe080c2b640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe06806a500 0x7fe06806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.857+0000 7fc72dadb640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7fc7281e6f50 0x7fc7281e7330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.857+0000 7fe07bfff640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fe0680726a0 0x7fe068074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.857+0000 7fe080c2b640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe06806a500 0x7fe06806c9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe06c001590 tx=0x7fe06c0078f0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:31.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.858+0000 7fc71dffb640 1 -- 172.21.15.40:0/682465982 <== osd.5 v2:172.21.15.69:6808/89419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc7200073b0 con 0x7fc7281e6f50 2023-12-20T04:23:31.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.858+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== osd.4 v2:172.21.15.69:6824/89421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe068075170 con 0x7fe0680726a0 2023-12-20T04:23:31.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.875+0000 7f7471687640 1 -- 172.21.15.40:0/2124873104 --> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f744c002ce0 con 0x7f7450072720 2023-12-20T04:23:31.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.876+0000 7f7468ff9640 1 -- 172.21.15.40:0/2124873104 <== osd.3 v2:172.21.15.40:6824/89423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f744c002ce0 con 0x7f7450072720 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.877+0000 7f74567fc640 1 -- 172.21.15.40:0/2124873104 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7f7450072720 msgr2=0x7f7450074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.877+0000 7f74567fc640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7f7450072720 0x7f7450074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.877+0000 7f74567fc640 1 -- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f745006a500 msgr2=0x7f745006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.877+0000 7f74567fc640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f745006a500 0x7f745006c9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f746c072ab0 tx=0x7f746c06e040 comp rx=0 tx=0).stop 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.877+0000 7f74567fc640 1 -- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74640d0a10 msgr2=0x7f7464165950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.877+0000 7f74567fc640 1 --2- 172.21.15.40:0/2124873104 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74640d0a10 0x7f7464165950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f745800bb70 tx=0x7f74580046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.877+0000 7f7470e86640 1 -- 172.21.15.40:0/2124873104 reap_dead start 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.878+0000 7f74567fc640 1 -- 172.21.15.40:0/2124873104 shutdown_connections 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.878+0000 7f74567fc640 1 -- 172.21.15.40:0/2124873104 >> 172.21.15.40:0/2124873104 conn(0x7f746403ef10 msgr2=0x7f74640c55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.878+0000 7f74567fc640 1 -- 172.21.15.40:0/2124873104 shutdown_connections 2023-12-20T04:23:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.878+0000 7f74567fc640 1 -- 172.21.15.40:0/2124873104 wait complete. 2023-12-20T04:23:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.884+0000 7fbe86dae640 1 -- 172.21.15.40:0/1178972411 --> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe780d9750 con 0x7fbe640725b0 2023-12-20T04:23:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.884+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 --> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f372403bcc0 con 0x7f37180731f0 2023-12-20T04:23:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.884+0000 7fbe7d7fa640 1 -- 172.21.15.40:0/1178972411 <== osd.1 v2:172.21.15.40:6808/89425 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe800ba040 con 0x7fbe640725b0 2023-12-20T04:23:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7f37137fe640 1 -- 172.21.15.40:0/3297172677 <== osd.6 v2:172.21.15.69:6800/89420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f371c0017c0 con 0x7f37180731f0 2023-12-20T04:23:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7fbe6affd640 1 -- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7fbe640725b0 msgr2=0x7fbe640749d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7fbe6affd640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7fbe640725b0 0x7fbe640749d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7fbe6affd640 1 -- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbe6406a500 msgr2=0x7fbe6406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7fbe6affd640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbe6406a500 0x7fbe6406c9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe780d83c0 tx=0x7fbe74009060 comp rx=0 tx=0).stop 2023-12-20T04:23:31.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7fbe6affd640 1 -- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 msgr2=0x7fbe780c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7fbe6affd640 1 --2- 172.21.15.40:0/1178972411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbe7803c660 0x7fbe780c8210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00eb70 tx=0x7fbe6c00c520 comp rx=0 tx=0).stop 2023-12-20T04:23:31.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7f88b2ffd640 1 -- 172.21.15.40:0/2319188123 --> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88ac0b6150 con 0x7f8890072620 2023-12-20T04:23:31.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f37180731f0 msgr2=0x7f3718075690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f37180731f0 0x7f3718075690 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f88a27fc640 1 -- 172.21.15.40:0/2319188123 <== osd.7 v2:172.21.15.69:6816/89432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f889c0041e0 con 0x7f8890072620 2023-12-20T04:23:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f371806a4c0 msgr2=0x7f371806c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f371806a4c0 0x7f371806c980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f372415fae0 tx=0x7f3720009030 comp rx=0 tx=0).stop 2023-12-20T04:23:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140047c0 msgr2=0x7f37240c1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 --2- 172.21.15.40:0/3297172677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37140047c0 0x7f37240c1a90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f372c04eda0 tx=0x7f372c066fc0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7fa494ff9640 1 -- 172.21.15.40:0/1818152762 --> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa48c002cb0 con 0x7fa488072720 2023-12-20T04:23:31.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f372b7fe640 1 -- 172.21.15.40:0/3297172677 reap_dead start 2023-12-20T04:23:31.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 shutdown_connections 2023-12-20T04:23:31.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 >> 172.21.15.40:0/3297172677 conn(0x7f3724041000 msgr2=0x7f372403ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 --> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3f0071c20 con 0x7fa3d4072720 2023-12-20T04:23:31.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 shutdown_connections 2023-12-20T04:23:31.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7f37117fa640 1 -- 172.21.15.40:0/3297172677 wait complete. 2023-12-20T04:23:31.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7fa496ffd640 1 -- 172.21.15.40:0/1818152762 <== osd.2 v2:172.21.15.40:6809/89424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa48c002cb0 con 0x7fa488072720 2023-12-20T04:23:31.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.885+0000 7fbe8534b640 1 -- 172.21.15.40:0/1178972411 reap_dead start 2023-12-20T04:23:31.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7fbe6affd640 1 -- 172.21.15.40:0/1178972411 shutdown_connections 2023-12-20T04:23:31.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7fbe6affd640 1 -- 172.21.15.40:0/1178972411 >> 172.21.15.40:0/1178972411 conn(0x7fbe78043290 msgr2=0x7fbe78043670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7fbe6affd640 1 -- 172.21.15.40:0/1178972411 shutdown_connections 2023-12-20T04:23:31.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.886+0000 7fbe6affd640 1 -- 172.21.15.40:0/1178972411 wait complete. 2023-12-20T04:23:31.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3e6ffd640 1 -- 172.21.15.40:0/1102896228 <== osd.0 v2:172.21.15.40:6800/89422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3ec0096b0 con 0x7fa3d4072720 2023-12-20T04:23:31.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7fa3d4072720 msgr2=0x7fa3d4074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3e4ff9640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7fa3d4072720 0x7fa3d4074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa3d406a500 msgr2=0x7fa3d406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3e4ff9640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa3d406a500 0x7fa3d406c9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8000ba0 tx=0x7fa3e8009630 comp rx=0 tx=0).stop 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3f006ae20 msgr2=0x7fa3f0151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3e4ff9640 1 --2- 172.21.15.40:0/1102896228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3f006ae20 0x7fa3f0151a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009890 tx=0x7fa3e00046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa3f6cb5640 1 -- 172.21.15.40:0/1102896228 reap_dead start 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7f888ffff640 1 -- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f8890072620 msgr2=0x7f8890074a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7f888ffff640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f8890072620 0x7f8890074a40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7f888ffff640 1 -- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f889006a480 msgr2=0x7f889006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7f888ffff640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f889006a480 0x7f889006c940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f88ac06bf40 tx=0x7f88a8008040 comp rx=0 tx=0).stop 2023-12-20T04:23:31.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7f888ffff640 1 -- 172.21.15.40:0/2319188123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88ac145370 msgr2=0x7f88ac1457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7f888ffff640 1 --2- 172.21.15.40:0/2319188123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88ac145370 0x7f88ac1457f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0b6f00 tx=0x7f88a400a640 comp rx=0 tx=0).stop 2023-12-20T04:23:31.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7f88b27fc640 1 -- 172.21.15.40:0/2319188123 reap_dead start 2023-12-20T04:23:31.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 shutdown_connections 2023-12-20T04:23:31.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 >> 172.21.15.40:0/1102896228 conn(0x7fa3f00b8f20 msgr2=0x7fa3f01d9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fa488072720 msgr2=0x7fa488074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fa488072720 0x7fa488074b40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa48806a500 msgr2=0x7fa48806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa48806a500 0x7fa48806c9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa49c007ca0 tx=0x7fa49c007c30 comp rx=0 tx=0).stop 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00d0640 msgr2=0x7fa4a00cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 --2- 172.21.15.40:0/1818152762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4a00d0640 0x7fa4a00cb700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa498033000 tx=0x7fa498004730 comp rx=0 tx=0).stop 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4a6d9d640 1 -- 172.21.15.40:0/1818152762 reap_dead start 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 shutdown_connections 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.887+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 >> 172.21.15.40:0/1818152762 conn(0x7fa4a00061f0 msgr2=0x7fa4a0037310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7f888ffff640 1 -- 172.21.15.40:0/2319188123 shutdown_connections 2023-12-20T04:23:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 shutdown_connections 2023-12-20T04:23:31.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7f888ffff640 1 -- 172.21.15.40:0/2319188123 >> 172.21.15.40:0/2319188123 conn(0x7f88ac0c0090 msgr2=0x7f88ac0bf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7fa3e4ff9640 1 -- 172.21.15.40:0/1102896228 wait complete. 2023-12-20T04:23:31.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 shutdown_connections 2023-12-20T04:23:31.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7fa4acbb9640 1 -- 172.21.15.40:0/1818152762 wait complete. 2023-12-20T04:23:31.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7f888ffff640 1 -- 172.21.15.40:0/2319188123 shutdown_connections 2023-12-20T04:23:31.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.888+0000 7f888ffff640 1 -- 172.21.15.40:0/2319188123 wait complete. 2023-12-20T04:23:31.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.889+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 --> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7280b87e0 con 0x7fc7281e6f50 2023-12-20T04:23:31.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.889+0000 7fc71dffb640 1 -- 172.21.15.40:0/682465982 <== osd.5 v2:172.21.15.69:6808/89419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7200073b0 con 0x7fc7281e6f50 2023-12-20T04:23:31.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.890+0000 7fe082e8f640 1 -- 172.21.15.40:0/2781617938 --> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe05c002cb0 con 0x7fe0680726a0 2023-12-20T04:23:31.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.890+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7fc7281e6f50 msgr2=0x7fc7281e7330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.890+0000 7fc72f53e640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7fc7281e6f50 0x7fc7281e7330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.890+0000 7fe0797fa640 1 -- 172.21.15.40:0/2781617938 <== osd.4 v2:172.21.15.69:6824/89421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe05c002cb0 con 0x7fe0680726a0 2023-12-20T04:23:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.890+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc70c06a500 msgr2=0x7fc70c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.890+0000 7fc72f53e640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc70c06a500 0x7fc70c06c9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc718036000 tx=0x7fc718030000 comp rx=0 tx=0).stop 2023-12-20T04:23:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714003760 msgr2=0x7fc7280b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fc72f53e640 1 --2- 172.21.15.40:0/682465982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc714003760 0x7fc7280b49d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc72400fb60 tx=0x7fc72400d520 comp rx=0 tx=0).stop 2023-12-20T04:23:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 -- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fe0680726a0 msgr2=0x7fe068074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fe0680726a0 0x7fe068074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fc72dadb640 1 -- 172.21.15.40:0/682465982 reap_dead start 2023-12-20T04:23:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 shutdown_connections 2023-12-20T04:23:31.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 >> 172.21.15.40:0/682465982 conn(0x7fc728069ba0 msgr2=0x7fc7280bb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 -- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe06806a500 msgr2=0x7fe06806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe06806a500 0x7fe06806c9c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe06c001590 tx=0x7fe06c0078f0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 -- 172.21.15.40:0/2781617938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe07c14abd0 msgr2=0x7fe07c0b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:31.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 --2- 172.21.15.40:0/2781617938 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe07c14abd0 0x7fe07c0b1cb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe07000d600 tx=0x7fe07000dac0 comp rx=0 tx=0).stop 2023-12-20T04:23:31.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe08142c640 1 -- 172.21.15.40:0/2781617938 reap_dead start 2023-12-20T04:23:31.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 shutdown_connections 2023-12-20T04:23:31.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 -- 172.21.15.40:0/2781617938 shutdown_connections 2023-12-20T04:23:31.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fe062ffd640 1 -- 172.21.15.40:0/2781617938 >> 172.21.15.40:0/2781617938 conn(0x7fe07c0c0270 msgr2=0x7fe07c14a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:31.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.891+0000 7fc72f53e640 1 -- 172.21.15.40:0/682465982 wait complete. 2023-12-20T04:23:31.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.892+0000 7fe062ffd640 1 -- 172.21.15.40:0/2781617938 shutdown_connections 2023-12-20T04:23:31.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:31.892+0000 7fe062ffd640 1 -- 172.21.15.40:0/2781617938 wait complete. 2023-12-20T04:23:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-12-20T04:23:31.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-20T04:23:31.955 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:31.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-20T04:23:31.956 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-12-20T04:23:31.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-20T04:23:31.957 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:31.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-20T04:23:31.958 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-12-20T04:23:31.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-20T04:23:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-12-20T04:23:31.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-20T04:23:31.960 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-12-20T04:23:31.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-20T04:23:31.962 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:31.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-20T04:23:32.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.175+0000 7f8fecd89640 1 Processor -- start 2023-12-20T04:23:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.175+0000 7f8fecd89640 1 -- start start 2023-12-20T04:23:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f8fecd89640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fe80b6a60 0x7f8fe80b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f35168ce640 1 Processor -- start 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f8fecd89640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe815ad80 0x7f8fe815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f8fecd89640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe80716a0 con 0x7f8fe8157f30 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f8fecd89640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe815b6e0 con 0x7f8fe80b6a60 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f8fecd89640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8070a40 con 0x7f8fe815ad80 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f8fe6d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8fe8157f30 0x7f8fe8158390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52882/0 (socket says 172.21.15.40:52882) 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.176+0000 7f8fe6d9d640 1 -- 172.21.15.40:0/1293643132 learned_addr learned my addr 172.21.15.40:0/1293643132 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.177+0000 7f8fe659c640 1 --2- 172.21.15.40:0/1293643132 >> v2:172.21.15.40:3300/0 conn(0x7f8fe80b6a60 0x7f8fe80b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.177+0000 7f8fe5d9b640 1 --2- 172.21.15.40:0/1293643132 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe815ad80 0x7f8fe815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.177+0000 7f8fe659c640 1 -- 172.21.15.40:0/1293643132 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe815ad80 msgr2=0x7f8fe815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.177+0000 7f8fe659c640 1 --2- 172.21.15.40:0/1293643132 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe815ad80 0x7f8fe815b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.177+0000 7f8fe659c640 1 -- 172.21.15.40:0/1293643132 >> v1:172.21.15.40:6789/0 conn(0x7f8fe8157f30 legacy=0x7f8fe8158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.177+0000 7f8fe659c640 1 -- 172.21.15.40:0/1293643132 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe80b9790 con 0x7f8fe80b6a60 2023-12-20T04:23:32.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7fa7d3fff640 1 Processor -- start 2023-12-20T04:23:32.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.177+0000 7f35168ce640 1 -- start start 2023-12-20T04:23:32.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f35168ce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f351006ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f35168ce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351006f3c0 con 0x7f35100704e0 2023-12-20T04:23:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f35168ce640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35101411d0 con 0x7f3510140df0 2023-12-20T04:23:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f35168ce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100b2be0 con 0x7f3510147420 2023-12-20T04:23:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f350f7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f351006ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f38c0fb5640 1 Processor -- start 2023-12-20T04:23:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f350f7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f351006ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54626/0 (socket says 172.21.15.40:54626) 2023-12-20T04:23:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f350f7fe640 1 -- 172.21.15.40:0/2848748956 learned_addr learned my addr 172.21.15.40:0/2848748956 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7fa7d3fff640 1 -- start start 2023-12-20T04:23:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f350f7fe640 1 -- 172.21.15.40:0/2848748956 >> v1:172.21.15.69:6789/0 conn(0x7f3510140df0 legacy=0x7f3510146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f350f7fe640 1 -- 172.21.15.40:0/2848748956 >> v1:172.21.15.40:6789/0 conn(0x7f35100704e0 legacy=0x7f3510151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.178+0000 7f38c0fb5640 1 -- start start 2023-12-20T04:23:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f78a5701640 1 Processor -- start 2023-12-20T04:23:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f78a5701640 1 -- start start 2023-12-20T04:23:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc007200 0x7fa7cc0294b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7fa7d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa7cc008cd0 0x7fa7cc0dfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7fa7d3fff640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc03aa20 con 0x7fa7cc0075e0 2023-12-20T04:23:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7fa7d3fff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc007a20 con 0x7fa7cc008cd0 2023-12-20T04:23:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7fa7d3fff640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0087f0 con 0x7fa7cc007200 2023-12-20T04:23:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f8fe659c640 1 --2- 172.21.15.40:0/1293643132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80b6a60 0x7f8fe80b6e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009790 tx=0x7f8fdc02b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c097bd88d1dcf8ff server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f350f7fe640 1 -- 172.21.15.40:0/2848748956 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351006f610 con 0x7f3510147420 2023-12-20T04:23:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f98a4db3640 1 Processor -- start 2023-12-20T04:23:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7fa7d2ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc007200 0x7fa7cc0294b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7fa7d27fc640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa7cc0075e0 0x7fa7cc0d2860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43928/0 (socket says 172.21.15.40:43928) 2023-12-20T04:23:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7fa7d27fc640 1 -- 172.21.15.40:0/492963803 learned_addr learned my addr 172.21.15.40:0/492963803 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f169b04a640 1 Processor -- start 2023-12-20T04:23:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f98a4db3640 1 -- start start 2023-12-20T04:23:32.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f38c0fb5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38bc06fa70 0x7f38bc152a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f98a4db3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b6220 0x7f98a00b6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f38c0fb5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc152fc0 0x7f38bc1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f38c0fb5640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38bc071940 con 0x7f38bc06b480 2023-12-20T04:23:32.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f38c0fb5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38bc070200 con 0x7f38bc06fa70 2023-12-20T04:23:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.179+0000 7f38c0fb5640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc153430 con 0x7f38bc152fc0 2023-12-20T04:23:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f38bb7fe640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f38bc06b480 0x7f38bc0b30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43922/0 (socket says 172.21.15.40:43922) 2023-12-20T04:23:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f38bb7fe640 1 -- 172.21.15.40:0/1445275464 learned_addr learned my addr 172.21.15.40:0/1445275464 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f169b04a640 1 -- start start 2023-12-20T04:23:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f38baffd640 1 --2- 172.21.15.40:0/1445275464 >> v2:172.21.15.40:3300/0 conn(0x7f38bc06fa70 0x7f38bc152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f38baffd640 1 -- 172.21.15.40:0/1445275464 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc152fc0 msgr2=0x7f38bc1597f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-20T04:23:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f38baffd640 1 --2- 172.21.15.40:0/1445275464 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc152fc0 0x7f38bc1597f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f38baffd640 1 -- 172.21.15.40:0/1445275464 >> v1:172.21.15.69:6789/0 conn(0x7f38bc06b480 legacy=0x7f38bc0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f38baffd640 1 -- 172.21.15.40:0/1445275464 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc071660 con 0x7f38bc06fa70 2023-12-20T04:23:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7fa7d2ffd640 1 -- 172.21.15.40:0/492963803 >> v2:172.21.15.40:3300/0 conn(0x7fa7cc008cd0 msgr2=0x7fa7cc0dfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7fa7d2ffd640 1 --2- 172.21.15.40:0/492963803 >> v2:172.21.15.40:3300/0 conn(0x7fa7cc008cd0 0x7fa7cc0dfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7fa7d2ffd640 1 -- 172.21.15.40:0/492963803 >> v1:172.21.15.69:6789/0 conn(0x7fa7cc0075e0 legacy=0x7fa7cc0d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7f98a4db3640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f98a00b9fd0 0x7f98a0155230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f98a4db3640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a014aa00 con 0x7f98a014b170 2023-12-20T04:23:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f98a4db3640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a014ad50 con 0x7f98a00b9fd0 2023-12-20T04:23:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f98a4db3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00baa10 con 0x7f98a00b6220 2023-12-20T04:23:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989f7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b6220 0x7f98a00b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989f7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b6220 0x7f98a00b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54636/0 (socket says 172.21.15.40:54636) 2023-12-20T04:23:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989f7fe640 1 -- 172.21.15.40:0/1335838203 learned_addr learned my addr 172.21.15.40:0/1335838203 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989ffff640 1 --2- 172.21.15.40:0/1335838203 >> v2:172.21.15.69:3300/0 conn(0x7f98a00b9fd0 0x7f98a0155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.180+0000 7fa7d2ffd640 1 -- 172.21.15.40:0/492963803 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc03ac70 con 0x7fa7cc007200 2023-12-20T04:23:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989ffff640 1 -- 172.21.15.40:0/1335838203 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b6220 msgr2=0x7f98a00b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989ffff640 1 --2- 172.21.15.40:0/1335838203 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b6220 0x7f98a00b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989ffff640 1 -- 172.21.15.40:0/1335838203 >> v1:172.21.15.69:6789/0 conn(0x7f98a014b170 legacy=0x7f98a00b98c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-20T04:23:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f989ffff640 1 -- 172.21.15.40:0/1335838203 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a00bc3f0 con 0x7f98a00b9fd0 2023-12-20T04:23:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7fd6895fd640 1 Processor -- start 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7fa7d2ffd640 1 --2- 172.21.15.40:0/492963803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc007200 0x7fa7cc0294b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40097a0 tx=0x7fa7c402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bc79b018c3abae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f169b04a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1694072000 0x7f1694148b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f169b04a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1694149050 0x7f1694152270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f169b04a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16940700d0 con 0x7f169406ae20 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f169b04a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1694071a00 con 0x7f1694072000 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f169b04a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1694070320 con 0x7f1694149050 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f1698de6640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f169406ae20 0x7f16940b85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43958/0 (socket says 172.21.15.40:43958) 2023-12-20T04:23:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f1698de6640 1 -- 172.21.15.40:0/749100411 learned_addr learned my addr 172.21.15.40:0/749100411 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:32.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f1693fff640 1 --2- 172.21.15.40:0/749100411 >> v2:172.21.15.40:3300/0 conn(0x7f1694072000 0x7f1694148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f16995e7640 1 --2- 172.21.15.40:0/749100411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1694149050 0x7f1694152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f38baffd640 1 --2- 172.21.15.40:0/1445275464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06fa70 0x7f38bc152a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38b00097d0 tx=0x7f38b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f6502bb83a6d6c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f38ba7fc640 1 -- 172.21.15.40:0/1445275464 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b002e070 con 0x7f38bc06fa70 2023-12-20T04:23:32.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f38ba7fc640 1 -- 172.21.15.40:0/1445275464 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b00315a0 con 0x7f38bc06fa70 2023-12-20T04:23:32.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f38ba7fc640 1 -- 172.21.15.40:0/1445275464 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0031930 con 0x7f38bc06fa70 2023-12-20T04:23:32.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7fd6895fd640 1 -- start start 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f78a5701640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a006ae20 0x7f78a00b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f789ffff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a006ae20 0x7f78a00b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f789ffff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a006ae20 0x7f78a00b8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54642/0 (socket says 172.21.15.40:54642) 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f789ffff640 1 -- 172.21.15.40:0/2773710554 learned_addr learned my addr 172.21.15.40:0/2773710554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00707b0 con 0x7f78a0150f00 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a0070a00 con 0x7f78a00b7390 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00b8d70 con 0x7f78a006ae20 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431493023 0 0) 0x7f78a0070a00 con 0x7f78a00b7390 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7888003520 con 0x7f78a00b7390 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562912546 0 0) 0x7f78a00707b0 con 0x7f78a0150f00 2023-12-20T04:23:32.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a0070a00 con 0x7f78a0150f00 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 <== mon.1 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861611939 0 0) 0x7f7888003520 con 0x7f78a00b7390 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a006ae20 msgr2=0x7f78a00b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a006ae20 0x7f78a00b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 >> v1:172.21.15.40:6789/0 conn(0x7f78a0150f00 legacy=0x7f78a01532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a006f590 con 0x7f78a00b7390 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 <== mon.1 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f7890001670 con 0x7f78a00b7390 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 >> v1:172.21.15.69:6789/0 conn(0x7f78a00b7390 legacy=0x7f78a01421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7888003b00 0x7f7888003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78880047c0 0x7f7888004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7888005180 0x7f788800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00b8d70 con 0x7f7888005180 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789f7fe640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78880047c0 0x7f7888004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788800bfd0 con 0x7f78880047c0 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788800c190 con 0x7f7888003b00 2023-12-20T04:23:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f78a4f00640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7888005180 0x7f788800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7fa7d1ffb640 1 -- 172.21.15.40:0/492963803 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4030610 con 0x7fa7cc007200 2023-12-20T04:23:32.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7fa7d1ffb640 1 -- 172.21.15.40:0/492963803 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4030770 con 0x7fa7cc007200 2023-12-20T04:23:32.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7fa7d1ffb640 1 -- 172.21.15.40:0/492963803 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4030b00 con 0x7fa7cc007200 2023-12-20T04:23:32.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f8fe559a640 1 -- 172.21.15.40:0/1293643132 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc030710 con 0x7f8fe80b6a60 2023-12-20T04:23:32.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f8fe559a640 1 -- 172.21.15.40:0/1293643132 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc02e050 con 0x7f8fe80b6a60 2023-12-20T04:23:32.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.181+0000 7f8fe559a640 1 -- 172.21.15.40:0/1293643132 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc030a90 con 0x7f8fe80b6a60 2023-12-20T04:23:32.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f8fecd89640 1 -- 172.21.15.40:0/1293643132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80b6a60 msgr2=0x7f8fe80b6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f8fecd89640 1 --2- 172.21.15.40:0/1293643132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80b6a60 0x7f8fe80b6e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc009790 tx=0x7f8fdc02b650 comp rx=0 tx=0).stop 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f8fecd89640 1 -- 172.21.15.40:0/1293643132 shutdown_connections 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f8fecd89640 1 --2- 172.21.15.40:0/1293643132 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe815ad80 0x7f8fe815b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f8fecd89640 1 --2- 172.21.15.40:0/1293643132 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe80b6a60 0x7f8fe80b6e40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f8fecd89640 1 -- 172.21.15.40:0/1293643132 >> 172.21.15.40:0/1293643132 conn(0x7f8fe80b88a0 msgr2=0x7f8fe80b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f989ffff640 1 --2- 172.21.15.40:0/1335838203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b9fd0 0x7f98a0155230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9894011fc0 tx=0x7f98940340e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d44e94019476f732 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f989e7fc640 1 -- 172.21.15.40:0/1335838203 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894034e90 con 0x7f98a00b9fd0 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f989e7fc640 1 -- 172.21.15.40:0/1335838203 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98940110d0 con 0x7f98a00b9fd0 2023-12-20T04:23:32.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f989e7fc640 1 -- 172.21.15.40:0/1335838203 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011460 con 0x7f98a00b9fd0 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f16995e7640 1 -- 172.21.15.40:0/749100411 >> v2:172.21.15.40:3300/0 conn(0x7f1694072000 msgr2=0x7f1694148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f16995e7640 1 --2- 172.21.15.40:0/749100411 >> v2:172.21.15.40:3300/0 conn(0x7f1694072000 0x7f1694148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.182+0000 7f16995e7640 1 -- 172.21.15.40:0/749100411 >> v1:172.21.15.69:6789/0 conn(0x7f169406ae20 legacy=0x7f16940b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f789f7fe640 1 -- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7888003b00 msgr2=0x7f7888003ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f789f7fe640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7888003b00 0x7f7888003ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f789f7fe640 1 -- 172.21.15.40:0/2773710554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7888005180 msgr2=0x7f788800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f789f7fe640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7888005180 0x7f788800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f789f7fe640 1 -- 172.21.15.40:0/2773710554 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7888003520 con 0x7f78880047c0 2023-12-20T04:23:32.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f78a4f00640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7888005180 0x7f788800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:32.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6895fd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0072b0 0x7fd67c040780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6895fd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd67c042ac0 0x7fd67c0d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6895fd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd67c0d1430 0x7fd67c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd683fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0072b0 0x7fd67c040780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f350f7fe640 1 --2- 172.21.15.40:0/2848748956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f351006ffa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f350800d3a0 tx=0x7f350802e1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74e0e73cdf90748 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6895fd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c03e5b0 con 0x7fd67c042ac0 2023-12-20T04:23:32.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6895fd640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd67c042fe0 con 0x7fd67c0d1430 2023-12-20T04:23:32.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6895fd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c03dd90 con 0x7fd67c0072b0 2023-12-20T04:23:32.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd67c042ac0 0x7fd67c0d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fa7d3fff640 1 -- 172.21.15.40:0/492963803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc007200 msgr2=0x7fa7cc0294b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fa7d3fff640 1 --2- 172.21.15.40:0/492963803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc007200 0x7fa7cc0294b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40097a0 tx=0x7fa7c402b960 comp rx=0 tx=0).stop 2023-12-20T04:23:32.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd683fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0072b0 0x7fd67c040780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54652/0 (socket says 172.21.15.40:54652) 2023-12-20T04:23:32.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd6837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd67c042ac0 0x7fd67c0d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57364/0 (socket says 172.21.15.40:57364) 2023-12-20T04:23:32.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd683fff640 1 -- 172.21.15.40:0/29744897 learned_addr learned my addr 172.21.15.40:0/29744897 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f38c0fb5640 1 -- 172.21.15.40:0/1445275464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06fa70 msgr2=0x7f38bc152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f38c0fb5640 1 --2- 172.21.15.40:0/1445275464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06fa70 0x7f38bc152a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f38b00097d0 tx=0x7f38b002b840 comp rx=0 tx=0).stop 2023-12-20T04:23:32.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd688dfc640 1 --2- 172.21.15.40:0/29744897 >> v2:172.21.15.69:3300/0 conn(0x7fd67c0d1430 0x7fd67c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fa7d3fff640 1 -- 172.21.15.40:0/492963803 shutdown_connections 2023-12-20T04:23:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fa7d3fff640 1 --2- 172.21.15.40:0/492963803 >> v2:172.21.15.40:3300/0 conn(0x7fa7cc008cd0 0x7fa7cc0dfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fa7d3fff640 1 --2- 172.21.15.40:0/492963803 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc007200 0x7fa7cc0294b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fa7d3fff640 1 -- 172.21.15.40:0/492963803 >> 172.21.15.40:0/492963803 conn(0x7fa7cc007c30 msgr2=0x7fa7cc008040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f38c0fb5640 1 -- 172.21.15.40:0/1445275464 shutdown_connections 2023-12-20T04:23:32.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f8fecd89640 1 -- 172.21.15.40:0/1293643132 shutdown_connections 2023-12-20T04:23:32.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fa7d3fff640 1 -- 172.21.15.40:0/492963803 shutdown_connections 2023-12-20T04:23:32.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f38c0fb5640 1 --2- 172.21.15.40:0/1445275464 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06fa70 0x7f38bc152a80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f38c0fb5640 1 --2- 172.21.15.40:0/1445275464 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc152fc0 0x7f38bc1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd683fff640 1 -- 172.21.15.40:0/29744897 >> v2:172.21.15.69:3300/0 conn(0x7fd67c0d1430 msgr2=0x7fd67c0cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7fd683fff640 1 --2- 172.21.15.40:0/29744897 >> v2:172.21.15.69:3300/0 conn(0x7fd67c0d1430 0x7fd67c0cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7fd683fff640 1 -- 172.21.15.40:0/29744897 >> v2:172.21.15.40:3300/0 conn(0x7fd67c042ac0 msgr2=0x7fd67c0d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f38c0fb5640 1 -- 172.21.15.40:0/1445275464 >> 172.21.15.40:0/1445275464 conn(0x7f38bc0bbed0 msgr2=0x7f38bc0bc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 -- 172.21.15.40:0/1335838203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b9fd0 msgr2=0x7f98a0155230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f16937fe640 1 -- 172.21.15.40:0/749100411 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463241682 0 0) 0x7f16940700d0 con 0x7f169406ae20 2023-12-20T04:23:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f16995e7640 1 -- 172.21.15.40:0/749100411 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1694070600 con 0x7f1694149050 2023-12-20T04:23:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.183+0000 7f8fecd89640 1 -- 172.21.15.40:0/1293643132 wait complete. 2023-12-20T04:23:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 --2- 172.21.15.40:0/1335838203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b9fd0 0x7f98a0155230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9894011fc0 tx=0x7f98940340e0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 -- 172.21.15.40:0/1335838203 shutdown_connections 2023-12-20T04:23:32.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 --2- 172.21.15.40:0/1335838203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b9fd0 0x7f98a0155230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 --2- 172.21.15.40:0/1335838203 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b6220 0x7f98a00b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 -- 172.21.15.40:0/1335838203 >> 172.21.15.40:0/1335838203 conn(0x7f98a00c0090 msgr2=0x7f98a00c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7fd683fff640 1 --2- 172.21.15.40:0/29744897 >> v2:172.21.15.40:3300/0 conn(0x7fd67c042ac0 0x7fd67c0d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7fd683fff640 1 -- 172.21.15.40:0/29744897 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c03e7c0 con 0x7fd67c0072b0 2023-12-20T04:23:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7fd6837fe640 1 --2- 172.21.15.40:0/29744897 >> v2:172.21.15.40:3300/0 conn(0x7fd67c042ac0 0x7fd67c0d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:32.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7fa7d3fff640 1 -- 172.21.15.40:0/492963803 wait complete. 2023-12-20T04:23:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 -- 172.21.15.40:0/1335838203 shutdown_connections 2023-12-20T04:23:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f350effd640 1 -- 172.21.15.40:0/2848748956 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508038400 con 0x7f3510147420 2023-12-20T04:23:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f789f7fe640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78880047c0 0x7f7888004c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7890007ed0 tx=0x7f78880057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0841558fd1d26eb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f98a4db3640 1 -- 172.21.15.40:0/1335838203 wait complete. 2023-12-20T04:23:32.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f350effd640 1 -- 172.21.15.40:0/2848748956 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508032070 con 0x7f3510147420 2023-12-20T04:23:32.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f350effd640 1 -- 172.21.15.40:0/2848748956 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508038780 con 0x7f3510147420 2023-12-20T04:23:32.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f38c0fb5640 1 -- 172.21.15.40:0/1445275464 shutdown_connections 2023-12-20T04:23:32.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.184+0000 7f38c0fb5640 1 -- 172.21.15.40:0/1445275464 wait complete. 2023-12-20T04:23:32.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f16995e7640 1 --2- 172.21.15.40:0/749100411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1694149050 0x7f1694152270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f16840097d0 tx=0x7f168402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=663ae2ff2f2fcbd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789002c8a0 con 0x7f78880047c0 2023-12-20T04:23:32.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f8fecd89640 1 Processor -- start 2023-12-20T04:23:32.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789002ca20 con 0x7f78880047c0 2023-12-20T04:23:32.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f789effd640 1 -- 172.21.15.40:0/2773710554 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789002cdd0 con 0x7f78880047c0 2023-12-20T04:23:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f8fecd89640 1 -- start start 2023-12-20T04:23:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f35168ce640 1 -- 172.21.15.40:0/2848748956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 msgr2=0x7f351006ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f35168ce640 1 --2- 172.21.15.40:0/2848748956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f351006ffa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f350800d3a0 tx=0x7f350802e1d0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7fa7d3fff640 1 Processor -- start 2023-12-20T04:23:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f35168ce640 1 -- 172.21.15.40:0/2848748956 shutdown_connections 2023-12-20T04:23:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f35168ce640 1 --2- 172.21.15.40:0/2848748956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f351006ffa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f35168ce640 1 -- 172.21.15.40:0/2848748956 >> 172.21.15.40:0/2848748956 conn(0x7f35100b88a0 msgr2=0x7f35100b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f16937fe640 1 -- 172.21.15.40:0/749100411 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684031890 con 0x7f1694149050 2023-12-20T04:23:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7f16937fe640 1 -- 172.21.15.40:0/749100411 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16840319f0 con 0x7f1694149050 2023-12-20T04:23:32.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.185+0000 7fd683fff640 1 --2- 172.21.15.40:0/29744897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0072b0 0x7fd67c040780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0d18f0 tx=0x7fd67802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c0cd4cdaca7dcc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f98a4db3640 1 Processor -- start 2023-12-20T04:23:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7fa7d3fff640 1 -- start start 2023-12-20T04:23:32.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78880047c0 msgr2=0x7f7888004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f78a5701640 1 --2- 172.21.15.40:0/2773710554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78880047c0 0x7f7888004c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7890007ed0 tx=0x7f78880057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f78a4f00640 1 -- 172.21.15.40:0/2773710554 reap_dead start 2023-12-20T04:23:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f98a4db3640 1 -- start start 2023-12-20T04:23:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 shutdown_connections 2023-12-20T04:23:32.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 >> 172.21.15.40:0/2773710554 conn(0x7f78a00b8f60 msgr2=0x7f78a00b9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f16937fe640 1 -- 172.21.15.40:0/749100411 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684031d80 con 0x7f1694149050 2023-12-20T04:23:32.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f38c0fb5640 1 Processor -- start 2023-12-20T04:23:32.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7fd682ffd640 1 -- 172.21.15.40:0/29744897 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780317e0 con 0x7fd67c0072b0 2023-12-20T04:23:32.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7fd682ffd640 1 -- 172.21.15.40:0/29744897 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678031940 con 0x7fd67c0072b0 2023-12-20T04:23:32.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7fd682ffd640 1 -- 172.21.15.40:0/29744897 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678031cd0 con 0x7fd67c0072b0 2023-12-20T04:23:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f35168ce640 1 -- 172.21.15.40:0/2848748956 shutdown_connections 2023-12-20T04:23:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f35168ce640 1 -- 172.21.15.40:0/2848748956 wait complete. 2023-12-20T04:23:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f169b04a640 1 -- 172.21.15.40:0/749100411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1694149050 msgr2=0x7f1694152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f8fecd89640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fe80b6a60 0x7f8fe81470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 shutdown_connections 2023-12-20T04:23:32.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f8fecd89640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe8157f30 0x7f8fe80bb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f78a5701640 1 -- 172.21.15.40:0/2773710554 wait complete. 2023-12-20T04:23:32.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f169b04a640 1 --2- 172.21.15.40:0/749100411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1694149050 0x7f1694152270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f16840097d0 tx=0x7f168402b930 comp rx=0 tx=0).stop 2023-12-20T04:23:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fecd89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe815ad80 0x7f8fe8146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f98a4db3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b6220 0x7f98a01dc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f169b04a640 1 -- 172.21.15.40:0/749100411 shutdown_connections 2023-12-20T04:23:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f169b04a640 1 --2- 172.21.15.40:0/749100411 >> v2:172.21.15.40:3300/0 conn(0x7f1694072000 0x7f1694148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f169b04a640 1 --2- 172.21.15.40:0/749100411 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1694149050 0x7f1694152270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f169b04a640 1 -- 172.21.15.40:0/749100411 >> 172.21.15.40:0/749100411 conn(0x7f16940b8fa0 msgr2=0x7f16940b93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f169b04a640 1 -- 172.21.15.40:0/749100411 shutdown_connections 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7cc007200 0x7fa7cc0d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fecd89640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe80b2770 con 0x7f8fe815ad80 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fecd89640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8086ee0 con 0x7f8fe80b6a60 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fecd89640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe8168ac0 con 0x7f8fe8157f30 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fe6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe815ad80 0x7f8fe8146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fe6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe815ad80 0x7f8fe8146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57368/0 (socket says 172.21.15.40:57368) 2023-12-20T04:23:32.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fe6d9d640 1 -- 172.21.15.40:0/3731000962 learned_addr learned my addr 172.21.15.40:0/3731000962 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fe5d9b640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe8157f30 0x7f8fe80bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f8fe659c640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fe80b6a60 0x7f8fe81470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc0075e0 0x7fa7cc03f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc008cd0 0x7fa7cc0d3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.186+0000 7f38c0fb5640 1 -- start start 2023-12-20T04:23:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f38c0fb5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06b480 0x7f38bc0aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f38c0fb5640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc06fa70 0x7f38bc0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7fa7d2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7cc007200 0x7fa7cc0d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7fa7d2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7cc007200 0x7fa7cc0d4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57382/0 (socket says 172.21.15.40:57382) 2023-12-20T04:23:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7fa7d3fff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc03fb60 con 0x7fa7cc007200 2023-12-20T04:23:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7fa7d3fff640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0d3490 con 0x7fa7cc0075e0 2023-12-20T04:23:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d3fff640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0d52b0 con 0x7fa7cc008cd0 2023-12-20T04:23:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d2ffd640 1 -- 172.21.15.40:0/2997577910 learned_addr learned my addr 172.21.15.40:0/2997577910 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fd6895fd640 1 -- 172.21.15.40:0/29744897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0072b0 msgr2=0x7fd67c040780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fd6895fd640 1 --2- 172.21.15.40:0/29744897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0072b0 0x7fd67c040780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0d18f0 tx=0x7fd67802b880 comp rx=0 tx=0).stop 2023-12-20T04:23:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f98a4db3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b9fd0 0x7f98a00bf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f8fe6d9d640 1 -- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe8157f30 msgr2=0x7f8fe80bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f8fe6d9d640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe8157f30 0x7f8fe80bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f8fe6d9d640 1 -- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fe80b6a60 msgr2=0x7f8fe81470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f8fe6d9d640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fe80b6a60 0x7f8fe81470e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f38bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06b480 0x7f38bc0aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06b480 0x7f38bc0aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57388/0 (socket says 172.21.15.40:57388) 2023-12-20T04:23:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38c0fb5640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38bc152fc0 0x7f38bc1e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d37fe640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc008cd0 0x7fa7cc0d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f98a4db3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a014b170 0x7f98a00be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f35168ce640 1 Processor -- start 2023-12-20T04:23:32.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f8fe6d9d640 1 -- 172.21.15.40:0/3731000962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0093a0 con 0x7f8fe815ad80 2023-12-20T04:23:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38c0fb5640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0ab490 con 0x7f38bc06b480 2023-12-20T04:23:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38c0fb5640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc0aeb50 con 0x7f38bc152fc0 2023-12-20T04:23:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38c0fb5640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc14de00 con 0x7f38bc06fa70 2023-12-20T04:23:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f98a4db3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a013b1c0 con 0x7f98a014b170 2023-12-20T04:23:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f98a4db3640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a01d0e00 con 0x7f98a00b6220 2023-12-20T04:23:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f98a4db3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a01dbd40 con 0x7f98a00b9fd0 2023-12-20T04:23:32.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38baffd640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc06fa70 0x7f38bc0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38bb7fe640 1 -- 172.21.15.40:0/2272612382 learned_addr learned my addr 172.21.15.40:0/2272612382 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d2ffd640 1 -- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc008cd0 msgr2=0x7fa7cc0d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d2ffd640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc008cd0 0x7fa7cc0d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d2ffd640 1 -- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc0075e0 msgr2=0x7fa7cc03f620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-20T04:23:32.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38bbfff640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38bc152fc0 0x7f38bc1e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d2ffd640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc0075e0 0x7fa7cc03f620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d2ffd640 1 -- 172.21.15.40:0/2997577910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c4009400 con 0x7fa7cc007200 2023-12-20T04:23:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f989f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b6220 0x7f98a01dc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f989f7fe640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b6220 0x7f98a01dc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:35998/0 (socket says 172.21.15.40:35998) 2023-12-20T04:23:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f989f7fe640 1 -- 172.21.15.40:0/1906305421 learned_addr learned my addr 172.21.15.40:0/1906305421 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f35168ce640 1 -- start start 2023-12-20T04:23:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.187+0000 7f169b04a640 1 -- 172.21.15.40:0/749100411 wait complete. 2023-12-20T04:23:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38bb7fe640 1 -- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc06fa70 msgr2=0x7f38bc0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38bb7fe640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc06fa70 0x7f38bc0b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38bb7fe640 1 -- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38bc152fc0 msgr2=0x7f38bc1e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7f38bb7fe640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38bc152fc0 0x7f38bc1e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f38bb7fe640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b0009400 con 0x7f38bc06b480 2023-12-20T04:23:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f989f7fe640 1 -- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b9fd0 msgr2=0x7f98a00bf750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-20T04:23:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f989f7fe640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b9fd0 0x7f98a00bf750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f989f7fe640 1 -- 172.21.15.40:0/1906305421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a014b170 msgr2=0x7f98a00be7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f989f7fe640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a014b170 0x7f98a00be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f989f7fe640 1 -- 172.21.15.40:0/1906305421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894011ca0 con 0x7f98a00b6220 2023-12-20T04:23:32.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.188+0000 7fa7d2ffd640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7cc007200 0x7fa7cc0d4c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40098c0 tx=0x7fa7c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f78a5701640 1 Processor -- start 2023-12-20T04:23:32.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f169b04a640 1 Processor -- start 2023-12-20T04:23:32.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f169b04a640 1 -- start start 2023-12-20T04:23:32.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7fa7d37fe640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc008cd0 0x7fa7cc0d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:32.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f989f7fe640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b6220 0x7f98a01dc750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f989800efc0 tx=0x7f989800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f38bb7fe640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06b480 0x7f38bc0aaf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38b400cba0 tx=0x7f38b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f78a5701640 1 -- start start 2023-12-20T04:23:32.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f8fe6d9d640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe815ad80 0x7f8fe8146080 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c890 tx=0x7f8fe000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f38a3fff640 1 -- 172.21.15.40:0/2272612382 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400ad40 con 0x7f38bc06b480 2023-12-20T04:23:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f9887fff640 1 -- 172.21.15.40:0/1906305421 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800cda0 con 0x7f98a00b6220 2023-12-20T04:23:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f9887fff640 1 -- 172.21.15.40:0/1906305421 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989800f040 con 0x7f98a00b6220 2023-12-20T04:23:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f9887fff640 1 -- 172.21.15.40:0/1906305421 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980146c0 con 0x7f98a00b6220 2023-12-20T04:23:32.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f38c0fb5640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc0aeda0 con 0x7f38bc06b480 2023-12-20T04:23:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f8fd6ffd640 1 -- 172.21.15.40:0/3731000962 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000a640 con 0x7f8fe815ad80 2023-12-20T04:23:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f98a4db3640 1 -- 172.21.15.40:0/1906305421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a01dcc90 con 0x7f98a00b6220 2023-12-20T04:23:32.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f8fecd89640 1 -- 172.21.15.40:0/3731000962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe8087180 con 0x7f8fe815ad80 2023-12-20T04:23:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f98a4db3640 1 -- 172.21.15.40:0/1906305421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a01d0b20 con 0x7f98a00b6220 2023-12-20T04:23:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.189+0000 7f38c0fb5640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc14da90 con 0x7f38bc06b480 2023-12-20T04:23:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f35168ce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35100704e0 0x7f35101432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f35168ce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3510140df0 0x7f3510141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f8fecd89640 1 -- 172.21.15.40:0/3731000962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe80884f0 con 0x7f8fe815ad80 2023-12-20T04:23:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7fd6895fd640 1 -- 172.21.15.40:0/29744897 shutdown_connections 2023-12-20T04:23:32.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f169b04a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169406ae20 0x7f1694141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7fd6895fd640 1 --2- 172.21.15.40:0/29744897 >> v2:172.21.15.69:3300/0 conn(0x7fd67c0d1430 0x7fd67c0cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7fd6895fd640 1 --2- 172.21.15.40:0/29744897 >> v2:172.21.15.40:3300/0 conn(0x7fd67c042ac0 0x7fd67c0d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7fd6895fd640 1 --2- 172.21.15.40:0/29744897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0072b0 0x7fd67c040780 secure :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0d18f0 tx=0x7fd67802b880 comp rx=0 tx=0).stop 2023-12-20T04:23:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7fd6895fd640 1 -- 172.21.15.40:0/29744897 >> 172.21.15.40:0/29744897 conn(0x7fd67c0432a0 msgr2=0x7fd67c0436b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f169b04a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1694072000 0x7f16941ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f78a5701640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78880047c0 0x7f78a00b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f350f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3510140df0 0x7f3510141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f169b04a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694149050 0x7f16941ed2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f169b04a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1694141ed0 con 0x7f1694072000 2023-12-20T04:23:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f169b04a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16940b6da0 con 0x7f1694149050 2023-12-20T04:23:32.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f169b04a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16941ec920 con 0x7f169406ae20 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f350f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3510140df0 0x7f3510141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57410/0 (socket says 172.21.15.40:57410) 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f350f7fe640 1 -- 172.21.15.40:0/1813862220 learned_addr learned my addr 172.21.15.40:0/1813862220 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f35168ce640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f3510149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f35168ce640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510143810 con 0x7f3510140df0 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f1693fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1694072000 0x7f16941ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f1693fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1694072000 0x7f16941ecdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57416/0 (socket says 172.21.15.40:57416) 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f1693fff640 1 -- 172.21.15.40:0/3456673255 learned_addr learned my addr 172.21.15.40:0/3456673255 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f1698de6640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169406ae20 0x7f1694141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f35168ce640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101dc930 con 0x7f35100704e0 2023-12-20T04:23:32.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7f35168ce640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35101dbb70 con 0x7f3510147420 2023-12-20T04:23:32.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.190+0000 7fa7bb7fe640 1 -- 172.21.15.40:0/2997577910 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c403e040 con 0x7fa7cc007200 2023-12-20T04:23:32.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f16995e7640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694149050 0x7f16941ed2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7fa7bb7fe640 1 -- 172.21.15.40:0/2997577910 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4039cd0 con 0x7fa7cc007200 2023-12-20T04:23:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7fa7d3fff640 1 -- 172.21.15.40:0/2997577910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc0d5b00 con 0x7fa7cc007200 2023-12-20T04:23:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f1693fff640 1 -- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169406ae20 msgr2=0x7f1694141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f1693fff640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169406ae20 0x7f1694141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f1693fff640 1 -- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694149050 msgr2=0x7f16941ed2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f1693fff640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694149050 0x7f16941ed2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f1693fff640 1 -- 172.21.15.40:0/3456673255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1684009400 con 0x7f1694072000 2023-12-20T04:23:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7fa7d3fff640 1 -- 172.21.15.40:0/2997577910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc036790 con 0x7fa7cc007200 2023-12-20T04:23:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f8fd6ffd640 1 -- 172.21.15.40:0/3731000962 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe000a7a0 con 0x7f8fe815ad80 2023-12-20T04:23:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f350ffff640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35100704e0 0x7f35101432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f350f7fe640 1 -- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 msgr2=0x7f3510149d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-20T04:23:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f350f7fe640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f3510149d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f350f7fe640 1 -- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35100704e0 msgr2=0x7f35101432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f1693fff640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1694072000 0x7f16941ecdb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f168800d800 tx=0x7f168800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f350f7fe640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35100704e0 0x7f35101432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f350f7fe640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350800d050 con 0x7f3510140df0 2023-12-20T04:23:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f350ffff640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35100704e0 0x7f35101432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f38c0fb5640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc061880 con 0x7f38bc06b480 2023-12-20T04:23:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7fd6895fd640 1 -- 172.21.15.40:0/29744897 shutdown_connections 2023-12-20T04:23:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f78a5701640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a0132b10 0x7f78a013d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f78a5701640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78a0132f50 0x7f78a013d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f78a5701640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00b6160 con 0x7f78880047c0 2023-12-20T04:23:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f78a5701640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0144460 con 0x7f78a0132f50 2023-12-20T04:23:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f78a5701640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0143260 con 0x7f78a0132b10 2023-12-20T04:23:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f38a3fff640 1 -- 172.21.15.40:0/2272612382 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b401c440 con 0x7f38bc06b480 2023-12-20T04:23:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f8fd6ffd640 1 -- 172.21.15.40:0/3731000962 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000ab90 con 0x7f8fe815ad80 2023-12-20T04:23:32.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f38a3fff640 1 -- 172.21.15.40:0/2272612382 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400aea0 con 0x7f38bc06b480 2023-12-20T04:23:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe804e840 con 0x7f8fe815ad80 2023-12-20T04:23:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.191+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9878005250 con 0x7f98a00b6220 2023-12-20T04:23:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f16917fa640 1 -- 172.21.15.40:0/3456673255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688018070 con 0x7f1694072000 2023-12-20T04:23:32.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f350f7fe640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3510140df0 0x7f3510141be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f350803a040 tx=0x7f3508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16940b6ff0 con 0x7f1694072000 2023-12-20T04:23:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7fa7bb7fe640 1 -- 172.21.15.40:0/2997577910 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4044610 con 0x7fa7cc007200 2023-12-20T04:23:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f8fd6ffd640 1 -- 172.21.15.40:0/3731000962 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8fe00070d0 con 0x7f8fe815ad80 2023-12-20T04:23:32.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.192+0000 7f9887fff640 1 -- 172.21.15.40:0/1906305421 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9898014820 con 0x7f98a00b6220 2023-12-20T04:23:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f9887fff640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f988c06a500 0x7f988c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f9887fff640 1 -- 172.21.15.40:0/1906305421 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9898088e70 con 0x7f98a00b6220 2023-12-20T04:23:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16940b75b0 con 0x7f1694072000 2023-12-20T04:23:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f38a3fff640 1 -- 172.21.15.40:0/2272612382 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f38b401c870 con 0x7f38bc06b480 2023-12-20T04:23:32.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f789ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78880047c0 0x7f78a00b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f789ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78880047c0 0x7f78a00b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57418/0 (socket says 172.21.15.40:57418) 2023-12-20T04:23:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f789ffff640 1 -- 172.21.15.40:0/1591820017 learned_addr learned my addr 172.21.15.40:0/1591820017 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f16917fa640 1 -- 172.21.15.40:0/3456673255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1688004020 con 0x7f1694072000 2023-12-20T04:23:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc006990 con 0x7fa7cc007200 2023-12-20T04:23:32.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7f16917fa640 1 -- 172.21.15.40:0/3456673255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688004190 con 0x7f1694072000 2023-12-20T04:23:32.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7fa7bb7fe640 1 -- 172.21.15.40:0/2997577910 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7c404d3b0 con 0x7fa7cc007200 2023-12-20T04:23:32.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f989effd640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f988c06a500 0x7f988c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f8fd6ffd640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f8fc806a480 0x7f8fc806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.193+0000 7fd6895fd640 1 -- 172.21.15.40:0/29744897 wait complete. 2023-12-20T04:23:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f8fe659c640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f8fc806a480 0x7f8fc806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f8fd6ffd640 1 -- 172.21.15.40:0/3731000962 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fe0088230 con 0x7f8fe815ad80 2023-12-20T04:23:32.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f38a3fff640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f38a806a430 0x7f38a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7fa7bb7fe640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa7c006a480 0x7fa7c006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f38a3fff640 1 -- 172.21.15.40:0/2272612382 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38b40888e0 con 0x7f38bc06b480 2023-12-20T04:23:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f38baffd640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f38a806a430 0x7f38a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f789f7fe640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a0132b10 0x7f78a013d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f78a4f00640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78a0132f50 0x7f78a013d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7fa7bb7fe640 1 -- 172.21.15.40:0/2997577910 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c40aaf80 con 0x7fa7cc007200 2023-12-20T04:23:32.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7f989effd640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f988c06a500 0x7f988c06c9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98a013baa0 tx=0x7f9890006b30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.194+0000 7fa7d27fc640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa7c006a480 0x7fa7c006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789f7fe640 1 -- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78a0132f50 msgr2=0x7f78a013d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789f7fe640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78a0132f50 0x7f78a013d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789f7fe640 1 -- 172.21.15.40:0/1591820017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78880047c0 msgr2=0x7f78a00b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789f7fe640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78880047c0 0x7f78a00b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789f7fe640 1 -- 172.21.15.40:0/1591820017 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0085880 con 0x7f78a0132b10 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789f7fe640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a0132b10 0x7f78a013d430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7890033000 tx=0x7f789002e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7fa7d27fc640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa7c006a480 0x7fa7c006c940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc1618e0 tx=0x7fa7c8007a40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f8fe659c640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f8fc806a480 0x7f8fc806c940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc034000 tx=0x7f8fdc008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7fd6895fd640 1 Processor -- start 2023-12-20T04:23:32.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789cff9640 1 -- 172.21.15.40:0/1591820017 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78900054d0 con 0x7f78a0132b10 2023-12-20T04:23:32.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789cff9640 1 -- 172.21.15.40:0/1591820017 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78900035f0 con 0x7f78a0132b10 2023-12-20T04:23:32.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f789cff9640 1 -- 172.21.15.40:0/1591820017 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78900039a0 con 0x7f78a0132b10 2023-12-20T04:23:32.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a0085b60 con 0x7f78a0132b10 2023-12-20T04:23:32.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7fd6895fd640 1 -- start start 2023-12-20T04:23:32.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f350cff9640 1 -- 172.21.15.40:0/1813862220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508043470 con 0x7f3510140df0 2023-12-20T04:23:32.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f350cff9640 1 -- 172.21.15.40:0/1813862220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3508043610 con 0x7f3510140df0 2023-12-20T04:23:32.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7f16917fa640 1 -- 172.21.15.40:0/3456673255 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f16880042f0 con 0x7f1694072000 2023-12-20T04:23:32.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7f38baffd640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f38a806a430 0x7f38a806c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38b0036000 tx=0x7f38b003d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a00b6510 con 0x7f78a0132b10 2023-12-20T04:23:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7f16917fa640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f168006a480 0x7f168006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f350cff9640 1 -- 172.21.15.40:0/1813862220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35080439c0 con 0x7f3510140df0 2023-12-20T04:23:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7fd6895fd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67c042ac0 0x7fd67c0d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1674005250 con 0x7f1694072000 2023-12-20T04:23:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f35168ce640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35101dbe50 con 0x7f3510140df0 2023-12-20T04:23:32.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.195+0000 7f35168ce640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35101dc410 con 0x7f3510140df0 2023-12-20T04:23:32.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7fd6895fd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0d1430 0x7fd67c0d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.196+0000 7fd6895fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd67c16a0b0 0x7fd67c16a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e8005250 con 0x7f3510140df0 2023-12-20T04:23:32.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7f1698de6640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f168006a480 0x7f168006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd6895fd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0d3e00 con 0x7fd67c16a0b0 2023-12-20T04:23:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd6895fd640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c169980 con 0x7fd67c042ac0 2023-12-20T04:23:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd6895fd640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c0cba40 con 0x7fd67c0d1430 2023-12-20T04:23:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd67c16a0b0 0x7fd67c16a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd67c16a0b0 0x7fd67c16a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57430/0 (socket says 172.21.15.40:57430) 2023-12-20T04:23:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 -- 172.21.15.40:0/2736167221 learned_addr learned my addr 172.21.15.40:0/2736167221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:32.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd683fff640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67c042ac0 0x7fd67c0d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7f1698de6640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f168006a480 0x7f168006c940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f168c001920 tx=0x7f168c0018b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 -- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0d1430 msgr2=0x7fd67c0d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0d1430 0x7fd67c0d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a0143260 con 0x7f78a0132b10 2023-12-20T04:23:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 -- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67c042ac0 msgr2=0x7fd67c0d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67c042ac0 0x7fd67c0d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.197+0000 7fd688dfc640 1 -- 172.21.15.40:0/2736167221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670009400 con 0x7fd67c16a0b0 2023-12-20T04:23:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.198+0000 7fd688dfc640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd67c16a0b0 0x7fd67c16a530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd684063940 tx=0x7fd6840671f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.198+0000 7f9887fff640 1 -- 172.21.15.40:0/1906305421 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9898054590 con 0x7f98a00b6220 2023-12-20T04:23:32.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.198+0000 7f789cff9640 1 -- 172.21.15.40:0/1591820017 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7890003b00 con 0x7f78a0132b10 2023-12-20T04:23:32.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.199+0000 7f789cff9640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f788c06a520 0x7f788c06c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.199+0000 7f789ffff640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f788c06a520 0x7f788c06c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.199+0000 7f789cff9640 1 -- 172.21.15.40:0/1591820017 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78900aaa00 con 0x7f78a0132b10 2023-12-20T04:23:32.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.199+0000 7f789ffff640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f788c06a520 0x7f788c06c9e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7894009800 tx=0x7f7894008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.200+0000 7f16917fa640 1 -- 172.21.15.40:0/3456673255 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16880580c0 con 0x7f1694072000 2023-12-20T04:23:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.200+0000 7fd680ff9640 1 -- 172.21.15.40:0/2736167221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68408e070 con 0x7fd67c16a0b0 2023-12-20T04:23:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.201+0000 7f38a3fff640 1 -- 172.21.15.40:0/2272612382 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f38b4053ee0 con 0x7f38bc06b480 2023-12-20T04:23:32.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.200+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6780094d0 con 0x7fd67c16a0b0 2023-12-20T04:23:32.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.201+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c0c6c50 con 0x7fd67c16a0b0 2023-12-20T04:23:32.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.201+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67c0d18f0 con 0x7fd67c16a0b0 2023-12-20T04:23:32.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.203+0000 7f789cff9640 1 -- 172.21.15.40:0/1591820017 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7890075f60 con 0x7f78a0132b10 2023-12-20T04:23:32.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.206+0000 7f8fd6ffd640 1 -- 172.21.15.40:0/3731000962 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8fe0053940 con 0x7f8fe815ad80 2023-12-20T04:23:32.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.213+0000 7fa7bb7fe640 1 -- 172.21.15.40:0/2997577910 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa7c4076870 con 0x7fa7cc007200 2023-12-20T04:23:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.215+0000 7f350cff9640 1 -- 172.21.15.40:0/1813862220 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3508043b20 con 0x7f3510140df0 2023-12-20T04:23:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.216+0000 7f350cff9640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f34f006a480 0x7f34f006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.218+0000 7f350ffff640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f34f006a480 0x7f34f006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.218+0000 7f350ffff640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f34f006a480 0x7f34f006c940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3500003ea0 tx=0x7f3500009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.223+0000 7f350cff9640 1 -- 172.21.15.40:0/1813862220 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f350807ae40 con 0x7f3510140df0 2023-12-20T04:23:32.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.223+0000 7f16917fa640 1 -- 172.21.15.40:0/3456673255 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1688053d00 con 0x7f1694072000 2023-12-20T04:23:32.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.223+0000 7fd680ff9640 1 -- 172.21.15.40:0/2736167221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd684073500 con 0x7fd67c16a0b0 2023-12-20T04:23:32.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.224+0000 7fd680ff9640 1 -- 172.21.15.40:0/2736167221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd684073870 con 0x7fd67c16a0b0 2023-12-20T04:23:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.226+0000 7fd680ff9640 1 -- 172.21.15.40:0/2736167221 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd68409a360 con 0x7fd67c16a0b0 2023-12-20T04:23:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.227+0000 7fd680ff9640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd66806a430 0x7fd66806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.229+0000 7fd683fff640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd66806a430 0x7fd66806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.229+0000 7fd683fff640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd66806a430 0x7fd66806c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd678036000 tx=0x7fd67803d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.233+0000 7f350cff9640 1 -- 172.21.15.40:0/1813862220 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3508076a80 con 0x7f3510140df0 2023-12-20T04:23:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.234+0000 7fd680ff9640 1 -- 172.21.15.40:0/2736167221 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6840d1860 con 0x7fd67c16a0b0 2023-12-20T04:23:32.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.242+0000 7fd680ff9640 1 -- 172.21.15.40:0/2736167221 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd6840cd4a0 con 0x7fd67c16a0b0 2023-12-20T04:23:32.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.589+0000 7f38c0fb5640 1 -- 172.21.15.40:0/2272612382 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f38bc0b76c0 con 0x7f38bc06b480 2023-12-20T04:23:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.591+0000 7f38a3fff640 1 -- 172.21.15.40:0/2272612382 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38b4017090 con 0x7f38bc06b480 2023-12-20T04:23:32.593 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.594+0000 7f38a1ffb640 1 -- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f38a806a430 msgr2=0x7f38a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.594+0000 7f38a1ffb640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f38a806a430 0x7f38a806c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38b0036000 tx=0x7f38b003d040 comp rx=0 tx=0).stop 2023-12-20T04:23:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.594+0000 7f38a1ffb640 1 -- 172.21.15.40:0/2272612382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06b480 msgr2=0x7f38bc0aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.594+0000 7f38a1ffb640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06b480 0x7f38bc0aaf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38b400cba0 tx=0x7f38b400a430 comp rx=0 tx=0).stop 2023-12-20T04:23:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.595+0000 7f38a1ffb640 1 -- 172.21.15.40:0/2272612382 shutdown_connections 2023-12-20T04:23:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.595+0000 7f38a1ffb640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f38a806a430 0x7f38a806c8f0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38b0036000 tx=0x7f38b003d040 comp rx=0 tx=0).stop 2023-12-20T04:23:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.595+0000 7f38a1ffb640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38bc152fc0 0x7f38bc1e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.595+0000 7f38a1ffb640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f38bc06fa70 0x7f38bc0b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.595+0000 7f38a1ffb640 1 --2- 172.21.15.40:0/2272612382 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38bc06b480 0x7f38bc0aaf50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.595+0000 7f38a1ffb640 1 -- 172.21.15.40:0/2272612382 >> 172.21.15.40:0/2272612382 conn(0x7f38bc0bbed0 msgr2=0x7f38bc0b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.595+0000 7f38a1ffb640 1 -- 172.21.15.40:0/2272612382 shutdown_connections 2023-12-20T04:23:32.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.596+0000 7f38a1ffb640 1 -- 172.21.15.40:0/2272612382 wait complete. 2023-12-20T04:23:32.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.611+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fe8158e40 con 0x7f8fe815ad80 2023-12-20T04:23:32.613 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-12-20T04:23:32.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.612+0000 7f8fd6ffd640 1 -- 172.21.15.40:0/3731000962 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fe0018090 con 0x7f8fe815ad80 2023-12-20T04:23:32.613 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:32.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.613+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa7cc03a380 con 0x7fa7cc007200 2023-12-20T04:23:32.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.614+0000 7fa7bb7fe640 1 -- 172.21.15.40:0/2997577910 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7c4079e90 con 0x7fa7cc007200 2023-12-20T04:23:32.615 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f8fc806a480 msgr2=0x7f8fc806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f8fc806a480 0x7f8fc806c940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc034000 tx=0x7f8fdc008030 comp rx=0 tx=0).stop 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe815ad80 msgr2=0x7f8fe8146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe815ad80 0x7f8fe8146080 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8fe000c890 tx=0x7f8fe000cd50 comp rx=0 tx=0).stop 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 shutdown_connections 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f8fc806a480 0x7f8fc806c940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fe815ad80 0x7f8fe8146080 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8fe8157f30 0x7f8fe80bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 --2- 172.21.15.40:0/3731000962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fe80b6a60 0x7f8fe81470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 >> 172.21.15.40:0/3731000962 conn(0x7f8fe80b88a0 msgr2=0x7f8fe815a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 shutdown_connections 2023-12-20T04:23:32.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.615+0000 7f8fd4ff9640 1 -- 172.21.15.40:0/3731000962 wait complete. 2023-12-20T04:23:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.617+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa7c006a480 msgr2=0x7fa7c006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.617+0000 7fa7b97fa640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa7c006a480 0x7fa7c006c940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc1618e0 tx=0x7fa7c8007a40 comp rx=0 tx=0).stop 2023-12-20T04:23:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.617+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7cc007200 msgr2=0x7fa7cc0d4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7cc007200 0x7fa7cc0d4c30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40098c0 tx=0x7fa7c4004730 comp rx=0 tx=0).stop 2023-12-20T04:23:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9878005500 con 0x7f98a00b6220 2023-12-20T04:23:32.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 shutdown_connections 2023-12-20T04:23:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa7c006a480 0x7fa7c006c940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa7cc008cd0 0x7fa7cc0d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7cc0075e0 0x7fa7cc03f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 --2- 172.21.15.40:0/2997577910 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa7cc007200 0x7fa7cc0d4c30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 >> 172.21.15.40:0/2997577910 conn(0x7fa7cc007c30 msgr2=0x7fa7cc0d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78a0066d80 con 0x7f78a0132b10 2023-12-20T04:23:32.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7f9887fff640 1 -- 172.21.15.40:0/1906305421 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9898057bb0 con 0x7f98a00b6220 2023-12-20T04:23:32.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.618+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 shutdown_connections 2023-12-20T04:23:32.621 INFO:teuthology.orchestra.run.smithi040.stdout:55834574853 2023-12-20T04:23:32.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.619+0000 7f789cff9640 1 -- 172.21.15.40:0/1591820017 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f789004d090 con 0x7f78a0132b10 2023-12-20T04:23:32.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.619+0000 7fa7b97fa640 1 -- 172.21.15.40:0/2997577910 wait complete. 2023-12-20T04:23:32.622 INFO:teuthology.orchestra.run.smithi040.stdout:55834574853 2023-12-20T04:23:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f988c06a500 msgr2=0x7f988c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f988c06a500 0x7f988c06c9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98a013baa0 tx=0x7f9890006b30 comp rx=0 tx=0).stop 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b6220 msgr2=0x7f98a01dc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b6220 0x7f98a01dc750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f989800efc0 tx=0x7f989800c490 comp rx=0 tx=0).stop 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 shutdown_connections 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f988c06a500 0x7f988c06c9c0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f98a013baa0 tx=0x7f9890006b30 comp rx=0 tx=0).stop 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98a014b170 0x7f98a00be7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98a00b9fd0 0x7f98a00bf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 --2- 172.21.15.40:0/1906305421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98a00b6220 0x7f98a01dc750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 >> 172.21.15.40:0/1906305421 conn(0x7f98a00c0090 msgr2=0x7f98a00b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 shutdown_connections 2023-12-20T04:23:32.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.621+0000 7f9885ffb640 1 -- 172.21.15.40:0/1906305421 wait complete. 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.622+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f788c06a520 msgr2=0x7f788c06c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.622+0000 7f78a5701640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f788c06a520 0x7f788c06c9e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7894009800 tx=0x7f7894008040 comp rx=0 tx=0).stop 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.622+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a0132b10 msgr2=0x7f78a013d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.622+0000 7f78a5701640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a0132b10 0x7f78a013d430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7890033000 tx=0x7f789002e070 comp rx=0 tx=0).stop 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.622+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 shutdown_connections 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.623+0000 7f78a5701640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f788c06a520 0x7f788c06c9e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.623+0000 7f78a5701640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78a0132f50 0x7f78a013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.623+0000 7f78a5701640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78a0132b10 0x7f78a013d430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.623+0000 7f78a5701640 1 --2- 172.21.15.40:0/1591820017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78880047c0 0x7f78a00b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.623+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 >> 172.21.15.40:0/1591820017 conn(0x7f78a00b8f60 msgr2=0x7f78a0140170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.623+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 shutdown_connections 2023-12-20T04:23:32.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.623+0000 7f78a5701640 1 -- 172.21.15.40:0/1591820017 wait complete. 2023-12-20T04:23:32.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.626+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1674005500 con 0x7f1694072000 2023-12-20T04:23:32.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.626+0000 7f16917fa640 1 -- 172.21.15.40:0/3456673255 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1688057320 con 0x7f1694072000 2023-12-20T04:23:32.627 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f168006a480 msgr2=0x7f168006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f168006a480 0x7f168006c940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f168c001920 tx=0x7f168c0018b0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1694072000 msgr2=0x7f16941ecdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1694072000 0x7f16941ecdb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f168800d800 tx=0x7f168800dcc0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 shutdown_connections 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f168006a480 0x7f168006c940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1694149050 0x7f16941ed2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1694072000 0x7f16941ecdb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 --2- 172.21.15.40:0/3456673255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f169406ae20 0x7f1694141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.630+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 >> 172.21.15.40:0/3456673255 conn(0x7f16940b8fa0 msgr2=0x7f1694145b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.631+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 shutdown_connections 2023-12-20T04:23:32.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.631+0000 7f169b04a640 1 -- 172.21.15.40:0/3456673255 wait complete. 2023-12-20T04:23:32.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-12-20T04:23:32.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.637+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f34e80057d0 con 0x7f3510140df0 2023-12-20T04:23:32.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.637+0000 7f350cff9640 1 -- 172.21.15.40:0/1813862220 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3508047070 con 0x7f3510140df0 2023-12-20T04:23:32.638 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-12-20T04:23:32.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-12-20T04:23:32.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-12-20T04:23:32.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f34f006a480 msgr2=0x7f34f006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f34f006a480 0x7f34f006c940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3500003ea0 tx=0x7f3500009040 comp rx=0 tx=0).stop 2023-12-20T04:23:32.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3510140df0 msgr2=0x7f3510141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3510140df0 0x7f3510141be0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f350803a040 tx=0x7f3508004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 shutdown_connections 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f34f006a480 0x7f34f006c940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3510147420 0x7f3510149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3510140df0 0x7f3510141be0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 --2- 172.21.15.40:0/1813862220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35100704e0 0x7f35101432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 >> 172.21.15.40:0/1813862220 conn(0x7f35100b88a0 msgr2=0x7f35100b9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 shutdown_connections 2023-12-20T04:23:32.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.640+0000 7f35067fc640 1 -- 172.21.15.40:0/1813862220 wait complete. 2023-12-20T04:23:32.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-12-20T04:23:32.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.645+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd67c0423e0 con 0x7fd67c16a0b0 2023-12-20T04:23:32.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.645+0000 7fd680ff9640 1 -- 172.21.15.40:0/2736167221 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd684097070 con 0x7fd67c16a0b0 2023-12-20T04:23:32.646 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-12-20T04:23:32.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-12-20T04:23:32.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.647+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd66806a430 msgr2=0x7fd66806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.647+0000 7fd6895fd640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd66806a430 0x7fd66806c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd678036000 tx=0x7fd67803d040 comp rx=0 tx=0).stop 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.647+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd67c16a0b0 msgr2=0x7fd67c16a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.647+0000 7fd6895fd640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd67c16a0b0 0x7fd67c16a530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd684063940 tx=0x7fd6840671f0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 shutdown_connections 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd66806a430 0x7fd66806c8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd67c16a0b0 0x7fd67c16a530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd67c0d1430 0x7fd67c0d4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 --2- 172.21.15.40:0/2736167221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67c042ac0 0x7fd67c0d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 >> 172.21.15.40:0/2736167221 conn(0x7fd67c0432a0 msgr2=0x7fd67c041c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 shutdown_connections 2023-12-20T04:23:32.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:32.648+0000 7fd6895fd640 1 -- 172.21.15.40:0/2736167221 wait complete. 2023-12-20T04:23:32.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-12-20T04:23:32.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-12-20T04:23:33.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-20T04:23:33.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-20T04:23:33.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-20T04:23:33.641 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-20T04:23:33.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-20T04:23:33.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-20T04:23:33.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-20T04:23:33.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.793+0000 7fa8a67d0640 1 Processor -- start 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.793+0000 7fa8a67d0640 1 -- start start 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.794+0000 7fa8a67d0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 0x7fa8a006abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.794+0000 7fa8a67d0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a01476b0 0x7fa8a0151770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.794+0000 7fa8a67d0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a0070900 con 0x7fa8a00700f0 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.794+0000 7fa8a67d0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00b3d10 con 0x7fa8a01476b0 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.794+0000 7fa8a67d0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0141650 con 0x7fa8a0141270 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.795+0000 7fa8a5fcf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a01476b0 0x7fa8a0151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.795+0000 7fa8a5fcf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8a01476b0 0x7fa8a0151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57436/0 (socket says 172.21.15.40:57436) 2023-12-20T04:23:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.795+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/3242579205 learned_addr learned my addr 172.21.15.40:0/3242579205 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.795+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/3242579205 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 msgr2=0x7fa8a006abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.795+0000 7fa8a5fcf640 1 --2- 172.21.15.40:0/3242579205 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 0x7fa8a006abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.795+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/3242579205 >> v1:172.21.15.69:6789/0 conn(0x7fa8a00700f0 legacy=0x7fa8a0146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.795+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/3242579205 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00711a0 con 0x7fa8a01476b0 2023-12-20T04:23:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.796+0000 7fa8a5fcf640 1 --2- 172.21.15.40:0/3242579205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a01476b0 0x7fa8a0151770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa898009e80 tx=0x7fa89802e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1740c02a5b0da54a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.797+0000 7fa897fff640 1 -- 172.21.15.40:0/3242579205 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89802ec70 con 0x7fa8a01476b0 2023-12-20T04:23:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.797+0000 7fa897fff640 1 -- 172.21.15.40:0/3242579205 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89802edd0 con 0x7fa8a01476b0 2023-12-20T04:23:33.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.798+0000 7fa8a67d0640 1 -- 172.21.15.40:0/3242579205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a01476b0 msgr2=0x7fa8a0151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.798+0000 7fa8a67d0640 1 --2- 172.21.15.40:0/3242579205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a01476b0 0x7fa8a0151770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa898009e80 tx=0x7fa89802e0d0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.799+0000 7fa8a67d0640 1 -- 172.21.15.40:0/3242579205 shutdown_connections 2023-12-20T04:23:33.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.799+0000 7fa8a67d0640 1 --2- 172.21.15.40:0/3242579205 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a01476b0 0x7fa8a0151770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.799+0000 7fa8a67d0640 1 --2- 172.21.15.40:0/3242579205 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 0x7fa8a006abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.799+0000 7fa8a67d0640 1 -- 172.21.15.40:0/3242579205 >> 172.21.15.40:0/3242579205 conn(0x7fa8a00b9040 msgr2=0x7fa8a00b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.799+0000 7fa8a67d0640 1 -- 172.21.15.40:0/3242579205 shutdown_connections 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.799+0000 7fa8a67d0640 1 -- 172.21.15.40:0/3242579205 wait complete. 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.801+0000 7fa8a67d0640 1 Processor -- start 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.801+0000 7fa8a67d0640 1 -- start start 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.802+0000 7fa8a67d0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8a00700f0 0x7fa8a00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.802+0000 7fa8a67d0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 0x7fa8a01e0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.802+0000 7fa8a67d0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a00b5e30 0x7fa8a013f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.802+0000 7fa8a67d0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b54d0 con 0x7fa8a00b5e30 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.802+0000 7fa8a67d0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0146a00 con 0x7fa8a00700f0 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.802+0000 7fa8a67d0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a013f170 con 0x7fa8a0141270 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a00b5e30 0x7fa8a013f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a00b5e30 0x7fa8a013f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57442/0 (socket says 172.21.15.40:57442) 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/1439079754 learned_addr learned my addr 172.21.15.40:0/1439079754 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 msgr2=0x7fa8a01e0760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 0x7fa8a01e0760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8a00700f0 msgr2=0x7fa8a00b4f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8a00700f0 0x7fa8a00b4f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 -- 172.21.15.40:0/1439079754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898009b30 con 0x7fa8a00b5e30 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.803+0000 7fa8a5fcf640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a00b5e30 0x7fa8a013f600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa898009fa0 tx=0x7fa898004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.805+0000 7fa895ffb640 1 -- 172.21.15.40:0/1439079754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800f250 con 0x7fa8a00b5e30 2023-12-20T04:23:33.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.806+0000 7fa8a67d0640 1 -- 172.21.15.40:0/1439079754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a0140a70 con 0x7fa8a00b5e30 2023-12-20T04:23:33.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.806+0000 7fa8a67d0640 1 -- 172.21.15.40:0/1439079754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00b62c0 con 0x7fa8a00b5e30 2023-12-20T04:23:33.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.810+0000 7fa895ffb640 1 -- 172.21.15.40:0/1439079754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898036de0 con 0x7fa8a00b5e30 2023-12-20T04:23:33.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.810+0000 7fa895ffb640 1 -- 172.21.15.40:0/1439079754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898040660 con 0x7fa8a00b5e30 2023-12-20T04:23:33.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.811+0000 7fa895ffb640 1 -- 172.21.15.40:0/1439079754 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa898040880 con 0x7fa8a00b5e30 2023-12-20T04:23:33.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.812+0000 7fa895ffb640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa88406a580 0x7fa88406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.812+0000 7fa895ffb640 1 -- 172.21.15.40:0/1439079754 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8980ab500 con 0x7fa8a00b5e30 2023-12-20T04:23:33.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.812+0000 7fa8a57ce640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa88406a580 0x7fa88406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.813+0000 7fa8a67d0640 1 -- 172.21.15.40:0/1439079754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa880005250 con 0x7fa8a00b5e30 2023-12-20T04:23:33.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.823+0000 7fa895ffb640 1 -- 172.21.15.40:0/1439079754 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa898076c80 con 0x7fa8a00b5e30 2023-12-20T04:23:33.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.827+0000 7fa8a57ce640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa88406a580 0x7fa88406ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009610 tx=0x7fa89c006b80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.840+0000 7fb439f39640 1 Processor -- start 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.840+0000 7fb439f39640 1 -- start start 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.841+0000 7fb439f39640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb43415b3d0 0x7fb434157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.841+0000 7fb439f39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4340b7170 0x7fb434158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.841+0000 7fb439f39640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4340716a0 con 0x7fb43415aff0 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.841+0000 7fb439f39640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb434070a40 con 0x7fb4340b7170 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.841+0000 7fb439f39640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4340b9790 con 0x7fb43415b3d0 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb432ffd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb43415b3d0 0x7fb434157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb432ffd640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb43415b3d0 0x7fb434157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:36038/0 (socket says 172.21.15.40:36038) 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb432ffd640 1 -- 172.21.15.40:0/1438837076 learned_addr learned my addr 172.21.15.40:0/1438837076 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb433fff640 1 --2- 172.21.15.40:0/1438837076 >> v2:172.21.15.40:3300/0 conn(0x7fb4340b7170 0x7fb434158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb432ffd640 1 -- 172.21.15.40:0/1438837076 >> v2:172.21.15.40:3300/0 conn(0x7fb4340b7170 msgr2=0x7fb434158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:33.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb432ffd640 1 --2- 172.21.15.40:0/1438837076 >> v2:172.21.15.40:3300/0 conn(0x7fb4340b7170 0x7fb434158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb432ffd640 1 -- 172.21.15.40:0/1438837076 >> v1:172.21.15.69:6789/0 conn(0x7fb43415aff0 legacy=0x7fb4340b6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.842+0000 7fb432ffd640 1 -- 172.21.15.40:0/1438837076 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4341589b0 con 0x7fb43415b3d0 2023-12-20T04:23:33.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.843+0000 7fb433fff640 1 --2- 172.21.15.40:0/1438837076 >> v2:172.21.15.40:3300/0 conn(0x7fb4340b7170 0x7fb434158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:33.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.843+0000 7f3f8bfff640 1 Processor -- start 2023-12-20T04:23:33.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7fb432ffd640 1 --2- 172.21.15.40:0/1438837076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 0x7fb434157f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb43406e820 tx=0x7fb42c0301a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13141d5dced7ec65 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f56df6e7640 1 Processor -- start 2023-12-20T04:23:33.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.843+0000 7f3f8bfff640 1 -- start start 2023-12-20T04:23:33.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7fb4327fc640 1 -- 172.21.15.40:0/1438837076 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c03a400 con 0x7fb43415b3d0 2023-12-20T04:23:33.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7fb4327fc640 1 -- 172.21.15.40:0/1438837076 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c034070 con 0x7fb43415b3d0 2023-12-20T04:23:33.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f56df6e7640 1 -- start start 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb4327fc640 1 -- 172.21.15.40:0/1438837076 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c03a7a0 con 0x7fb43415b3d0 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f3f8bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f8c0bc7e0 0x7f3f8c143c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f3f8bfff640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c14abc0 con 0x7f3f8c144170 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f3f8bfff640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c14a290 con 0x7f3f8c06e9a0 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f3f8bfff640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c14a570 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f3f8a7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f8c0bc7e0 0x7f3f8c143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f3f8a7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3f8c0bc7e0 0x7f3f8c143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57454/0 (socket says 172.21.15.40:57454) 2023-12-20T04:23:33.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.844+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3806977835 learned_addr learned my addr 172.21.15.40:0/3806977835 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 -- 172.21.15.40:0/1438837076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 msgr2=0x7fb434157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 --2- 172.21.15.40:0/1438837076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 0x7fb434157f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb43406e820 tx=0x7fb42c0301a0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 -- 172.21.15.40:0/1438837076 shutdown_connections 2023-12-20T04:23:33.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 --2- 172.21.15.40:0/1438837076 >> v2:172.21.15.40:3300/0 conn(0x7fb4340b7170 0x7fb434158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 --2- 172.21.15.40:0/1438837076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 0x7fb434157f30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 -- 172.21.15.40:0/1438837076 >> 172.21.15.40:0/1438837076 conn(0x7fb4340b88a0 msgr2=0x7fb4340b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3806977835 >> v1:172.21.15.69:6789/0 conn(0x7f3f8c06e9a0 legacy=0x7f3f8c06b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3806977835 >> v1:172.21.15.40:6789/0 conn(0x7f3f8c144170 legacy=0x7f3f8c146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3806977835 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c14a850 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f56df6e7640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f56d0036c20 0x7f56d003f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f56df6e7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56d00428d0 0x7f56d0008ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f56df6e7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d00d4670 con 0x7f56d0042cf0 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f56df6e7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d0043220 con 0x7f56d00428d0 2023-12-20T04:23:33.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f56df6e7640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d003de80 con 0x7f56d0036c20 2023-12-20T04:23:33.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f56ddc84640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56d0042cf0 0x7f56d00cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52914/0 (socket says 172.21.15.40:52914) 2023-12-20T04:23:33.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f56ddc84640 1 -- 172.21.15.40:0/2822995781 learned_addr learned my addr 172.21.15.40:0/2822995781 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:33.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 -- 172.21.15.40:0/1438837076 shutdown_connections 2023-12-20T04:23:33.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7fb439f39640 1 -- 172.21.15.40:0/1438837076 wait complete. 2023-12-20T04:23:33.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f266f55c640 1 Processor -- start 2023-12-20T04:23:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.845+0000 7f266f55c640 1 -- start start 2023-12-20T04:23:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266f55c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2660007020 0x7f266003b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266f55c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f26600d08f0 0x7f26600d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266f55c640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266003a990 con 0x7f26600d04b0 2023-12-20T04:23:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266f55c640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266003a500 con 0x7f26600d08f0 2023-12-20T04:23:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266f55c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600d0d10 con 0x7f2660007020 2023-12-20T04:23:33.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f56dd483640 1 --2- 172.21.15.40:0/2822995781 >> v2:172.21.15.69:3300/0 conn(0x7f56d0036c20 0x7f56d003f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266d2f8640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2660007020 0x7f266003b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266caf7640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f26600d04b0 0x7f26600c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43976/0 (socket says 172.21.15.40:43976) 2023-12-20T04:23:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.846+0000 7f266caf7640 1 -- 172.21.15.40:0/2340136181 learned_addr learned my addr 172.21.15.40:0/2340136181 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:33.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f266daf9640 1 --2- 172.21.15.40:0/2340136181 >> v2:172.21.15.69:3300/0 conn(0x7f26600d08f0 0x7f26600d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f56dcc82640 1 --2- 172.21.15.40:0/2822995781 >> v2:172.21.15.40:3300/0 conn(0x7f56d00428d0 0x7f56d0008ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f3f8a7fc640 1 --2- 172.21.15.40:0/3806977835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c143c30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f84014a00 tx=0x7f3f84034a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e3ee20e4bfc6a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f265ffff640 1 -- 172.21.15.40:0/2340136181 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413387836 0 0) 0x7f2664001110 con 0x7f26600d04b0 2023-12-20T04:23:33.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7fb439f39640 1 Processor -- start 2023-12-20T04:23:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f3f89ffb640 1 -- 172.21.15.40:0/3806977835 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840114e0 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f3f89ffb640 1 -- 172.21.15.40:0/3806977835 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f84011640 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f266daf9640 1 -- 172.21.15.40:0/2340136181 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2660007020 msgr2=0x7f266003b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:33.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f266daf9640 1 --2- 172.21.15.40:0/2340136181 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2660007020 0x7f266003b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f266daf9640 1 -- 172.21.15.40:0/2340136181 >> v1:172.21.15.69:6789/0 conn(0x7f26600d04b0 legacy=0x7f26600c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f266daf9640 1 -- 172.21.15.40:0/2340136181 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2660039bd0 con 0x7f26600d08f0 2023-12-20T04:23:33.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f81cd46d640 1 Processor -- start 2023-12-20T04:23:33.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f81cd46d640 1 -- start start 2023-12-20T04:23:33.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f56cffff640 1 -- 172.21.15.40:0/2822995781 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138694056 0 0) 0x7f56d00d4670 con 0x7f56d0042cf0 2023-12-20T04:23:33.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f56dd483640 1 -- 172.21.15.40:0/2822995781 >> v2:172.21.15.40:3300/0 conn(0x7f56d00428d0 msgr2=0x7f56d0008ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f56dd483640 1 --2- 172.21.15.40:0/2822995781 >> v2:172.21.15.40:3300/0 conn(0x7f56d00428d0 0x7f56d0008ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f56dd483640 1 -- 172.21.15.40:0/2822995781 >> v1:172.21.15.40:6789/0 conn(0x7f56d0042cf0 legacy=0x7f56d00cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f56dd483640 1 -- 172.21.15.40:0/2822995781 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d003e160 con 0x7f56d0036c20 2023-12-20T04:23:33.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.847+0000 7f56dcc82640 1 --2- 172.21.15.40:0/2822995781 >> v2:172.21.15.40:3300/0 conn(0x7f56d00428d0 0x7f56d0008ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7fb439f39640 1 -- start start 2023-12-20T04:23:33.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f3f89ffb640 1 -- 172.21.15.40:0/3806977835 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840119d0 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f56dd483640 1 --2- 172.21.15.40:0/2822995781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d0036c20 0x7f56d003f1a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56d00094c0 tx=0x7f56c802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c3df93f20ac67d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f7846561640 1 Processor -- start 2023-12-20T04:23:33.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f3f8bfff640 1 -- 172.21.15.40:0/3806977835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 msgr2=0x7f3f8c143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f3f8bfff640 1 --2- 172.21.15.40:0/3806977835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c143c30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f84014a00 tx=0x7f3f84034a90 comp rx=0 tx=0).stop 2023-12-20T04:23:33.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f56cffff640 1 -- 172.21.15.40:0/2822995781 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8030610 con 0x7f56d0036c20 2023-12-20T04:23:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f266daf9640 1 --2- 172.21.15.40:0/2340136181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26600d08f0 0x7f26600d7840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2668066a80 tx=0x7f26680a7c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cb1780ffbbf407c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.848+0000 7f7846561640 1 -- start start 2023-12-20T04:23:33.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f56cffff640 1 -- 172.21.15.40:0/2822995781 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8030770 con 0x7f56d0036c20 2023-12-20T04:23:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f3f8bfff640 1 -- 172.21.15.40:0/3806977835 shutdown_connections 2023-12-20T04:23:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f3f8bfff640 1 --2- 172.21.15.40:0/3806977835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c143c30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb439f39640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb4340b7170 0x7fb4341ec600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb439f39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43415aff0 0x7fb4341f8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb439f39640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 0x7fb4340b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb439f39640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340b0110 con 0x7fb43415aff0 2023-12-20T04:23:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb439f39640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340b06d0 con 0x7fb43415b3d0 2023-12-20T04:23:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f265ffff640 1 -- 172.21.15.40:0/2340136181 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680a8ad0 con 0x7f26600d08f0 2023-12-20T04:23:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f265ffff640 1 -- 172.21.15.40:0/2340136181 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680a8c30 con 0x7f26600d08f0 2023-12-20T04:23:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f265ffff640 1 -- 172.21.15.40:0/2340136181 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26680b0640 con 0x7f26600d08f0 2023-12-20T04:23:33.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f81cd46d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c003b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb439f39640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340b20e0 con 0x7fb4340b7170 2023-12-20T04:23:33.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f3f8bfff640 1 -- 172.21.15.40:0/3806977835 >> 172.21.15.40:0/3806977835 conn(0x7f3f8c0bbcf0 msgr2=0x7f3f8c0bc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f81cd46d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f81c00d08f0 0x7f81c00d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb4340b7170 0x7fb4341ec600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f81c77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f81c00d04b0 0x7f81c00c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52924/0 (socket says 172.21.15.40:52924) 2023-12-20T04:23:33.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb4337fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb4340b7170 0x7fb4341ec600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54744/0 (socket says 172.21.15.40:54744) 2023-12-20T04:23:33.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7fb4337fe640 1 -- 172.21.15.40:0/1617754647 learned_addr learned my addr 172.21.15.40:0/1617754647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c003b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f81c77fe640 1 -- 172.21.15.40:0/2590685011 learned_addr learned my addr 172.21.15.40:0/2590685011 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:33.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 -- 172.21.15.40:0/2822995781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d0036c20 msgr2=0x7f56d003f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2822995781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d0036c20 0x7f56d003f1a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56d00094c0 tx=0x7f56c802b960 comp rx=0 tx=0).stop 2023-12-20T04:23:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7846561640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f78401527b0 0x7f784014f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7846561640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7840153230 con 0x7f7840148f80 2023-12-20T04:23:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7846561640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784014fcd0 con 0x7f784014f8c0 2023-12-20T04:23:33.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7846561640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784006b330 con 0x7f78401527b0 2023-12-20T04:23:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 -- 172.21.15.40:0/2822995781 shutdown_connections 2023-12-20T04:23:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2822995781 >> v2:172.21.15.40:3300/0 conn(0x7f56d00428d0 0x7f56d0008ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2822995781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d0036c20 0x7f56d003f1a0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56d00094c0 tx=0x7f56c802b960 comp rx=0 tx=0).stop 2023-12-20T04:23:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 -- 172.21.15.40:0/2822995781 >> 172.21.15.40:0/2822995781 conn(0x7f56d000a510 msgr2=0x7f56d000a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f784555f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7840148f80 0x7f78400b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52932/0 (socket says 172.21.15.40:52932) 2023-12-20T04:23:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f784555f640 1 -- 172.21.15.40:0/3109749394 learned_addr learned my addr 172.21.15.40:0/3109749394 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:33.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f266f55c640 1 -- 172.21.15.40:0/2340136181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26600d08f0 msgr2=0x7f26600d7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f266f55c640 1 --2- 172.21.15.40:0/2340136181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26600d08f0 0x7f26600d7840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2668066a80 tx=0x7f26680a7c60 comp rx=0 tx=0).stop 2023-12-20T04:23:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f3f8bfff640 1 -- 172.21.15.40:0/3806977835 shutdown_connections 2023-12-20T04:23:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f3f8bfff640 1 -- 172.21.15.40:0/3806977835 wait complete. 2023-12-20T04:23:33.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.849+0000 7f81ccc6c640 1 --2- 172.21.15.40:0/2590685011 >> v2:172.21.15.40:3300/0 conn(0x7f81c00d08f0 0x7f81c00d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 -- 172.21.15.40:0/2822995781 shutdown_connections 2023-12-20T04:23:33.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c003a990 con 0x7f81c00d04b0 2023-12-20T04:23:33.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7844d5e640 1 --2- 172.21.15.40:0/3109749394 >> v2:172.21.15.69:3300/0 conn(0x7f78401527b0 0x7f784014f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7fb432ffd640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43415aff0 0x7fb4341f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7fb433fff640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 0x7fb4340b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c003a500 con 0x7f81c00d08f0 2023-12-20T04:23:33.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00d0d10 con 0x7f81c0007020 2023-12-20T04:23:33.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7fb4337fe640 1 -- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 msgr2=0x7fb4340b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7fb4337fe640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 0x7fb4340b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7fb4337fe640 1 -- 172.21.15.40:0/1617754647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43415aff0 msgr2=0x7fb4341f8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7fb4337fe640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43415aff0 0x7fb4341f8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7fb4337fe640 1 -- 172.21.15.40:0/1617754647 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c005f90 con 0x7fb4340b7170 2023-12-20T04:23:33.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f266f55c640 1 -- 172.21.15.40:0/2340136181 shutdown_connections 2023-12-20T04:23:33.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f266f55c640 1 --2- 172.21.15.40:0/2340136181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26600d08f0 0x7f26600d7840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f266f55c640 1 --2- 172.21.15.40:0/2340136181 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2660007020 0x7f266003b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7f266f55c640 1 -- 172.21.15.40:0/2340136181 >> 172.21.15.40:0/2340136181 conn(0x7f266003edf0 msgr2=0x7f266003f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7fb4337fe640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb4340b7170 0x7fb4341ec600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb42400c7b0 tx=0x7fb42400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7f3f8bfff640 1 Processor -- start 2023-12-20T04:23:33.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7844d5e640 1 -- 172.21.15.40:0/3109749394 >> v1:172.21.15.69:6789/0 conn(0x7f784014f8c0 legacy=0x7f7840159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7844d5e640 1 -- 172.21.15.40:0/3109749394 >> v1:172.21.15.40:6789/0 conn(0x7f7840148f80 legacy=0x7f78400b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f7844d5e640 1 -- 172.21.15.40:0/3109749394 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400b47e0 con 0x7f78401527b0 2023-12-20T04:23:33.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7f266f55c640 1 -- 172.21.15.40:0/2340136181 shutdown_connections 2023-12-20T04:23:33.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7f3f8bfff640 1 -- start start 2023-12-20T04:23:33.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7f266f55c640 1 -- 172.21.15.40:0/2340136181 wait complete. 2023-12-20T04:23:33.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.850+0000 7f56df6e7640 1 -- 172.21.15.40:0/2822995781 wait complete. 2023-12-20T04:23:33.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7f56df6e7640 1 Processor -- start 2023-12-20T04:23:33.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.851+0000 7f81c6ffd640 1 -- 172.21.15.40:0/2590685011 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873322919 0 0) 0x7f81b4001110 con 0x7f81c00d04b0 2023-12-20T04:23:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f56df6e7640 1 -- start start 2023-12-20T04:23:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7fb41bfff640 1 -- 172.21.15.40:0/1617754647 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424005270 con 0x7fb4340b7170 2023-12-20T04:23:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7fb41bfff640 1 -- 172.21.15.40:0/1617754647 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4240053d0 con 0x7fb4340b7170 2023-12-20T04:23:33.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7fb41bfff640 1 -- 172.21.15.40:0/1617754647 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400a880 con 0x7fb4340b7170 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8bfff640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f8c06e9a0 0x7f3f8c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8bfff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f8c144170 0x7f3f8c1deb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8bfff640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1447b0 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8bfff640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0ae410 con 0x7f3f8c06e9a0 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8bfff640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c144a90 con 0x7f3f8c144170 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8affd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f8c06e9a0 0x7f3f8c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f81ccc6c640 1 -- 172.21.15.40:0/2590685011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 msgr2=0x7f81c003b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:33.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f81ccc6c640 1 --2- 172.21.15.40:0/2590685011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c003b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f81ccc6c640 1 -- 172.21.15.40:0/2590685011 >> v1:172.21.15.40:6789/0 conn(0x7f81c00d04b0 legacy=0x7f81c00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f81ccc6c640 1 -- 172.21.15.40:0/2590685011 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0039bd0 con 0x7f81c00d08f0 2023-12-20T04:23:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4340b0b60 con 0x7fb4340b7170 2023-12-20T04:23:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f266f55c640 1 Processor -- start 2023-12-20T04:23:33.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f266f55c640 1 -- start start 2023-12-20T04:23:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8a7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c1457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57494/0 (socket says 172.21.15.40:57494) 2023-12-20T04:23:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3253093894 learned_addr learned my addr 172.21.15.40:0/3253093894 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f3f8b7fe640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f8c144170 0x7f3f8c1deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f8c144170 msgr2=0x7f3f8c1deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f3f8a7fc640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f8c144170 0x7f3f8c1deb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f8c06e9a0 msgr2=0x7f3f8c0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f3f8a7fc640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f8c06e9a0 0x7f3f8c0aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f3f8a7fc640 1 -- 172.21.15.40:0/3253093894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84014660 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f3f8b7fe640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f8c144170 0x7f3f8c1deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f81ccc6c640 1 --2- 172.21.15.40:0/2590685011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d08f0 0x7f81c00d7840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81c802c840 tx=0x7f81c80a6b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9fdf72b591f373 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56df6e7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d00428d0 0x7f56d0039440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56df6e7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f56d0042cf0 0x7f56d00207e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56df6e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d0039b70 0x7f56d0020d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56df6e7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0035cf0 con 0x7f56d0039b70 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56df6e7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d0039980 con 0x7f56d00428d0 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56df6e7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d001f3d0 con 0x7f56d0042cf0 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d00428d0 0x7f56d0039440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d00428d0 0x7f56d0039440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:36090/0 (socket says 172.21.15.40:36090) 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 -- 172.21.15.40:0/2317671631 learned_addr learned my addr 172.21.15.40:0/2317671631 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dcc82640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f56d0042cf0 0x7f56d00207e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56ddc84640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d0039b70 0x7f56d0020d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f7844d5e640 1 --2- 172.21.15.40:0/3109749394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78401527b0 0x7f784014f380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7838009d90 tx=0x7f783802be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9224ce27144dba7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f81c7fff640 1 --2- 172.21.15.40:0/2590685011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c003b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:33.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.852+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4340b0360 con 0x7fb4340b7170 2023-12-20T04:23:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 -- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f56d0042cf0 msgr2=0x7f56d00207e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f56d0042cf0 0x7f56d00207e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 -- 172.21.15.40:0/2317671631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d0039b70 msgr2=0x7f56d0020d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d0039b70 0x7f56d0020d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.853+0000 7f56dd483640 1 -- 172.21.15.40:0/2317671631 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c8009400 con 0x7f56d00428d0 2023-12-20T04:23:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266f55c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2660007020 0x7f26600c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266f55c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f26600d04b0 0x7f26600bed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266f55c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26600d08f0 0x7f26601666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f81c6ffd640 1 -- 172.21.15.40:0/2590685011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a89c0 con 0x7f81c00d08f0 2023-12-20T04:23:33.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266f55c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600bf240 con 0x7f26600d08f0 2023-12-20T04:23:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266f55c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c2210 con 0x7f2660007020 2023-12-20T04:23:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266f55c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600ca150 con 0x7f26600d04b0 2023-12-20T04:23:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f81c6ffd640 1 -- 172.21.15.40:0/2590685011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c80a8b20 con 0x7f81c00d08f0 2023-12-20T04:23:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f81c6ffd640 1 -- 172.21.15.40:0/2590685011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80b0420 con 0x7f81c00d08f0 2023-12-20T04:23:33.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f7837fff640 1 -- 172.21.15.40:0/3109749394 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783802cb70 con 0x7f78401527b0 2023-12-20T04:23:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f7837fff640 1 -- 172.21.15.40:0/3109749394 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783802ccd0 con 0x7f78401527b0 2023-12-20T04:23:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f7837fff640 1 -- 172.21.15.40:0/3109749394 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838034660 con 0x7f78401527b0 2023-12-20T04:23:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb414005250 con 0x7fb4340b7170 2023-12-20T04:23:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266daf9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26600d08f0 0x7f26601666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266daf9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26600d08f0 0x7f26601666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57514/0 (socket says 172.21.15.40:57514) 2023-12-20T04:23:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266daf9640 1 -- 172.21.15.40:0/4007534369 learned_addr learned my addr 172.21.15.40:0/4007534369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f56dd483640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d00428d0 0x7f56d0039440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009890 tx=0x7f56c8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f3f8a7fc640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c1457d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f840350a0 tx=0x7f3f84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266caf7640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f26600d04b0 0x7f26600bed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.854+0000 7f266d2f8640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2660007020 0x7f26600c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f266caf7640 1 -- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2660007020 msgr2=0x7f26600c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f266caf7640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2660007020 0x7f26600c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f266caf7640 1 -- 172.21.15.40:0/4007534369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26600d08f0 msgr2=0x7f26601666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f266caf7640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26600d08f0 0x7f26601666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f266caf7640 1 -- 172.21.15.40:0/4007534369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668072d50 con 0x7f26600d04b0 2023-12-20T04:23:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f266daf9640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26600d08f0 0x7f26601666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f3f737fe640 1 -- 172.21.15.40:0/3253093894 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84041c00 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f56cdffb640 1 -- 172.21.15.40:0/2317671631 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c803e040 con 0x7f56d00428d0 2023-12-20T04:23:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f56cdffb640 1 -- 172.21.15.40:0/2317671631 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80443f0 con 0x7f56d00428d0 2023-12-20T04:23:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f266caf7640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f26600d04b0 0x7f26600bed00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2664000c00 tx=0x7f266400cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f7846561640 1 -- 172.21.15.40:0/3109749394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78401527b0 msgr2=0x7f784014f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f7846561640 1 --2- 172.21.15.40:0/3109749394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78401527b0 0x7f784014f380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7838009d90 tx=0x7f783802be40 comp rx=0 tx=0).stop 2023-12-20T04:23:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f3f737fe640 1 -- 172.21.15.40:0/3253093894 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f84047040 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f3f737fe640 1 -- 172.21.15.40:0/3253093894 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84011450 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d08f0 msgr2=0x7f81c00d7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f81cd46d640 1 --2- 172.21.15.40:0/2590685011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d08f0 0x7f81c00d7840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f81c802c840 tx=0x7f81c80a6b40 comp rx=0 tx=0).stop 2023-12-20T04:23:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 shutdown_connections 2023-12-20T04:23:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f81cd46d640 1 --2- 172.21.15.40:0/2590685011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d08f0 0x7f81c00d7840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f81cd46d640 1 --2- 172.21.15.40:0/2590685011 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c003b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 >> 172.21.15.40:0/2590685011 conn(0x7f81c003edf0 msgr2=0x7f81c003f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d0036800 con 0x7f56d00428d0 2023-12-20T04:23:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f56cdffb640 1 -- 172.21.15.40:0/2317671631 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8044780 con 0x7f56d00428d0 2023-12-20T04:23:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f3f8bfff640 1 -- 172.21.15.40:0/3253093894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c145d10 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7fb41bfff640 1 -- 172.21.15.40:0/1617754647 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb42400a9e0 con 0x7fb4340b7170 2023-12-20T04:23:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.856+0000 7fb41bfff640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb42006a500 0x7fb42006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.856+0000 7fb41bfff640 1 -- 172.21.15.40:0/1617754647 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4240882b0 con 0x7fb4340b7170 2023-12-20T04:23:33.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.857+0000 7fb432ffd640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb42006a500 0x7fb42006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f3f8bfff640 1 -- 172.21.15.40:0/3253093894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0b26a0 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f7846561640 1 -- 172.21.15.40:0/3109749394 shutdown_connections 2023-12-20T04:23:33.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f7846561640 1 --2- 172.21.15.40:0/3109749394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78401527b0 0x7f784014f380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f7846561640 1 -- 172.21.15.40:0/3109749394 >> 172.21.15.40:0/3109749394 conn(0x7f78400bdec0 msgr2=0x7f78400be2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.856+0000 7f7846561640 1 -- 172.21.15.40:0/3109749394 shutdown_connections 2023-12-20T04:23:33.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.855+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d00361b0 con 0x7f56d00428d0 2023-12-20T04:23:33.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.856+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 shutdown_connections 2023-12-20T04:23:33.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.857+0000 7f81cd46d640 1 -- 172.21.15.40:0/2590685011 wait complete. 2023-12-20T04:23:33.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.857+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d003ea50 con 0x7f56d00428d0 2023-12-20T04:23:33.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.857+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f64005250 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.857+0000 7f7846561640 1 -- 172.21.15.40:0/3109749394 wait complete. 2023-12-20T04:23:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.857+0000 7f56cdffb640 1 -- 172.21.15.40:0/2317671631 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f56c804d3b0 con 0x7f56d00428d0 2023-12-20T04:23:33.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.857+0000 7fb432ffd640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb42006a500 0x7fb42006c9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb42c03b000 tx=0x7fb42c00e040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.858+0000 7f56cdffb640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f56bc06a4b0 0x7f56bc06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.858+0000 7f56cdffb640 1 -- 172.21.15.40:0/2317671631 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c80aabb0 con 0x7f56d00428d0 2023-12-20T04:23:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.858+0000 7f56dcc82640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f56bc06a4b0 0x7f56bc06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.858+0000 7f3f737fe640 1 -- 172.21.15.40:0/3253093894 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f84036440 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.858+0000 7f7846561640 1 Processor -- start 2023-12-20T04:23:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f7846561640 1 -- start start 2023-12-20T04:23:33.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f56dcc82640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f56bc06a4b0 0x7f56bc06c970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f56d80679d0 tx=0x7f56d808c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f81cd46d640 1 Processor -- start 2023-12-20T04:23:33.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f3f737fe640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f7806a430 0x7f3f7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f3f737fe640 1 -- 172.21.15.40:0/3253093894 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f840b3c40 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f81cd46d640 1 -- start start 2023-12-20T04:23:33.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f3f8affd640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f7806a430 0x7f3f7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f7846561640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7840148f80 0x7f7840147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f7846561640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f784014f8c0 0x7f78401e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f7846561640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78401527b0 0x7f784014e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f7846561640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7840152190 con 0x7f784014f8c0 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f7846561640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7840147ed0 con 0x7f7840148f80 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f7846561640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78401e8470 con 0x7f78401527b0 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f265dffb640 1 -- 172.21.15.40:0/4007534369 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640070d0 con 0x7f26600d04b0 2023-12-20T04:23:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f265dffb640 1 -- 172.21.15.40:0/4007534369 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664007230 con 0x7f26600d04b0 2023-12-20T04:23:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f265dffb640 1 -- 172.21.15.40:0/4007534369 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664007660 con 0x7f26600d04b0 2023-12-20T04:23:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.859+0000 7f784555f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7840148f80 0x7f7840147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f7845d60640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78401527b0 0x7f784014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f7845d60640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78401527b0 0x7f784014e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54788/0 (socket says 172.21.15.40:54788) 2023-12-20T04:23:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f7845d60640 1 -- 172.21.15.40:0/3290725276 learned_addr learned my addr 172.21.15.40:0/3290725276 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26600c27d0 con 0x7f26600d04b0 2023-12-20T04:23:33.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7fb41bfff640 1 -- 172.21.15.40:0/1617754647 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb4240539c0 con 0x7fb4340b7170 2023-12-20T04:23:33.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266003e5e0 con 0x7f26600d04b0 2023-12-20T04:23:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f81cd46d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c00c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f81cd46d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d04b0 0x7f81c0037b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.860+0000 7f81cd46d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81c00d08f0 0x7f81c0027a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c00c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81cd46d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00c3980 con 0x7f81c00d04b0 2023-12-20T04:23:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c00c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:54792/0 (socket says 172.21.15.40:54792) 2023-12-20T04:23:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81cd46d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00cd880 con 0x7f81c00d08f0 2023-12-20T04:23:33.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81c7fff640 1 -- 172.21.15.40:0/4147408451 learned_addr learned my addr 172.21.15.40:0/4147408451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81ccc6c640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81c00d08f0 0x7f81c0027a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81cd46d640 1 -- 172.21.15.40:0/4147408451 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c00cdb60 con 0x7f81c0007020 2023-12-20T04:23:33.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f7844d5e640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f784014f8c0 0x7f78401e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81c77fe640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d04b0 0x7f81c0037b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f3f8affd640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f7806a430 0x7f3f7806c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c000f60 tx=0x7f3f7c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f7845d60640 1 -- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7840148f80 msgr2=0x7f7840147990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f7845d60640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7840148f80 0x7f7840147990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f7845d60640 1 -- 172.21.15.40:0/3290725276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f784014f8c0 msgr2=0x7f78401e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f7845d60640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f784014f8c0 0x7f78401e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f7845d60640 1 -- 172.21.15.40:0/3290725276 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7838009a70 con 0x7f78401527b0 2023-12-20T04:23:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81ccc6c640 1 -- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 msgr2=0x7f81c00c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81ccc6c640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c00c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81ccc6c640 1 -- 172.21.15.40:0/4147408451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d04b0 msgr2=0x7f81c0037b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81ccc6c640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d04b0 0x7f81c0037b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81ccc6c640 1 -- 172.21.15.40:0/4147408451 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8072d50 con 0x7f81c00d08f0 2023-12-20T04:23:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2660008170 con 0x7f26600d04b0 2023-12-20T04:23:33.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.861+0000 7f81ccc6c640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81c00d08f0 0x7f81c0027a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81c80685a0 tx=0x7f81c8067fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.862+0000 7f265dffb640 1 -- 172.21.15.40:0/4007534369 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f26640047e0 con 0x7f26600d04b0 2023-12-20T04:23:33.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.862+0000 7f7845d60640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78401527b0 0x7f784014e210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f783000c5a0 tx=0x7f783000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f7835ffb640 1 -- 172.21.15.40:0/3290725276 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830005480 con 0x7f78401527b0 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f265dffb640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f264c06a480 0x7f264c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f265dffb640 1 -- 172.21.15.40:0/4007534369 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2664087b70 con 0x7f26600d04b0 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f266d2f8640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f264c06a480 0x7f264c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f81c4ff9640 1 -- 172.21.15.40:0/4147408451 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a8ea0 con 0x7f81c00d08f0 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f81c4ff9640 1 -- 172.21.15.40:0/4147408451 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c80b9640 con 0x7f81c00d08f0 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f81c4ff9640 1 -- 172.21.15.40:0/4147408451 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80b99f0 con 0x7f81c00d08f0 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f81cd46d640 1 -- 172.21.15.40:0/4147408451 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c00cbb00 con 0x7f81c00d08f0 2023-12-20T04:23:33.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f81cd46d640 1 -- 172.21.15.40:0/4147408451 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c00cc020 con 0x7f81c00d08f0 2023-12-20T04:23:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f56cdffb640 1 -- 172.21.15.40:0/2317671631 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f56c8076240 con 0x7f56d00428d0 2023-12-20T04:23:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f7846561640 1 -- 172.21.15.40:0/3290725276 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78401e76b0 con 0x7f78401527b0 2023-12-20T04:23:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.863+0000 7f7846561640 1 -- 172.21.15.40:0/3290725276 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78401e7c70 con 0x7f78401527b0 2023-12-20T04:23:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.864+0000 7f7835ffb640 1 -- 172.21.15.40:0/3290725276 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78300035f0 con 0x7f78401527b0 2023-12-20T04:23:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.864+0000 7f7835ffb640 1 -- 172.21.15.40:0/3290725276 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7830003980 con 0x7f78401527b0 2023-12-20T04:23:33.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.865+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78401451f0 con 0x7f78401527b0 2023-12-20T04:23:33.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.865+0000 7f266d2f8640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f264c06a480 0x7f264c06c940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2658009a10 tx=0x7f2658008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.865+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a0005250 con 0x7f81c00d08f0 2023-12-20T04:23:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.866+0000 7f81c4ff9640 1 -- 172.21.15.40:0/4147408451 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81c80b9b50 con 0x7f81c00d08f0 2023-12-20T04:23:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.866+0000 7f81c4ff9640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f81ac06a500 0x7f81ac06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.867+0000 7f81c4ff9640 1 -- 172.21.15.40:0/4147408451 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81c80ac070 con 0x7f81c00d08f0 2023-12-20T04:23:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.867+0000 7f81c7fff640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f81ac06a500 0x7f81ac06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.867+0000 7f3f737fe640 1 -- 172.21.15.40:0/3253093894 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f8407f220 con 0x7f3f8c0bc7e0 2023-12-20T04:23:33.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.867+0000 7f265dffb640 1 -- 172.21.15.40:0/4007534369 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2664053280 con 0x7f26600d04b0 2023-12-20T04:23:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.867+0000 7f81c7fff640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f81ac06a500 0x7f81ac06c9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00aab0 tx=0x7f81bc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.869+0000 7f7835ffb640 1 -- 172.21.15.40:0/3290725276 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f783001b3b0 con 0x7f78401527b0 2023-12-20T04:23:33.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.869+0000 7f7835ffb640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f782406a500 0x7f782406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.870+0000 7f7835ffb640 1 -- 172.21.15.40:0/3290725276 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78300884b0 con 0x7f78401527b0 2023-12-20T04:23:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.870+0000 7f784555f640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f782406a500 0x7f782406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.871+0000 7f784555f640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f782406a500 0x7f782406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f783c005880 tx=0x7f783c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.871+0000 7f81c4ff9640 1 -- 172.21.15.40:0/4147408451 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f81c80f0800 con 0x7f81c00d08f0 2023-12-20T04:23:33.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.872+0000 7f7835ffb640 1 -- 172.21.15.40:0/3290725276 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7830053a80 con 0x7f78401527b0 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.885+0000 7f98d32c4640 1 Processor -- start 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.885+0000 7f98d32c4640 1 -- start start 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.886+0000 7f98d32c4640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f98c403c2d0 0x7f98c403c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.886+0000 7f98d32c4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c40d7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.886+0000 7f98d32c4640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c400aaa0 con 0x7f98c4007c40 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.886+0000 7f98d32c4640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c403e630 con 0x7f98c403c2d0 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.886+0000 7f98d32c4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c403da10 con 0x7f98c403cc80 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.886+0000 7f98d1060640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f98c4007c40 0x7f98c40cd760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:43984/0 (socket says 172.21.15.40:43984) 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.886+0000 7f98d1060640 1 -- 172.21.15.40:0/3812666507 learned_addr learned my addr 172.21.15.40:0/3812666507 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.887+0000 7f98d1861640 1 --2- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c40d7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.887+0000 7f98d085f640 1 --2- 172.21.15.40:0/3812666507 >> v2:172.21.15.69:3300/0 conn(0x7f98c403c2d0 0x7f98c403c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.889+0000 7f98d085f640 1 -- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 msgr2=0x7f98c40d7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.889+0000 7f98d085f640 1 --2- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c40d7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.889+0000 7f98d085f640 1 -- 172.21.15.40:0/3812666507 >> v1:172.21.15.69:6789/0 conn(0x7f98c4007c40 legacy=0x7f98c40cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.889+0000 7f98d085f640 1 -- 172.21.15.40:0/3812666507 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c403d6a0 con 0x7f98c403c2d0 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.893+0000 7f98d085f640 1 --2- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c403c2d0 0x7f98c403c740 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98c800b850 tx=0x7f98c802bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f1dbb7555870ab0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.893+0000 7f98c3fff640 1 -- 172.21.15.40:0/3812666507 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c802c940 con 0x7f98c403c2d0 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.893+0000 7f98c3fff640 1 -- 172.21.15.40:0/3812666507 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c802caa0 con 0x7f98c403c2d0 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.894+0000 7f98d32c4640 1 -- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c403c2d0 msgr2=0x7f98c403c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.894+0000 7f98d32c4640 1 --2- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c403c2d0 0x7f98c403c740 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f98c800b850 tx=0x7f98c802bc10 comp rx=0 tx=0).stop 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.894+0000 7f98d32c4640 1 -- 172.21.15.40:0/3812666507 shutdown_connections 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.894+0000 7f98d32c4640 1 --2- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c403c2d0 0x7f98c403c740 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.894+0000 7f98d32c4640 1 --2- 172.21.15.40:0/3812666507 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c40d7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.894+0000 7f98d32c4640 1 -- 172.21.15.40:0/3812666507 >> 172.21.15.40:0/3812666507 conn(0x7f98c4009c90 msgr2=0x7f98c400a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.895+0000 7f98d32c4640 1 -- 172.21.15.40:0/3812666507 shutdown_connections 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.895+0000 7f98d32c4640 1 -- 172.21.15.40:0/3812666507 wait complete. 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.896+0000 7f98d32c4640 1 Processor -- start 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.897+0000 7f98d32c4640 1 -- start start 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d32c4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c4007c40 0x7f98c403af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d32c4640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c4187310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d32c4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c40d1750 0x7f98c40ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d32c4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c403b4d0 con 0x7f98c4007c40 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d32c4640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40cffb0 con 0x7f98c40d1750 2023-12-20T04:23:33.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d32c4640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40d0850 con 0x7f98c403cc80 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c40d1750 0x7f98c40ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c40d1750 0x7f98c40ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:36132/0 (socket says 172.21.15.40:36132) 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 -- 172.21.15.40:0/1437277450 learned_addr learned my addr 172.21.15.40:0/1437277450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d085f640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c4187310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1060640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c4007c40 0x7f98c403af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 -- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 msgr2=0x7f98c4187310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c4187310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 -- 172.21.15.40:0/1437277450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c4007c40 msgr2=0x7f98c403af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c4007c40 0x7f98c403af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.898+0000 7f98d1861640 1 -- 172.21.15.40:0/1437277450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c800b4b0 con 0x7f98c40d1750 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.899+0000 7f98d1861640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c40d1750 0x7f98c40ca790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98cc068f60 tx=0x7f98cc061040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.900+0000 7f98c1ffb640 1 -- 172.21.15.40:0/1437277450 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc0608a0 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.900+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c4028000 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.900+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c4036a00 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.900+0000 7f98c1ffb640 1 -- 172.21.15.40:0/1437277450 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc060a00 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.900+0000 7f98c1ffb640 1 -- 172.21.15.40:0/1437277450 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc060d70 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.902+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c40056b0 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.904+0000 7f98c1ffb640 1 -- 172.21.15.40:0/1437277450 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f98cc0b5b60 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.905+0000 7f98c1ffb640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f98b006a530 0x7f98b006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.905+0000 7f98c1ffb640 1 -- 172.21.15.40:0/1437277450 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98cc101ab0 con 0x7f98c40d1750 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.906+0000 7f98d1060640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f98b006a530 0x7f98b006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.906+0000 7f98d1060640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f98b006a530 0x7f98b006c9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98bc000f60 tx=0x7f98bc001790 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:33.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:33.908+0000 7f98c1ffb640 1 -- 172.21.15.40:0/1437277450 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f98cc0cd1c0 con 0x7f98c40d1750 2023-12-20T04:23:34.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.226+0000 7fa8a67d0640 1 -- 172.21.15.40:0/1439079754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa880005500 con 0x7fa8a00b5e30 2023-12-20T04:23:34.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.227+0000 7fa895ffb640 1 -- 172.21.15.40:0/1439079754 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa89807a2a0 con 0x7fa8a00b5e30 2023-12-20T04:23:34.228 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-12-20T04:23:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.231+0000 7fa88b7fe640 1 -- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa88406a580 msgr2=0x7fa88406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.231+0000 7fa88b7fe640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa88406a580 0x7fa88406ca40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009610 tx=0x7fa89c006b80 comp rx=0 tx=0).stop 2023-12-20T04:23:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.231+0000 7fa88b7fe640 1 -- 172.21.15.40:0/1439079754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a00b5e30 msgr2=0x7fa8a013f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.231+0000 7fa88b7fe640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a00b5e30 0x7fa8a013f600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa898009fa0 tx=0x7fa898004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 -- 172.21.15.40:0/1439079754 shutdown_connections 2023-12-20T04:23:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa88406a580 0x7fa88406ca40 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009610 tx=0x7fa89c006b80 comp rx=0 tx=0).stop 2023-12-20T04:23:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8a00b5e30 0x7fa8a013f600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa8a0141270 0x7fa8a01e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 --2- 172.21.15.40:0/1439079754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8a00700f0 0x7fa8a00b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 -- 172.21.15.40:0/1439079754 >> 172.21.15.40:0/1439079754 conn(0x7fa8a00b9040 msgr2=0x7fa8a0146fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 -- 172.21.15.40:0/1439079754 shutdown_connections 2023-12-20T04:23:34.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.232+0000 7fa88b7fe640 1 -- 172.21.15.40:0/1439079754 wait complete. 2023-12-20T04:23:34.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-12-20T04:23:34.250 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.261+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7840061880 con 0x7f78401527b0 2023-12-20T04:23:34.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.261+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56d00056b0 con 0x7f56d00428d0 2023-12-20T04:23:34.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.261+0000 7f56cdffb640 1 -- 172.21.15.40:0/2317671631 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56c8079860 con 0x7f56d00428d0 2023-12-20T04:23:34.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.262+0000 7f7835ffb640 1 -- 172.21.15.40:0/3290725276 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78300570a0 con 0x7f78401527b0 2023-12-20T04:23:34.262 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-12-20T04:23:34.263 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.264+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f782406a500 msgr2=0x7f782406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.264+0000 7f782b7fe640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f782406a500 0x7f782406c9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f783c005880 tx=0x7f783c009040 comp rx=0 tx=0).stop 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.264+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78401527b0 msgr2=0x7f784014e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.264+0000 7f782b7fe640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78401527b0 0x7f784014e210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f783000c5a0 tx=0x7f783000ca60 comp rx=0 tx=0).stop 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.264+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 shutdown_connections 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f782b7fe640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f782406a500 0x7f782406c9c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f782b7fe640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f78401527b0 0x7f784014e210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f782b7fe640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f784014f8c0 0x7f78401e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f782b7fe640 1 --2- 172.21.15.40:0/3290725276 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7840148f80 0x7f7840147990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 >> 172.21.15.40:0/3290725276 conn(0x7f78400bdec0 msgr2=0x7f78400b9710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 shutdown_connections 2023-12-20T04:23:34.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f782b7fe640 1 -- 172.21.15.40:0/3290725276 wait complete. 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.265+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f56bc06a4b0 msgr2=0x7f56bc06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f56bc06a4b0 0x7f56bc06c970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f56d80679d0 tx=0x7f56d808c040 comp rx=0 tx=0).stop 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d00428d0 msgr2=0x7f56d0039440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d00428d0 0x7f56d0039440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009890 tx=0x7f56c8004730 comp rx=0 tx=0).stop 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 shutdown_connections 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f56bc06a4b0 0x7f56bc06c970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d0039b70 0x7f56d0020d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f56d0042cf0 0x7f56d00207e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 --2- 172.21.15.40:0/2317671631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56d00428d0 0x7f56d0039440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 >> 172.21.15.40:0/2317671631 conn(0x7f56d000a510 msgr2=0x7f56d003a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 shutdown_connections 2023-12-20T04:23:34.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.266+0000 7f56df6e7640 1 -- 172.21.15.40:0/2317671631 wait complete. 2023-12-20T04:23:34.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.271+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4140057d0 con 0x7fb4340b7170 2023-12-20T04:23:34.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.271+0000 7fb41bfff640 1 -- 172.21.15.40:0/1617754647 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb424017020 con 0x7fb4340b7170 2023-12-20T04:23:34.273 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-12-20T04:23:34.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb42006a500 msgr2=0x7fb42006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb42006a500 0x7fb42006c9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb42c03b000 tx=0x7fb42c00e040 comp rx=0 tx=0).stop 2023-12-20T04:23:34.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb4340b7170 msgr2=0x7fb4341ec600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb4340b7170 0x7fb4341ec600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb42400c7b0 tx=0x7fb42400cc70 comp rx=0 tx=0).stop 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 shutdown_connections 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb42006a500 0x7fb42006c9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb43415b3d0 0x7fb4340b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb43415aff0 0x7fb4341f8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 --2- 172.21.15.40:0/1617754647 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb4340b7170 0x7fb4341ec600 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 >> 172.21.15.40:0/1617754647 conn(0x7fb4340b88a0 msgr2=0x7fb434158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.275+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 shutdown_connections 2023-12-20T04:23:34.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.276+0000 7fb439f39640 1 -- 172.21.15.40:0/1617754647 wait complete. 2023-12-20T04:23:34.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.276+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3f64005500 con 0x7f3f8c0bc7e0 2023-12-20T04:23:34.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.277+0000 7f3f737fe640 1 -- 172.21.15.40:0/3253093894 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f8403c090 con 0x7f3f8c0bc7e0 2023-12-20T04:23:34.278 INFO:teuthology.orchestra.run.smithi040.stdout:55834574854 2023-12-20T04:23:34.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.278+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f266003bce0 con 0x7f26600d04b0 2023-12-20T04:23:34.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.278+0000 7f265dffb640 1 -- 172.21.15.40:0/4007534369 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2664018070 con 0x7f26600d04b0 2023-12-20T04:23:34.279 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:34.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-12-20T04:23:34.281 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f7806a430 msgr2=0x7f3f7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f7806a430 0x7f3f7806c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c000f60 tx=0x7f3f7c009040 comp rx=0 tx=0).stop 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 msgr2=0x7f3f8c1457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c1457d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3f840350a0 tx=0x7f3f84004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 shutdown_connections 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f7806a430 0x7f3f7806c8f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3f8c144170 0x7f3f8c1deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3f8c0bc7e0 0x7f3f8c1457d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 --2- 172.21.15.40:0/3253093894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f8c06e9a0 0x7f3f8c0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 >> 172.21.15.40:0/3253093894 conn(0x7f3f8c0bbcf0 msgr2=0x7f3f8c0b8ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.280+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 shutdown_connections 2023-12-20T04:23:34.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.281+0000 7f3f717fa640 1 -- 172.21.15.40:0/3253093894 wait complete. 2023-12-20T04:23:34.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f264c06a480 msgr2=0x7f264c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f264c06a480 0x7f264c06c940 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2658009a10 tx=0x7f2658008040 comp rx=0 tx=0).stop 2023-12-20T04:23:34.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f26600d04b0 msgr2=0x7f26600bed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f26600d04b0 0x7f26600bed00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2664000c00 tx=0x7f266400cbe0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 shutdown_connections 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f264c06a480 0x7f264c06c940 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26600d08f0 0x7f26601666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f26600d04b0 0x7f26600bed00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 --2- 172.21.15.40:0/4007534369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2660007020 0x7f26600c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 >> 172.21.15.40:0/4007534369 conn(0x7f266003edf0 msgr2=0x7f26600419f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 shutdown_connections 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.282+0000 7f266f55c640 1 -- 172.21.15.40:0/4007534369 wait complete. 2023-12-20T04:23:34.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.284+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81a0005500 con 0x7f81c00d08f0 2023-12-20T04:23:34.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.284+0000 7f81c4ff9640 1 -- 172.21.15.40:0/4147408451 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81c80be020 con 0x7f81c00d08f0 2023-12-20T04:23:34.285 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2023-12-20T04:23:34.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-12-20T04:23:34.286 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f81ac06a500 msgr2=0x7f81ac06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f81ac06a500 0x7f81ac06c9c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00aab0 tx=0x7f81bc008040 comp rx=0 tx=0).stop 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81c00d08f0 msgr2=0x7f81c0027a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81c00d08f0 0x7f81c0027a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f81c80685a0 tx=0x7f81c8067fb0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 shutdown_connections 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f81ac06a500 0x7f81ac06c9c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81c00d08f0 0x7f81c0027a60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81c00d04b0 0x7f81c0037b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 --2- 172.21.15.40:0/4147408451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81c0007020 0x7f81c00c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 >> 172.21.15.40:0/4147408451 conn(0x7f81c003edf0 msgr2=0x7f81c00c43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 shutdown_connections 2023-12-20T04:23:34.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.287+0000 7f81b27fc640 1 -- 172.21.15.40:0/4147408451 wait complete. 2023-12-20T04:23:34.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-12-20T04:23:34.298 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-12-20T04:23:34.298 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.299+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f98c40d0990 con 0x7f98c40d1750 2023-12-20T04:23:34.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.299+0000 7f98c1ffb640 1 -- 172.21.15.40:0/1437277450 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98cc088020 con 0x7f98c40d1750 2023-12-20T04:23:34.300 INFO:teuthology.orchestra.run.smithi040.stdout:55834574855 2023-12-20T04:23:34.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-20T04:23:34.302 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-12-20T04:23:34.302 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f98b006a530 msgr2=0x7f98b006c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f98b006a530 0x7f98b006c9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98bc000f60 tx=0x7f98bc001790 comp rx=0 tx=0).stop 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c40d1750 msgr2=0x7f98c40ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c40d1750 0x7f98c40ca790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f98cc068f60 tx=0x7f98cc061040 comp rx=0 tx=0).stop 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 shutdown_connections 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f98b006a530 0x7f98b006c9f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f98c40d1750 0x7f98c40ca790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f98c403cc80 0x7f98c4187310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 --2- 172.21.15.40:0/1437277450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98c4007c40 0x7f98c403af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 >> 172.21.15.40:0/1437277450 conn(0x7f98c4009c90 msgr2=0x7f98c4023840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 shutdown_connections 2023-12-20T04:23:34.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.301+0000 7f98d32c4640 1 -- 172.21.15.40:0/1437277450 wait complete. 2023-12-20T04:23:34.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-12-20T04:23:34.314 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:34.314 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-20T04:23:34.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:23:34.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.459+0000 7fab06516640 1 Processor -- start 2023-12-20T04:23:34.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.459+0000 7fab06516640 1 -- start start 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7fab06516640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab000bcdd0 0x7fab000b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7fab06516640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab000bc6b0 con 0x7fab00144ea0 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7fab06516640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab000b6900 con 0x7fab000b64c0 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7fab06516640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab000a59f0 con 0x7fab000bcdd0 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7faafffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab000bcdd0 0x7fab000b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7fab04ab3640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fab00144ea0 0x7fab00155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52944/0 (socket says 172.21.15.40:52944) 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7fab04ab3640 1 -- 172.21.15.40:0/154855821 learned_addr learned my addr 172.21.15.40:0/154855821 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7faafffff640 1 -- 172.21.15.40:0/154855821 >> v1:172.21.15.69:6789/0 conn(0x7fab000b64c0 legacy=0x7fab00144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7faafffff640 1 -- 172.21.15.40:0/154855821 >> v1:172.21.15.40:6789/0 conn(0x7fab00144ea0 legacy=0x7fab00155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.460+0000 7faafffff640 1 -- 172.21.15.40:0/154855821 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab000bc0a0 con 0x7fab000bcdd0 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7faafffff640 1 --2- 172.21.15.40:0/154855821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab000bcdd0 0x7fab000b5f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faaf40097a0 tx=0x7faaf402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4071210084d24a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7faafeffd640 1 -- 172.21.15.40:0/154855821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf402f810 con 0x7fab000bcdd0 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7faafeffd640 1 -- 172.21.15.40:0/154855821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf402f970 con 0x7fab000bcdd0 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7faafeffd640 1 -- 172.21.15.40:0/154855821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf402fd00 con 0x7fab000bcdd0 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7fab06516640 1 -- 172.21.15.40:0/154855821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab000bcdd0 msgr2=0x7fab000b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7fab06516640 1 --2- 172.21.15.40:0/154855821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab000bcdd0 0x7fab000b5f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faaf40097a0 tx=0x7faaf402b9f0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7fab06516640 1 -- 172.21.15.40:0/154855821 shutdown_connections 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7fab06516640 1 --2- 172.21.15.40:0/154855821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab000bcdd0 0x7fab000b5f80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7fab06516640 1 -- 172.21.15.40:0/154855821 >> 172.21.15.40:0/154855821 conn(0x7fab00071e60 msgr2=0x7fab000c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7fab06516640 1 -- 172.21.15.40:0/154855821 shutdown_connections 2023-12-20T04:23:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.461+0000 7fab06516640 1 -- 172.21.15.40:0/154855821 wait complete. 2023-12-20T04:23:34.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.462+0000 7fab06516640 1 Processor -- start 2023-12-20T04:23:34.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab06516640 1 -- start start 2023-12-20T04:23:34.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab06516640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fab000b64c0 0x7fab001d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab06516640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab000bcdd0 0x7fab0014a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab06516640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab00144ea0 0x7fab001496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab06516640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0013e520 con 0x7fab00144ea0 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab06516640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab00148460 con 0x7fab000bcdd0 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab06516640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab001d1340 con 0x7fab000b64c0 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab04ab3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab00144ea0 0x7fab001496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab04ab3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab00144ea0 0x7fab001496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57564/0 (socket says 172.21.15.40:57564) 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.463+0000 7fab04ab3640 1 -- 172.21.15.40:0/4170428024 learned_addr learned my addr 172.21.15.40:0/4170428024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7faafffff640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fab000b64c0 0x7fab001d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7faaff7fe640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab000bcdd0 0x7fab0014a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab04ab3640 1 -- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fab000b64c0 msgr2=0x7fab001d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab04ab3640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fab000b64c0 0x7fab001d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab04ab3640 1 -- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab000bcdd0 msgr2=0x7fab0014a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab04ab3640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab000bcdd0 0x7fab0014a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab04ab3640 1 -- 172.21.15.40:0/4170428024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf4009400 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab04ab3640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab00144ea0 0x7fab001496f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faaf800ca80 tx=0x7faaf800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7faafcff9640 1 -- 172.21.15.40:0/4170428024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf800ac30 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7faafcff9640 1 -- 172.21.15.40:0/4170428024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf800ad90 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7faafcff9640 1 -- 172.21.15.40:0/4170428024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf8012600 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0014b0a0 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.464+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab001491d0 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.465+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab001493f0 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.465+0000 7faafcff9640 1 -- 172.21.15.40:0/4170428024 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faaf8007070 con 0x7fab00144ea0 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.466+0000 7faafcff9640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faaec06a430 0x7faaec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.466+0000 7faafcff9640 1 -- 172.21.15.40:0/4170428024 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaf8088750 con 0x7fab00144ea0 2023-12-20T04:23:34.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.466+0000 7faafffff640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faaec06a430 0x7faaec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.467+0000 7faafffff640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faaec06a430 0x7faaec06c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faaf4036000 tx=0x7faaf4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.470+0000 7faafcff9640 1 -- 172.21.15.40:0/4170428024 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faaf8053d70 con 0x7fab00144ea0 2023-12-20T04:23:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.642+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab001d16d0 con 0x7faaec06a430 2023-12-20T04:23:34.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.649+0000 7faafcff9640 1 -- 172.21.15.40:0/4170428024 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264521 (secure 0 0 0) 0x7faaf402fb60 con 0x7faaec06a430 2023-12-20T04:23:34.653 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:34.655 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faaec06a430 msgr2=0x7faaec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faaec06a430 0x7faaec06c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faaf4036000 tx=0x7faaf4008030 comp rx=0 tx=0).stop 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab00144ea0 msgr2=0x7fab001496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab00144ea0 0x7fab001496f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faaf800ca80 tx=0x7faaf800cf40 comp rx=0 tx=0).stop 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 shutdown_connections 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7faaec06a430 0x7faaec06c8f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab00144ea0 0x7fab001496f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab000bcdd0 0x7fab0014a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 --2- 172.21.15.40:0/4170428024 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fab000b64c0 0x7fab001d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 >> 172.21.15.40:0/4170428024 conn(0x7fab00071e60 msgr2=0x7fab000b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 shutdown_connections 2023-12-20T04:23:34.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.653+0000 7fab06516640 1 -- 172.21.15.40:0/4170428024 wait complete. 2023-12-20T04:23:34.665 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-20T04:23:34.528821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218440,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002304"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061624+0000","last_change":"2023-12-20T04:23:26.666498+0000","last_active":"2023-12-20T04:23:28.061624+0000","last_peered":"2023-12-20T04:23:28.061624+0000","last_clean":"2023-12-20T04:23:28.061624+0000","last_became_active":"2023-12-20T04:23:26.666246+0000","last_became_peered":"2023-12-20T04:23:26.666246+0000","last_unstale":"2023-12-20T04:23:28.061624+0000","last_undegraded":"2023-12-20T04:23:28.061624+0000","last_fullsized":"2023-12-20T04:23:28.061624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:11.658501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646532+0000","last_change":"2023-12-20T04:23:26.668502+0000","last_active":"2023-12-20T04:23:27.646532+0000","last_peered":"2023-12-20T04:23:27.646532+0000","last_clean":"2023-12-20T04:23:27.646532+0000","last_became_active":"2023-12-20T04:23:26.668226+0000","last_became_peered":"2023-12-20T04:23:26.668226+0000","last_unstale":"2023-12-20T04:23:27.646532+0000","last_undegraded":"2023-12-20T04:23:27.646532+0000","last_fullsized":"2023-12-20T04:23:27.646532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692326+0000","last_change":"2023-12-20T04:23:26.657999+0000","last_active":"2023-12-20T04:23:28.692326+0000","last_peered":"2023-12-20T04:23:28.692326+0000","last_clean":"2023-12-20T04:23:28.692326+0000","last_became_active":"2023-12-20T04:23:26.657747+0000","last_became_peered":"2023-12-20T04:23:26.657747+0000","last_unstale":"2023-12-20T04:23:28.692326+0000","last_undegraded":"2023-12-20T04:23:28.692326+0000","last_fullsized":"2023-12-20T04:23:28.692326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693115+0000","last_change":"2023-12-20T04:23:26.667729+0000","last_active":"2023-12-20T04:23:28.693115+0000","last_peered":"2023-12-20T04:23:28.693115+0000","last_clean":"2023-12-20T04:23:28.693115+0000","last_became_active":"2023-12-20T04:23:26.667465+0000","last_became_peered":"2023-12-20T04:23:26.667465+0000","last_unstale":"2023-12-20T04:23:28.693115+0000","last_undegraded":"2023-12-20T04:23:28.693115+0000","last_fullsized":"2023-12-20T04:23:28.693115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:00.052684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061201+0000","last_change":"2023-12-20T04:23:26.663765+0000","last_active":"2023-12-20T04:23:28.061201+0000","last_peered":"2023-12-20T04:23:28.061201+0000","last_clean":"2023-12-20T04:23:28.061201+0000","last_became_active":"2023-12-20T04:23:26.661392+0000","last_became_peered":"2023-12-20T04:23:26.661392+0000","last_unstale":"2023-12-20T04:23:28.061201+0000","last_undegraded":"2023-12-20T04:23:28.061201+0000","last_fullsized":"2023-12-20T04:23:28.061201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:50:16.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692819+0000","last_change":"2023-12-20T04:23:26.668637+0000","last_active":"2023-12-20T04:23:28.692819+0000","last_peered":"2023-12-20T04:23:28.692819+0000","last_clean":"2023-12-20T04:23:28.692819+0000","last_became_active":"2023-12-20T04:23:26.668371+0000","last_became_peered":"2023-12-20T04:23:26.668371+0000","last_unstale":"2023-12-20T04:23:28.692819+0000","last_undegraded":"2023-12-20T04:23:28.692819+0000","last_fullsized":"2023-12-20T04:23:28.692819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:50:16.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061136+0000","last_change":"2023-12-20T04:23:26.660691+0000","last_active":"2023-12-20T04:23:28.061136+0000","last_peered":"2023-12-20T04:23:28.061136+0000","last_clean":"2023-12-20T04:23:28.061136+0000","last_became_active":"2023-12-20T04:23:26.660437+0000","last_became_peered":"2023-12-20T04:23:26.660437+0000","last_unstale":"2023-12-20T04:23:28.061136+0000","last_undegraded":"2023-12-20T04:23:28.061136+0000","last_fullsized":"2023-12-20T04:23:28.061136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:06:36.081600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579534+0000","last_change":"2023-12-20T04:23:26.670148+0000","last_active":"2023-12-20T04:23:28.579534+0000","last_peered":"2023-12-20T04:23:28.579534+0000","last_clean":"2023-12-20T04:23:28.579534+0000","last_became_active":"2023-12-20T04:23:26.669968+0000","last_became_peered":"2023-12-20T04:23:26.669968+0000","last_unstale":"2023-12-20T04:23:28.579534+0000","last_undegraded":"2023-12-20T04:23:28.579534+0000","last_fullsized":"2023-12-20T04:23:28.579534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061628+0000","last_change":"2023-12-20T04:23:26.671820+0000","last_active":"2023-12-20T04:23:28.061628+0000","last_peered":"2023-12-20T04:23:28.061628+0000","last_clean":"2023-12-20T04:23:28.061628+0000","last_became_active":"2023-12-20T04:23:26.671447+0000","last_became_peered":"2023-12-20T04:23:26.671447+0000","last_unstale":"2023-12-20T04:23:28.061628+0000","last_undegraded":"2023-12-20T04:23:28.061628+0000","last_fullsized":"2023-12-20T04:23:28.061628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648899+0000","last_change":"2023-12-20T04:23:26.667769+0000","last_active":"2023-12-20T04:23:27.648899+0000","last_peered":"2023-12-20T04:23:27.648899+0000","last_clean":"2023-12-20T04:23:27.648899+0000","last_became_active":"2023-12-20T04:23:26.667520+0000","last_became_peered":"2023-12-20T04:23:26.667520+0000","last_unstale":"2023-12-20T04:23:27.648899+0000","last_undegraded":"2023-12-20T04:23:27.648899+0000","last_fullsized":"2023-12-20T04:23:27.648899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648667+0000","last_change":"2023-12-20T04:23:26.668385+0000","last_active":"2023-12-20T04:23:27.648667+0000","last_peered":"2023-12-20T04:23:27.648667+0000","last_clean":"2023-12-20T04:23:27.648667+0000","last_became_active":"2023-12-20T04:23:26.668091+0000","last_became_peered":"2023-12-20T04:23:26.668091+0000","last_unstale":"2023-12-20T04:23:27.648667+0000","last_undegraded":"2023-12-20T04:23:27.648667+0000","last_fullsized":"2023-12-20T04:23:27.648667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648548+0000","last_change":"2023-12-20T04:23:26.664617+0000","last_active":"2023-12-20T04:23:27.648548+0000","last_peered":"2023-12-20T04:23:27.648548+0000","last_clean":"2023-12-20T04:23:27.648548+0000","last_became_active":"2023-12-20T04:23:26.664369+0000","last_became_peered":"2023-12-20T04:23:26.664369+0000","last_unstale":"2023-12-20T04:23:27.648548+0000","last_undegraded":"2023-12-20T04:23:27.648548+0000","last_fullsized":"2023-12-20T04:23:27.648548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:27.375983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.580024+0000","last_change":"2023-12-20T04:23:26.668361+0000","last_active":"2023-12-20T04:23:28.580024+0000","last_peered":"2023-12-20T04:23:28.580024+0000","last_clean":"2023-12-20T04:23:28.580024+0000","last_became_active":"2023-12-20T04:23:26.668035+0000","last_became_peered":"2023-12-20T04:23:26.668035+0000","last_unstale":"2023-12-20T04:23:28.580024+0000","last_undegraded":"2023-12-20T04:23:28.580024+0000","last_fullsized":"2023-12-20T04:23:28.580024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692172+0000","last_change":"2023-12-20T04:23:26.666583+0000","last_active":"2023-12-20T04:23:28.692172+0000","last_peered":"2023-12-20T04:23:28.692172+0000","last_clean":"2023-12-20T04:23:28.692172+0000","last_became_active":"2023-12-20T04:23:26.666196+0000","last_became_peered":"2023-12-20T04:23:26.666196+0000","last_unstale":"2023-12-20T04:23:28.692172+0000","last_undegraded":"2023-12-20T04:23:28.692172+0000","last_fullsized":"2023-12-20T04:23:28.692172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646250+0000","last_change":"2023-12-20T04:23:26.664551+0000","last_active":"2023-12-20T04:23:27.646250+0000","last_peered":"2023-12-20T04:23:27.646250+0000","last_clean":"2023-12-20T04:23:27.646250+0000","last_became_active":"2023-12-20T04:23:26.663982+0000","last_became_peered":"2023-12-20T04:23:26.663982+0000","last_unstale":"2023-12-20T04:23:27.646250+0000","last_undegraded":"2023-12-20T04:23:27.646250+0000","last_fullsized":"2023-12-20T04:23:27.646250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692742+0000","last_change":"2023-12-20T04:23:26.669630+0000","last_active":"2023-12-20T04:23:28.692742+0000","last_peered":"2023-12-20T04:23:28.692742+0000","last_clean":"2023-12-20T04:23:28.692742+0000","last_became_active":"2023-12-20T04:23:26.669031+0000","last_became_peered":"2023-12-20T04:23:26.669031+0000","last_unstale":"2023-12-20T04:23:28.692742+0000","last_undegraded":"2023-12-20T04:23:28.692742+0000","last_fullsized":"2023-12-20T04:23:28.692742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:50.192488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693333+0000","last_change":"2023-12-20T04:23:26.671539+0000","last_active":"2023-12-20T04:23:28.693333+0000","last_peered":"2023-12-20T04:23:28.693333+0000","last_clean":"2023-12-20T04:23:28.693333+0000","last_became_active":"2023-12-20T04:23:26.671276+0000","last_became_peered":"2023-12-20T04:23:26.671276+0000","last_unstale":"2023-12-20T04:23:28.693333+0000","last_undegraded":"2023-12-20T04:23:28.693333+0000","last_fullsized":"2023-12-20T04:23:28.693333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:25.045988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177902+0000","last_change":"2023-12-20T04:23:26.657248+0000","last_active":"2023-12-20T04:23:28.177902+0000","last_peered":"2023-12-20T04:23:28.177902+0000","last_clean":"2023-12-20T04:23:28.177902+0000","last_became_active":"2023-12-20T04:23:26.657002+0000","last_became_peered":"2023-12-20T04:23:26.657002+0000","last_unstale":"2023-12-20T04:23:28.177902+0000","last_undegraded":"2023-12-20T04:23:28.177902+0000","last_fullsized":"2023-12-20T04:23:28.177902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:04.276683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061570+0000","last_change":"2023-12-20T04:23:26.663917+0000","last_active":"2023-12-20T04:23:28.061570+0000","last_peered":"2023-12-20T04:23:28.061570+0000","last_clean":"2023-12-20T04:23:28.061570+0000","last_became_active":"2023-12-20T04:23:26.662376+0000","last_became_peered":"2023-12-20T04:23:26.662376+0000","last_unstale":"2023-12-20T04:23:28.061570+0000","last_undegraded":"2023-12-20T04:23:28.061570+0000","last_fullsized":"2023-12-20T04:23:28.061570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:50.192488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648277+0000","last_change":"2023-12-20T04:23:26.663614+0000","last_active":"2023-12-20T04:23:27.648277+0000","last_peered":"2023-12-20T04:23:27.648277+0000","last_clean":"2023-12-20T04:23:27.648277+0000","last_became_active":"2023-12-20T04:23:26.663349+0000","last_became_peered":"2023-12-20T04:23:26.663349+0000","last_unstale":"2023-12-20T04:23:27.648277+0000","last_undegraded":"2023-12-20T04:23:27.648277+0000","last_fullsized":"2023-12-20T04:23:27.648277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692303+0000","last_change":"2023-12-20T04:23:26.662123+0000","last_active":"2023-12-20T04:23:28.692303+0000","last_peered":"2023-12-20T04:23:28.692303+0000","last_clean":"2023-12-20T04:23:28.692303+0000","last_became_active":"2023-12-20T04:23:26.661842+0000","last_became_peered":"2023-12-20T04:23:26.661842+0000","last_unstale":"2023-12-20T04:23:28.692303+0000","last_undegraded":"2023-12-20T04:23:28.692303+0000","last_fullsized":"2023-12-20T04:23:28.692303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692896+0000","last_change":"2023-12-20T04:23:26.672102+0000","last_active":"2023-12-20T04:23:28.692896+0000","last_peered":"2023-12-20T04:23:28.692896+0000","last_clean":"2023-12-20T04:23:28.692896+0000","last_became_active":"2023-12-20T04:23:26.671824+0000","last_became_peered":"2023-12-20T04:23:26.671824+0000","last_unstale":"2023-12-20T04:23:28.692896+0000","last_undegraded":"2023-12-20T04:23:28.692896+0000","last_fullsized":"2023-12-20T04:23:28.692896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:11.658501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579664+0000","last_change":"2023-12-20T04:23:26.665844+0000","last_active":"2023-12-20T04:23:28.579664+0000","last_peered":"2023-12-20T04:23:28.579664+0000","last_clean":"2023-12-20T04:23:28.579664+0000","last_became_active":"2023-12-20T04:23:26.664538+0000","last_became_peered":"2023-12-20T04:23:26.664538+0000","last_unstale":"2023-12-20T04:23:28.579664+0000","last_undegraded":"2023-12-20T04:23:28.579664+0000","last_fullsized":"2023-12-20T04:23:28.579664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692840+0000","last_change":"2023-12-20T04:23:26.667407+0000","last_active":"2023-12-20T04:23:28.692840+0000","last_peered":"2023-12-20T04:23:28.692840+0000","last_clean":"2023-12-20T04:23:28.692840+0000","last_became_active":"2023-12-20T04:23:26.667140+0000","last_became_peered":"2023-12-20T04:23:26.667140+0000","last_unstale":"2023-12-20T04:23:28.692840+0000","last_undegraded":"2023-12-20T04:23:28.692840+0000","last_fullsized":"2023-12-20T04:23:28.692840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:18:25.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579721+0000","last_change":"2023-12-20T04:23:26.663904+0000","last_active":"2023-12-20T04:23:28.579721+0000","last_peered":"2023-12-20T04:23:28.579721+0000","last_clean":"2023-12-20T04:23:28.579721+0000","last_became_active":"2023-12-20T04:23:26.663613+0000","last_became_peered":"2023-12-20T04:23:26.663613+0000","last_unstale":"2023-12-20T04:23:28.579721+0000","last_undegraded":"2023-12-20T04:23:28.579721+0000","last_fullsized":"2023-12-20T04:23:28.579721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648900+0000","last_change":"2023-12-20T04:23:26.662650+0000","last_active":"2023-12-20T04:23:27.648900+0000","last_peered":"2023-12-20T04:23:27.648900+0000","last_clean":"2023-12-20T04:23:27.648900+0000","last_became_active":"2023-12-20T04:23:26.662377+0000","last_became_peered":"2023-12-20T04:23:26.662377+0000","last_unstale":"2023-12-20T04:23:27.648900+0000","last_undegraded":"2023-12-20T04:23:27.648900+0000","last_fullsized":"2023-12-20T04:23:27.648900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646456+0000","last_change":"2023-12-20T04:23:26.666772+0000","last_active":"2023-12-20T04:23:27.646456+0000","last_peered":"2023-12-20T04:23:27.646456+0000","last_clean":"2023-12-20T04:23:27.646456+0000","last_became_active":"2023-12-20T04:23:26.666531+0000","last_became_peered":"2023-12-20T04:23:26.666531+0000","last_unstale":"2023-12-20T04:23:27.646456+0000","last_undegraded":"2023-12-20T04:23:27.646456+0000","last_fullsized":"2023-12-20T04:23:27.646456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579870+0000","last_change":"2023-12-20T04:23:26.663285+0000","last_active":"2023-12-20T04:23:28.579870+0000","last_peered":"2023-12-20T04:23:28.579870+0000","last_clean":"2023-12-20T04:23:28.579870+0000","last_became_active":"2023-12-20T04:23:26.662878+0000","last_became_peered":"2023-12-20T04:23:26.662878+0000","last_unstale":"2023-12-20T04:23:28.579870+0000","last_undegraded":"2023-12-20T04:23:28.579870+0000","last_fullsized":"2023-12-20T04:23:28.579870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692402+0000","last_change":"2023-12-20T04:23:26.658130+0000","last_active":"2023-12-20T04:23:28.692402+0000","last_peered":"2023-12-20T04:23:28.692402+0000","last_clean":"2023-12-20T04:23:28.692402+0000","last_became_active":"2023-12-20T04:23:26.657806+0000","last_became_peered":"2023-12-20T04:23:26.657806+0000","last_unstale":"2023-12-20T04:23:28.692402+0000","last_undegraded":"2023-12-20T04:23:28.692402+0000","last_fullsized":"2023-12-20T04:23:28.692402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692986+0000","last_change":"2023-12-20T04:23:26.667214+0000","last_active":"2023-12-20T04:23:28.692986+0000","last_peered":"2023-12-20T04:23:28.692986+0000","last_clean":"2023-12-20T04:23:28.692986+0000","last_became_active":"2023-12-20T04:23:26.666941+0000","last_became_peered":"2023-12-20T04:23:26.666941+0000","last_unstale":"2023-12-20T04:23:28.692986+0000","last_undegraded":"2023-12-20T04:23:28.692986+0000","last_fullsized":"2023-12-20T04:23:28.692986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177740+0000","last_change":"2023-12-20T04:23:26.661015+0000","last_active":"2023-12-20T04:23:28.177740+0000","last_peered":"2023-12-20T04:23:28.177740+0000","last_clean":"2023-12-20T04:23:28.177740+0000","last_became_active":"2023-12-20T04:23:26.660710+0000","last_became_peered":"2023-12-20T04:23:26.660710+0000","last_unstale":"2023-12-20T04:23:28.177740+0000","last_undegraded":"2023-12-20T04:23:28.177740+0000","last_fullsized":"2023-12-20T04:23:28.177740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:14.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648277+0000","last_change":"2023-12-20T04:23:26.661715+0000","last_active":"2023-12-20T04:23:27.648277+0000","last_peered":"2023-12-20T04:23:27.648277+0000","last_clean":"2023-12-20T04:23:27.648277+0000","last_became_active":"2023-12-20T04:23:26.660262+0000","last_became_peered":"2023-12-20T04:23:26.660262+0000","last_unstale":"2023-12-20T04:23:27.648277+0000","last_undegraded":"2023-12-20T04:23:27.648277+0000","last_fullsized":"2023-12-20T04:23:27.648277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648886+0000","last_change":"2023-12-20T04:23:26.666784+0000","last_active":"2023-12-20T04:23:27.648886+0000","last_peered":"2023-12-20T04:23:27.648886+0000","last_clean":"2023-12-20T04:23:27.648886+0000","last_became_active":"2023-12-20T04:23:26.666421+0000","last_became_peered":"2023-12-20T04:23:26.666421+0000","last_unstale":"2023-12-20T04:23:27.648886+0000","last_undegraded":"2023-12-20T04:23:27.648886+0000","last_fullsized":"2023-12-20T04:23:27.648886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:20.915118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579911+0000","last_change":"2023-12-20T04:23:26.282457+0000","last_active":"2023-12-20T04:23:28.579911+0000","last_peered":"2023-12-20T04:23:28.579911+0000","last_clean":"2023-12-20T04:23:28.579911+0000","last_became_active":"2023-12-20T04:23:26.281316+0000","last_became_peered":"2023-12-20T04:23:26.281316+0000","last_unstale":"2023-12-20T04:23:28.579911+0000","last_undegraded":"2023-12-20T04:23:28.579911+0000","last_fullsized":"2023-12-20T04:23:28.579911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692426+0000","last_change":"2023-12-20T04:23:26.663926+0000","last_active":"2023-12-20T04:23:28.692426+0000","last_peered":"2023-12-20T04:23:28.692426+0000","last_clean":"2023-12-20T04:23:28.692426+0000","last_became_active":"2023-12-20T04:23:26.663675+0000","last_became_peered":"2023-12-20T04:23:26.663675+0000","last_unstale":"2023-12-20T04:23:28.692426+0000","last_undegraded":"2023-12-20T04:23:28.692426+0000","last_fullsized":"2023-12-20T04:23:28.692426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648259+0000","last_change":"2023-12-20T04:23:26.277616+0000","last_active":"2023-12-20T04:23:27.648259+0000","last_peered":"2023-12-20T04:23:27.648259+0000","last_clean":"2023-12-20T04:23:27.648259+0000","last_became_active":"2023-12-20T04:23:26.277349+0000","last_became_peered":"2023-12-20T04:23:26.277349+0000","last_unstale":"2023-12-20T04:23:27.648259+0000","last_undegraded":"2023-12-20T04:23:27.648259+0000","last_fullsized":"2023-12-20T04:23:27.648259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579656+0000","last_change":"2023-12-20T04:23:26.279099+0000","last_active":"2023-12-20T04:23:28.579656+0000","last_peered":"2023-12-20T04:23:28.579656+0000","last_clean":"2023-12-20T04:23:28.579656+0000","last_became_active":"2023-12-20T04:23:26.278619+0000","last_became_peered":"2023-12-20T04:23:26.278619+0000","last_unstale":"2023-12-20T04:23:28.579656+0000","last_undegraded":"2023-12-20T04:23:28.579656+0000","last_fullsized":"2023-12-20T04:23:28.579656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579626+0000","last_change":"2023-12-20T04:23:26.662251+0000","last_active":"2023-12-20T04:23:28.579626+0000","last_peered":"2023-12-20T04:23:28.579626+0000","last_clean":"2023-12-20T04:23:28.579626+0000","last_became_active":"2023-12-20T04:23:26.661973+0000","last_became_peered":"2023-12-20T04:23:26.661973+0000","last_unstale":"2023-12-20T04:23:28.579626+0000","last_undegraded":"2023-12-20T04:23:28.579626+0000","last_fullsized":"2023-12-20T04:23:28.579626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692924+0000","last_change":"2023-12-20T04:23:26.283773+0000","last_active":"2023-12-20T04:23:28.692924+0000","last_peered":"2023-12-20T04:23:28.692924+0000","last_clean":"2023-12-20T04:23:28.692924+0000","last_became_active":"2023-12-20T04:23:26.283502+0000","last_became_peered":"2023-12-20T04:23:26.283502+0000","last_unstale":"2023-12-20T04:23:28.692924+0000","last_undegraded":"2023-12-20T04:23:28.692924+0000","last_fullsized":"2023-12-20T04:23:28.692924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646247+0000","last_change":"2023-12-20T04:23:26.664741+0000","last_active":"2023-12-20T04:23:27.646247+0000","last_peered":"2023-12-20T04:23:27.646247+0000","last_clean":"2023-12-20T04:23:27.646247+0000","last_became_active":"2023-12-20T04:23:26.664295+0000","last_became_peered":"2023-12-20T04:23:26.664295+0000","last_unstale":"2023-12-20T04:23:27.646247+0000","last_undegraded":"2023-12-20T04:23:27.646247+0000","last_fullsized":"2023-12-20T04:23:27.646247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648893+0000","last_change":"2023-12-20T04:23:26.285849+0000","last_active":"2023-12-20T04:23:27.648893+0000","last_peered":"2023-12-20T04:23:27.648893+0000","last_clean":"2023-12-20T04:23:27.648893+0000","last_became_active":"2023-12-20T04:23:26.285531+0000","last_became_peered":"2023-12-20T04:23:26.285531+0000","last_unstale":"2023-12-20T04:23:27.648893+0000","last_undegraded":"2023-12-20T04:23:27.648893+0000","last_fullsized":"2023-12-20T04:23:27.648893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693176+0000","last_change":"2023-12-20T04:23:26.671630+0000","last_active":"2023-12-20T04:23:28.693176+0000","last_peered":"2023-12-20T04:23:28.693176+0000","last_clean":"2023-12-20T04:23:28.693176+0000","last_became_active":"2023-12-20T04:23:26.671345+0000","last_became_peered":"2023-12-20T04:23:26.671345+0000","last_unstale":"2023-12-20T04:23:28.693176+0000","last_undegraded":"2023-12-20T04:23:28.693176+0000","last_fullsized":"2023-12-20T04:23:28.693176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:15.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693213+0000","last_change":"2023-12-20T04:23:26.284968+0000","last_active":"2023-12-20T04:23:28.693213+0000","last_peered":"2023-12-20T04:23:28.693213+0000","last_clean":"2023-12-20T04:23:28.693213+0000","last_became_active":"2023-12-20T04:23:26.283961+0000","last_became_peered":"2023-12-20T04:23:26.283961+0000","last_unstale":"2023-12-20T04:23:28.693213+0000","last_undegraded":"2023-12-20T04:23:28.693213+0000","last_fullsized":"2023-12-20T04:23:28.693213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692449+0000","last_change":"2023-12-20T04:23:26.668101+0000","last_active":"2023-12-20T04:23:28.692449+0000","last_peered":"2023-12-20T04:23:28.692449+0000","last_clean":"2023-12-20T04:23:28.692449+0000","last_became_active":"2023-12-20T04:23:26.667868+0000","last_became_peered":"2023-12-20T04:23:26.667868+0000","last_unstale":"2023-12-20T04:23:28.692449+0000","last_undegraded":"2023-12-20T04:23:28.692449+0000","last_fullsized":"2023-12-20T04:23:28.692449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:51:34.130960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646469+0000","last_change":"2023-12-20T04:23:26.285125+0000","last_active":"2023-12-20T04:23:27.646469+0000","last_peered":"2023-12-20T04:23:27.646469+0000","last_clean":"2023-12-20T04:23:27.646469+0000","last_became_active":"2023-12-20T04:23:26.284858+0000","last_became_peered":"2023-12-20T04:23:26.284858+0000","last_unstale":"2023-12-20T04:23:27.646469+0000","last_undegraded":"2023-12-20T04:23:27.646469+0000","last_fullsized":"2023-12-20T04:23:27.646469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:13.196722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648778+0000","last_change":"2023-12-20T04:23:26.662730+0000","last_active":"2023-12-20T04:23:27.648778+0000","last_peered":"2023-12-20T04:23:27.648778+0000","last_clean":"2023-12-20T04:23:27.648778+0000","last_became_active":"2023-12-20T04:23:26.662433+0000","last_became_peered":"2023-12-20T04:23:26.662433+0000","last_unstale":"2023-12-20T04:23:27.648778+0000","last_undegraded":"2023-12-20T04:23:27.648778+0000","last_fullsized":"2023-12-20T04:23:27.648778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:04.276683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648317+0000","last_change":"2023-12-20T04:23:26.281774+0000","last_active":"2023-12-20T04:23:27.648317+0000","last_peered":"2023-12-20T04:23:27.648317+0000","last_clean":"2023-12-20T04:23:27.648317+0000","last_became_active":"2023-12-20T04:23:26.281481+0000","last_became_peered":"2023-12-20T04:23:26.281481+0000","last_unstale":"2023-12-20T04:23:27.648317+0000","last_undegraded":"2023-12-20T04:23:27.648317+0000","last_fullsized":"2023-12-20T04:23:27.648317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061436+0000","last_change":"2023-12-20T04:23:26.658159+0000","last_active":"2023-12-20T04:23:28.061436+0000","last_peered":"2023-12-20T04:23:28.061436+0000","last_clean":"2023-12-20T04:23:28.061436+0000","last_became_active":"2023-12-20T04:23:26.657870+0000","last_became_peered":"2023-12-20T04:23:26.657870+0000","last_unstale":"2023-12-20T04:23:28.061436+0000","last_undegraded":"2023-12-20T04:23:28.061436+0000","last_fullsized":"2023-12-20T04:23:28.061436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:25.045988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692465+0000","last_change":"2023-12-20T04:23:26.286048+0000","last_active":"2023-12-20T04:23:28.692465+0000","last_peered":"2023-12-20T04:23:28.692465+0000","last_clean":"2023-12-20T04:23:28.692465+0000","last_became_active":"2023-12-20T04:23:26.285776+0000","last_became_peered":"2023-12-20T04:23:26.285776+0000","last_unstale":"2023-12-20T04:23:28.692465+0000","last_undegraded":"2023-12-20T04:23:28.692465+0000","last_fullsized":"2023-12-20T04:23:28.692465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692226+0000","last_change":"2023-12-20T04:23:26.658401+0000","last_active":"2023-12-20T04:23:28.692226+0000","last_peered":"2023-12-20T04:23:28.692226+0000","last_clean":"2023-12-20T04:23:28.692226+0000","last_became_active":"2023-12-20T04:23:26.658117+0000","last_became_peered":"2023-12-20T04:23:26.658117+0000","last_unstale":"2023-12-20T04:23:28.692226+0000","last_undegraded":"2023-12-20T04:23:28.692226+0000","last_fullsized":"2023-12-20T04:23:28.692226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693041+0000","last_change":"2023-12-20T04:23:26.288724+0000","last_active":"2023-12-20T04:23:28.693041+0000","last_peered":"2023-12-20T04:23:28.693041+0000","last_clean":"2023-12-20T04:23:28.693041+0000","last_became_active":"2023-12-20T04:23:26.288544+0000","last_became_peered":"2023-12-20T04:23:26.288544+0000","last_unstale":"2023-12-20T04:23:28.693041+0000","last_undegraded":"2023-12-20T04:23:28.693041+0000","last_fullsized":"2023-12-20T04:23:28.693041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061274+0000","last_change":"2023-12-20T04:23:26.664506+0000","last_active":"2023-12-20T04:23:28.061274+0000","last_peered":"2023-12-20T04:23:28.061274+0000","last_clean":"2023-12-20T04:23:28.061274+0000","last_became_active":"2023-12-20T04:23:26.664257+0000","last_became_peered":"2023-12-20T04:23:26.664257+0000","last_unstale":"2023-12-20T04:23:28.061274+0000","last_undegraded":"2023-12-20T04:23:28.061274+0000","last_fullsized":"2023-12-20T04:23:28.061274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:26.732551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648216+0000","last_change":"2023-12-20T04:23:26.278212+0000","last_active":"2023-12-20T04:23:27.648216+0000","last_peered":"2023-12-20T04:23:27.648216+0000","last_clean":"2023-12-20T04:23:27.648216+0000","last_became_active":"2023-12-20T04:23:26.277934+0000","last_became_peered":"2023-12-20T04:23:26.277934+0000","last_unstale":"2023-12-20T04:23:27.648216+0000","last_undegraded":"2023-12-20T04:23:27.648216+0000","last_fullsized":"2023-12-20T04:23:27.648216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648152+0000","last_change":"2023-12-20T04:23:26.661558+0000","last_active":"2023-12-20T04:23:27.648152+0000","last_peered":"2023-12-20T04:23:27.648152+0000","last_clean":"2023-12-20T04:23:27.648152+0000","last_became_active":"2023-12-20T04:23:26.659798+0000","last_became_peered":"2023-12-20T04:23:26.659798+0000","last_unstale":"2023-12-20T04:23:27.648152+0000","last_undegraded":"2023-12-20T04:23:27.648152+0000","last_fullsized":"2023-12-20T04:23:27.648152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177704+0000","last_change":"2023-12-20T04:23:26.284487+0000","last_active":"2023-12-20T04:23:28.177704+0000","last_peered":"2023-12-20T04:23:28.177704+0000","last_clean":"2023-12-20T04:23:28.177704+0000","last_became_active":"2023-12-20T04:23:26.283900+0000","last_became_peered":"2023-12-20T04:23:26.283900+0000","last_unstale":"2023-12-20T04:23:28.177704+0000","last_undegraded":"2023-12-20T04:23:28.177704+0000","last_fullsized":"2023-12-20T04:23:28.177704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061185+0000","last_change":"2023-12-20T04:23:26.665136+0000","last_active":"2023-12-20T04:23:28.061185+0000","last_peered":"2023-12-20T04:23:28.061185+0000","last_clean":"2023-12-20T04:23:28.061185+0000","last_became_active":"2023-12-20T04:23:26.664875+0000","last_became_peered":"2023-12-20T04:23:26.664875+0000","last_unstale":"2023-12-20T04:23:28.061185+0000","last_undegraded":"2023-12-20T04:23:28.061185+0000","last_fullsized":"2023-12-20T04:23:28.061185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:15.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648681+0000","last_change":"2023-12-20T04:23:26.284637+0000","last_active":"2023-12-20T04:23:27.648681+0000","last_peered":"2023-12-20T04:23:27.648681+0000","last_clean":"2023-12-20T04:23:27.648681+0000","last_became_active":"2023-12-20T04:23:26.284372+0000","last_became_peered":"2023-12-20T04:23:26.284372+0000","last_unstale":"2023-12-20T04:23:27.648681+0000","last_undegraded":"2023-12-20T04:23:27.648681+0000","last_fullsized":"2023-12-20T04:23:27.648681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:00:36.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061596+0000","last_change":"2023-12-20T04:23:26.663644+0000","last_active":"2023-12-20T04:23:28.061596+0000","last_peered":"2023-12-20T04:23:28.061596+0000","last_clean":"2023-12-20T04:23:28.061596+0000","last_became_active":"2023-12-20T04:23:26.663233+0000","last_became_peered":"2023-12-20T04:23:26.663233+0000","last_unstale":"2023-12-20T04:23:28.061596+0000","last_undegraded":"2023-12-20T04:23:28.061596+0000","last_fullsized":"2023-12-20T04:23:28.061596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177928+0000","last_change":"2023-12-20T04:23:26.292362+0000","last_active":"2023-12-20T04:23:28.177928+0000","last_peered":"2023-12-20T04:23:28.177928+0000","last_clean":"2023-12-20T04:23:28.177928+0000","last_became_active":"2023-12-20T04:23:26.291998+0000","last_became_peered":"2023-12-20T04:23:26.291998+0000","last_unstale":"2023-12-20T04:23:28.177928+0000","last_undegraded":"2023-12-20T04:23:28.177928+0000","last_fullsized":"2023-12-20T04:23:28.177928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061688+0000","last_change":"2023-12-20T04:23:26.663859+0000","last_active":"2023-12-20T04:23:28.061688+0000","last_peered":"2023-12-20T04:23:28.061688+0000","last_clean":"2023-12-20T04:23:28.061688+0000","last_became_active":"2023-12-20T04:23:26.663615+0000","last_became_peered":"2023-12-20T04:23:26.663615+0000","last_unstale":"2023-12-20T04:23:28.061688+0000","last_undegraded":"2023-12-20T04:23:28.061688+0000","last_fullsized":"2023-12-20T04:23:28.061688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646520+0000","last_change":"2023-12-20T04:23:26.278555+0000","last_active":"2023-12-20T04:23:27.646520+0000","last_peered":"2023-12-20T04:23:27.646520+0000","last_clean":"2023-12-20T04:23:27.646520+0000","last_became_active":"2023-12-20T04:23:26.278297+0000","last_became_peered":"2023-12-20T04:23:26.278297+0000","last_unstale":"2023-12-20T04:23:27.646520+0000","last_undegraded":"2023-12-20T04:23:27.646520+0000","last_fullsized":"2023-12-20T04:23:27.646520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693278+0000","last_change":"2023-12-20T04:23:26.673127+0000","last_active":"2023-12-20T04:23:28.693278+0000","last_peered":"2023-12-20T04:23:28.693278+0000","last_clean":"2023-12-20T04:23:28.693278+0000","last_became_active":"2023-12-20T04:23:26.672852+0000","last_became_peered":"2023-12-20T04:23:26.672852+0000","last_unstale":"2023-12-20T04:23:28.693278+0000","last_undegraded":"2023-12-20T04:23:28.693278+0000","last_fullsized":"2023-12-20T04:23:28.693278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177875+0000","last_change":"2023-12-20T04:23:26.284610+0000","last_active":"2023-12-20T04:23:28.177875+0000","last_peered":"2023-12-20T04:23:28.177875+0000","last_clean":"2023-12-20T04:23:28.177875+0000","last_became_active":"2023-12-20T04:23:26.284222+0000","last_became_peered":"2023-12-20T04:23:26.284222+0000","last_unstale":"2023-12-20T04:23:28.177875+0000","last_undegraded":"2023-12-20T04:23:28.177875+0000","last_fullsized":"2023-12-20T04:23:28.177875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061438+0000","last_change":"2023-12-20T04:23:26.667851+0000","last_active":"2023-12-20T04:23:28.061438+0000","last_peered":"2023-12-20T04:23:28.061438+0000","last_clean":"2023-12-20T04:23:28.061438+0000","last_became_active":"2023-12-20T04:23:26.667603+0000","last_became_peered":"2023-12-20T04:23:26.667603+0000","last_unstale":"2023-12-20T04:23:28.061438+0000","last_undegraded":"2023-12-20T04:23:28.061438+0000","last_fullsized":"2023-12-20T04:23:28.061438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:00.052684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:23:26.652599+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:23:26.652599+0000","last_peered":"2023-12-20T04:23:26.652599+0000","last_clean":"2023-12-20T04:23:26.652599+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:23:26.652599+0000","last_undegraded":"2023-12-20T04:23:26.652599+0000","last_fullsized":"2023-12-20T04:23:26.652599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692947+0000","last_change":"2023-12-20T04:23:26.284499+0000","last_active":"2023-12-20T04:23:28.692947+0000","last_peered":"2023-12-20T04:23:28.692947+0000","last_clean":"2023-12-20T04:23:28.692947+0000","last_became_active":"2023-12-20T04:23:26.284235+0000","last_became_peered":"2023-12-20T04:23:26.284235+0000","last_unstale":"2023-12-20T04:23:28.692947+0000","last_undegraded":"2023-12-20T04:23:28.692947+0000","last_fullsized":"2023-12-20T04:23:28.692947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579786+0000","last_change":"2023-12-20T04:23:26.673891+0000","last_active":"2023-12-20T04:23:28.579786+0000","last_peered":"2023-12-20T04:23:28.579786+0000","last_clean":"2023-12-20T04:23:28.579786+0000","last_became_active":"2023-12-20T04:23:26.673596+0000","last_became_peered":"2023-12-20T04:23:26.673596+0000","last_unstale":"2023-12-20T04:23:28.579786+0000","last_undegraded":"2023-12-20T04:23:28.579786+0000","last_fullsized":"2023-12-20T04:23:28.579786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061040+0000","last_change":"2023-12-20T04:23:26.285507+0000","last_active":"2023-12-20T04:23:28.061040+0000","last_peered":"2023-12-20T04:23:28.061040+0000","last_clean":"2023-12-20T04:23:28.061040+0000","last_became_active":"2023-12-20T04:23:26.285258+0000","last_became_peered":"2023-12-20T04:23:26.285258+0000","last_unstale":"2023-12-20T04:23:28.061040+0000","last_undegraded":"2023-12-20T04:23:28.061040+0000","last_fullsized":"2023-12-20T04:23:28.061040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692149+0000","last_change":"2023-12-20T04:23:26.664608+0000","last_active":"2023-12-20T04:23:28.692149+0000","last_peered":"2023-12-20T04:23:28.692149+0000","last_clean":"2023-12-20T04:23:28.692149+0000","last_became_active":"2023-12-20T04:23:26.664342+0000","last_became_peered":"2023-12-20T04:23:26.664342+0000","last_unstale":"2023-12-20T04:23:28.692149+0000","last_undegraded":"2023-12-20T04:23:28.692149+0000","last_fullsized":"2023-12-20T04:23:28.692149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:19.585364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177946+0000","last_change":"2023-12-20T04:23:26.292355+0000","last_active":"2023-12-20T04:23:28.177946+0000","last_peered":"2023-12-20T04:23:28.177946+0000","last_clean":"2023-12-20T04:23:28.177946+0000","last_became_active":"2023-12-20T04:23:26.292011+0000","last_became_peered":"2023-12-20T04:23:26.292011+0000","last_unstale":"2023-12-20T04:23:28.177946+0000","last_undegraded":"2023-12-20T04:23:28.177946+0000","last_fullsized":"2023-12-20T04:23:28.177946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646297+0000","last_change":"2023-12-20T04:23:26.664413+0000","last_active":"2023-12-20T04:23:27.646297+0000","last_peered":"2023-12-20T04:23:27.646297+0000","last_clean":"2023-12-20T04:23:27.646297+0000","last_became_active":"2023-12-20T04:23:26.664071+0000","last_became_peered":"2023-12-20T04:23:26.664071+0000","last_unstale":"2023-12-20T04:23:27.646297+0000","last_undegraded":"2023-12-20T04:23:27.646297+0000","last_fullsized":"2023-12-20T04:23:27.646297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693216+0000","last_change":"2023-12-20T04:23:26.284859+0000","last_active":"2023-12-20T04:23:28.693216+0000","last_peered":"2023-12-20T04:23:28.693216+0000","last_clean":"2023-12-20T04:23:28.693216+0000","last_became_active":"2023-12-20T04:23:26.284584+0000","last_became_peered":"2023-12-20T04:23:26.284584+0000","last_unstale":"2023-12-20T04:23:28.693216+0000","last_undegraded":"2023-12-20T04:23:28.693216+0000","last_fullsized":"2023-12-20T04:23:28.693216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648580+0000","last_change":"2023-12-20T04:23:26.660582+0000","last_active":"2023-12-20T04:23:27.648580+0000","last_peered":"2023-12-20T04:23:27.648580+0000","last_clean":"2023-12-20T04:23:27.648580+0000","last_became_active":"2023-12-20T04:23:26.660268+0000","last_became_peered":"2023-12-20T04:23:26.660268+0000","last_unstale":"2023-12-20T04:23:27.648580+0000","last_undegraded":"2023-12-20T04:23:27.648580+0000","last_fullsized":"2023-12-20T04:23:27.648580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:14.759440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646423+0000","last_change":"2023-12-20T04:23:26.284941+0000","last_active":"2023-12-20T04:23:27.646423+0000","last_peered":"2023-12-20T04:23:27.646423+0000","last_clean":"2023-12-20T04:23:27.646423+0000","last_became_active":"2023-12-20T04:23:26.284623+0000","last_became_peered":"2023-12-20T04:23:26.284623+0000","last_unstale":"2023-12-20T04:23:27.646423+0000","last_undegraded":"2023-12-20T04:23:27.646423+0000","last_fullsized":"2023-12-20T04:23:27.646423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693278+0000","last_change":"2023-12-20T04:23:26.672358+0000","last_active":"2023-12-20T04:23:28.693278+0000","last_peered":"2023-12-20T04:23:28.693278+0000","last_clean":"2023-12-20T04:23:28.693278+0000","last_became_active":"2023-12-20T04:23:26.672111+0000","last_became_peered":"2023-12-20T04:23:26.672111+0000","last_unstale":"2023-12-20T04:23:28.693278+0000","last_undegraded":"2023-12-20T04:23:28.693278+0000","last_fullsized":"2023-12-20T04:23:28.693278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061655+0000","last_change":"2023-12-20T04:23:26.292027+0000","last_active":"2023-12-20T04:23:28.061655+0000","last_peered":"2023-12-20T04:23:28.061655+0000","last_clean":"2023-12-20T04:23:28.061655+0000","last_became_active":"2023-12-20T04:23:26.291668+0000","last_became_peered":"2023-12-20T04:23:26.291668+0000","last_unstale":"2023-12-20T04:23:28.061655+0000","last_undegraded":"2023-12-20T04:23:28.061655+0000","last_fullsized":"2023-12-20T04:23:28.061655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:13.754694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646427+0000","last_change":"2023-12-20T04:23:26.665693+0000","last_active":"2023-12-20T04:23:27.646427+0000","last_peered":"2023-12-20T04:23:27.646427+0000","last_clean":"2023-12-20T04:23:27.646427+0000","last_became_active":"2023-12-20T04:23:26.665421+0000","last_became_peered":"2023-12-20T04:23:26.665421+0000","last_unstale":"2023-12-20T04:23:27.646427+0000","last_undegraded":"2023-12-20T04:23:27.646427+0000","last_fullsized":"2023-12-20T04:23:27.646427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:29.545264+0000","last_change":"2023-12-20T04:23:26.280830+0000","last_active":"2023-12-20T04:23:29.545264+0000","last_peered":"2023-12-20T04:23:29.545264+0000","last_clean":"2023-12-20T04:23:29.545264+0000","last_became_active":"2023-12-20T04:23:26.280522+0000","last_became_peered":"2023-12-20T04:23:26.280522+0000","last_unstale":"2023-12-20T04:23:29.545264+0000","last_undegraded":"2023-12-20T04:23:29.545264+0000","last_fullsized":"2023-12-20T04:23:29.545264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:03.271936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579867+0000","last_change":"2023-12-20T04:23:26.669071+0000","last_active":"2023-12-20T04:23:28.579867+0000","last_peered":"2023-12-20T04:23:28.579867+0000","last_clean":"2023-12-20T04:23:28.579867+0000","last_became_active":"2023-12-20T04:23:26.668801+0000","last_became_peered":"2023-12-20T04:23:26.668801+0000","last_unstale":"2023-12-20T04:23:28.579867+0000","last_undegraded":"2023-12-20T04:23:28.579867+0000","last_fullsized":"2023-12-20T04:23:28.579867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648978+0000","last_change":"2023-12-20T04:23:26.282356+0000","last_active":"2023-12-20T04:23:27.648978+0000","last_peered":"2023-12-20T04:23:27.648978+0000","last_clean":"2023-12-20T04:23:27.648978+0000","last_became_active":"2023-12-20T04:23:26.282046+0000","last_became_peered":"2023-12-20T04:23:26.282046+0000","last_unstale":"2023-12-20T04:23:27.648978+0000","last_undegraded":"2023-12-20T04:23:27.648978+0000","last_fullsized":"2023-12-20T04:23:27.648978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692373+0000","last_change":"2023-12-20T04:23:26.666869+0000","last_active":"2023-12-20T04:23:28.692373+0000","last_peered":"2023-12-20T04:23:28.692373+0000","last_clean":"2023-12-20T04:23:28.692373+0000","last_became_active":"2023-12-20T04:23:26.666606+0000","last_became_peered":"2023-12-20T04:23:26.666606+0000","last_unstale":"2023-12-20T04:23:28.692373+0000","last_undegraded":"2023-12-20T04:23:28.692373+0000","last_fullsized":"2023-12-20T04:23:28.692373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061005+0000","last_change":"2023-12-20T04:23:26.291924+0000","last_active":"2023-12-20T04:23:28.061005+0000","last_peered":"2023-12-20T04:23:28.061005+0000","last_clean":"2023-12-20T04:23:28.061005+0000","last_became_active":"2023-12-20T04:23:26.291445+0000","last_became_peered":"2023-12-20T04:23:26.291445+0000","last_unstale":"2023-12-20T04:23:28.061005+0000","last_undegraded":"2023-12-20T04:23:28.061005+0000","last_fullsized":"2023-12-20T04:23:28.061005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:13.196722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648824+0000","last_change":"2023-12-20T04:23:26.661472+0000","last_active":"2023-12-20T04:23:27.648824+0000","last_peered":"2023-12-20T04:23:27.648824+0000","last_clean":"2023-12-20T04:23:27.648824+0000","last_became_active":"2023-12-20T04:23:26.661072+0000","last_became_peered":"2023-12-20T04:23:26.661072+0000","last_unstale":"2023-12-20T04:23:27.648824+0000","last_undegraded":"2023-12-20T04:23:27.648824+0000","last_fullsized":"2023-12-20T04:23:27.648824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:14.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646334+0000","last_change":"2023-12-20T04:23:26.286742+0000","last_active":"2023-12-20T04:23:27.646334+0000","last_peered":"2023-12-20T04:23:27.646334+0000","last_clean":"2023-12-20T04:23:27.646334+0000","last_became_active":"2023-12-20T04:23:26.286439+0000","last_became_peered":"2023-12-20T04:23:26.286439+0000","last_unstale":"2023-12-20T04:23:27.646334+0000","last_undegraded":"2023-12-20T04:23:27.646334+0000","last_fullsized":"2023-12-20T04:23:27.646334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579841+0000","last_change":"2023-12-20T04:23:26.665515+0000","last_active":"2023-12-20T04:23:28.579841+0000","last_peered":"2023-12-20T04:23:28.579841+0000","last_clean":"2023-12-20T04:23:28.579841+0000","last_became_active":"2023-12-20T04:23:26.664947+0000","last_became_peered":"2023-12-20T04:23:26.664947+0000","last_unstale":"2023-12-20T04:23:28.579841+0000","last_undegraded":"2023-12-20T04:23:28.579841+0000","last_fullsized":"2023-12-20T04:23:28.579841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:18:25.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646417+0000","last_change":"2023-12-20T04:23:26.280703+0000","last_active":"2023-12-20T04:23:27.646417+0000","last_peered":"2023-12-20T04:23:27.646417+0000","last_clean":"2023-12-20T04:23:27.646417+0000","last_became_active":"2023-12-20T04:23:26.280429+0000","last_became_peered":"2023-12-20T04:23:26.280429+0000","last_unstale":"2023-12-20T04:23:27.646417+0000","last_undegraded":"2023-12-20T04:23:27.646417+0000","last_fullsized":"2023-12-20T04:23:27.646417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579858+0000","last_change":"2023-12-20T04:23:26.664971+0000","last_active":"2023-12-20T04:23:28.579858+0000","last_peered":"2023-12-20T04:23:28.579858+0000","last_clean":"2023-12-20T04:23:28.579858+0000","last_became_active":"2023-12-20T04:23:26.664247+0000","last_became_peered":"2023-12-20T04:23:26.664247+0000","last_unstale":"2023-12-20T04:23:28.579858+0000","last_undegraded":"2023-12-20T04:23:28.579858+0000","last_fullsized":"2023-12-20T04:23:28.579858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061365+0000","last_change":"2023-12-20T04:23:26.292375+0000","last_active":"2023-12-20T04:23:28.061365+0000","last_peered":"2023-12-20T04:23:28.061365+0000","last_clean":"2023-12-20T04:23:28.061365+0000","last_became_active":"2023-12-20T04:23:26.292034+0000","last_became_peered":"2023-12-20T04:23:26.292034+0000","last_unstale":"2023-12-20T04:23:28.061365+0000","last_undegraded":"2023-12-20T04:23:28.061365+0000","last_fullsized":"2023-12-20T04:23:28.061365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648275+0000","last_change":"2023-12-20T04:23:26.663174+0000","last_active":"2023-12-20T04:23:27.648275+0000","last_peered":"2023-12-20T04:23:27.648275+0000","last_clean":"2023-12-20T04:23:27.648275+0000","last_became_active":"2023-12-20T04:23:26.662709+0000","last_became_peered":"2023-12-20T04:23:26.662709+0000","last_unstale":"2023-12-20T04:23:27.648275+0000","last_undegraded":"2023-12-20T04:23:27.648275+0000","last_fullsized":"2023-12-20T04:23:27.648275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693257+0000","last_change":"2023-12-20T04:23:26.667112+0000","last_active":"2023-12-20T04:23:28.693257+0000","last_peered":"2023-12-20T04:23:28.693257+0000","last_clean":"2023-12-20T04:23:28.693257+0000","last_became_active":"2023-12-20T04:23:26.666537+0000","last_became_peered":"2023-12-20T04:23:26.666537+0000","last_unstale":"2023-12-20T04:23:28.693257+0000","last_undegraded":"2023-12-20T04:23:28.693257+0000","last_fullsized":"2023-12-20T04:23:28.693257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061363+0000","last_change":"2023-12-20T04:23:26.287011+0000","last_active":"2023-12-20T04:23:28.061363+0000","last_peered":"2023-12-20T04:23:28.061363+0000","last_clean":"2023-12-20T04:23:28.061363+0000","last_became_active":"2023-12-20T04:23:26.286702+0000","last_became_peered":"2023-12-20T04:23:26.286702+0000","last_unstale":"2023-12-20T04:23:28.061363+0000","last_undegraded":"2023-12-20T04:23:28.061363+0000","last_fullsized":"2023-12-20T04:23:28.061363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693236+0000","last_change":"2023-12-20T04:23:26.670705+0000","last_active":"2023-12-20T04:23:28.693236+0000","last_peered":"2023-12-20T04:23:28.693236+0000","last_clean":"2023-12-20T04:23:28.693236+0000","last_became_active":"2023-12-20T04:23:26.670216+0000","last_became_peered":"2023-12-20T04:23:26.670216+0000","last_unstale":"2023-12-20T04:23:28.693236+0000","last_undegraded":"2023-12-20T04:23:28.693236+0000","last_fullsized":"2023-12-20T04:23:28.693236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061565+0000","last_change":"2023-12-20T04:23:26.287007+0000","last_active":"2023-12-20T04:23:28.061565+0000","last_peered":"2023-12-20T04:23:28.061565+0000","last_clean":"2023-12-20T04:23:28.061565+0000","last_became_active":"2023-12-20T04:23:26.286700+0000","last_became_peered":"2023-12-20T04:23:26.286700+0000","last_unstale":"2023-12-20T04:23:28.061565+0000","last_undegraded":"2023-12-20T04:23:28.061565+0000","last_fullsized":"2023-12-20T04:23:28.061565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:03.271936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692365+0000","last_change":"2023-12-20T04:23:26.668234+0000","last_active":"2023-12-20T04:23:28.692365+0000","last_peered":"2023-12-20T04:23:28.692365+0000","last_clean":"2023-12-20T04:23:28.692365+0000","last_became_active":"2023-12-20T04:23:26.667991+0000","last_became_peered":"2023-12-20T04:23:26.667991+0000","last_unstale":"2023-12-20T04:23:28.692365+0000","last_undegraded":"2023-12-20T04:23:28.692365+0000","last_fullsized":"2023-12-20T04:23:28.692365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:24:56.720868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579915+0000","last_change":"2023-12-20T04:23:26.284158+0000","last_active":"2023-12-20T04:23:28.579915+0000","last_peered":"2023-12-20T04:23:28.579915+0000","last_clean":"2023-12-20T04:23:28.579915+0000","last_became_active":"2023-12-20T04:23:26.283866+0000","last_became_peered":"2023-12-20T04:23:26.283866+0000","last_unstale":"2023-12-20T04:23:28.579915+0000","last_undegraded":"2023-12-20T04:23:28.579915+0000","last_fullsized":"2023-12-20T04:23:28.579915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579780+0000","last_change":"2023-12-20T04:23:26.669065+0000","last_active":"2023-12-20T04:23:28.579780+0000","last_peered":"2023-12-20T04:23:28.579780+0000","last_clean":"2023-12-20T04:23:28.579780+0000","last_became_active":"2023-12-20T04:23:26.668822+0000","last_became_peered":"2023-12-20T04:23:26.668822+0000","last_unstale":"2023-12-20T04:23:28.579780+0000","last_undegraded":"2023-12-20T04:23:28.579780+0000","last_fullsized":"2023-12-20T04:23:28.579780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692475+0000","last_change":"2023-12-20T04:23:26.289452+0000","last_active":"2023-12-20T04:23:28.692475+0000","last_peered":"2023-12-20T04:23:28.692475+0000","last_clean":"2023-12-20T04:23:28.692475+0000","last_became_active":"2023-12-20T04:23:26.289223+0000","last_became_peered":"2023-12-20T04:23:26.289223+0000","last_unstale":"2023-12-20T04:23:28.692475+0000","last_undegraded":"2023-12-20T04:23:28.692475+0000","last_fullsized":"2023-12-20T04:23:28.692475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:25.367497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:23:34.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:23:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.810+0000 7ff770f47640 1 Processor -- start 2023-12-20T04:23:34.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.810+0000 7ff770f47640 1 -- start start 2023-12-20T04:23:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff770f47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff770f47640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff76c0b4f90 0x7ff76c0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff770f47640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff76c142d90 0x7ff76c0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff770f47640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0b6d70 con 0x7ff76c0b4f90 2023-12-20T04:23:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff770f47640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0b56e0 con 0x7ff76c142d90 2023-12-20T04:23:34.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff770f47640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0b59c0 con 0x7ff76c070ff0 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff769d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff76c0b4f90 0x7ff76c0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff769d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff76c0b4f90 0x7ff76c0b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57572/0 (socket says 172.21.15.40:57572) 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.811+0000 7ff769d9b640 1 -- 172.21.15.40:0/4060778125 learned_addr learned my addr 172.21.15.40:0/4060778125 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff76a59c640 1 --2- 172.21.15.40:0/4060778125 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff76ad9d640 1 --2- 172.21.15.40:0/4060778125 >> v2:172.21.15.69:3300/0 conn(0x7ff76c142d90 0x7ff76c0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff769d9b640 1 -- 172.21.15.40:0/4060778125 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 msgr2=0x7ff76c142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff769d9b640 1 --2- 172.21.15.40:0/4060778125 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff769d9b640 1 -- 172.21.15.40:0/4060778125 >> v2:172.21.15.69:3300/0 conn(0x7ff76c142d90 msgr2=0x7ff76c0b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff769d9b640 1 --2- 172.21.15.40:0/4060778125 >> v2:172.21.15.69:3300/0 conn(0x7ff76c142d90 0x7ff76c0b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff769d9b640 1 -- 172.21.15.40:0/4060778125 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0b5ca0 con 0x7ff76c0b4f90 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.812+0000 7ff769d9b640 1 --2- 172.21.15.40:0/4060778125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c0b78c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0bbfd0 tx=0x7ff75402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e56e48a5c3b2d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff76959a640 1 -- 172.21.15.40:0/4060778125 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754030860 con 0x7ff76c0b4f90 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff76959a640 1 -- 172.21.15.40:0/4060778125 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540309c0 con 0x7ff76c0b4f90 2023-12-20T04:23:34.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff76959a640 1 -- 172.21.15.40:0/4060778125 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754030d50 con 0x7ff76c0b4f90 2023-12-20T04:23:34.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 -- 172.21.15.40:0/4060778125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 msgr2=0x7ff76c0b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 --2- 172.21.15.40:0/4060778125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c0b78c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0bbfd0 tx=0x7ff75402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 -- 172.21.15.40:0/4060778125 shutdown_connections 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 --2- 172.21.15.40:0/4060778125 >> v2:172.21.15.69:3300/0 conn(0x7ff76c142d90 0x7ff76c0b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 --2- 172.21.15.40:0/4060778125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c0b78c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 --2- 172.21.15.40:0/4060778125 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 -- 172.21.15.40:0/4060778125 >> 172.21.15.40:0/4060778125 conn(0x7ff76c0be120 msgr2=0x7ff76c0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 -- 172.21.15.40:0/4060778125 shutdown_connections 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.813+0000 7ff770f47640 1 -- 172.21.15.40:0/4060778125 wait complete. 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.814+0000 7ff770f47640 1 Processor -- start 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.814+0000 7ff770f47640 1 -- start start 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff770f47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c14c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff770f47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff770f47640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff76c142d90 0x7ff76c1e12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff770f47640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c13a4a0 con 0x7ff76c0b4f90 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff770f47640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c149e90 con 0x7ff76c142d90 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff770f47640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0b94d0 con 0x7ff76c070ff0 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57580/0 (socket says 172.21.15.40:57580) 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 -- 172.21.15.40:0/3131729813 learned_addr learned my addr 172.21.15.40:0/3131729813 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff76ad9d640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff76c142d90 0x7ff76c1e12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff76a59c640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c14c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 -- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 msgr2=0x7ff76c14c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c14c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 -- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff76c142d90 msgr2=0x7ff76c1e12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff76c142d90 0x7ff76c1e12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.815+0000 7ff769d9b640 1 -- 172.21.15.40:0/3131729813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540094d0 con 0x7ff76c0b4f90 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.816+0000 7ff769d9b640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c139f60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.816+0000 7ff762ffd640 1 -- 172.21.15.40:0/3131729813 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754039d60 con 0x7ff76c0b4f90 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.816+0000 7ff762ffd640 1 -- 172.21.15.40:0/3131729813 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff754044480 con 0x7ff76c0b4f90 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.816+0000 7ff762ffd640 1 -- 172.21.15.40:0/3131729813 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff754044830 con 0x7ff76c0b4f90 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.816+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76c0bd960 con 0x7ff76c0b4f90 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.816+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c14a090 con 0x7ff76c0b4f90 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.817+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c04e840 con 0x7ff76c0b4f90 2023-12-20T04:23:34.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.817+0000 7ff762ffd640 1 -- 172.21.15.40:0/3131729813 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff75404d3b0 con 0x7ff76c0b4f90 2023-12-20T04:23:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.818+0000 7ff762ffd640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff74c06a430 0x7ff74c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.818+0000 7ff76a59c640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff74c06a430 0x7ff74c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:34.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.818+0000 7ff762ffd640 1 -- 172.21.15.40:0/3131729813 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff75403e070 con 0x7ff76c0b4f90 2023-12-20T04:23:34.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.818+0000 7ff76a59c640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff74c06a430 0x7ff74c06c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff764006fd0 tx=0x7ff764008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:34.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.822+0000 7ff762ffd640 1 -- 172.21.15.40:0/3131729813 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff754076da0 con 0x7ff76c0b4f90 2023-12-20T04:23:34.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:34.994+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff76c0713d0 con 0x7ff74c06a430 2023-12-20T04:23:35.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.001+0000 7ff762ffd640 1 -- 172.21.15.40:0/3131729813 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264521 (secure 0 0 0) 0x7ff76400f860 con 0x7ff74c06a430 2023-12-20T04:23:35.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:35.007 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff74c06a430 msgr2=0x7ff74c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff74c06a430 0x7ff74c06c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff764006fd0 tx=0x7ff764008040 comp rx=0 tx=0).stop 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 msgr2=0x7ff76c139f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c139f60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff754000c00 tx=0x7ff754004730 comp rx=0 tx=0).stop 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 shutdown_connections 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff74c06a430 0x7ff74c06c8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff76c142d90 0x7ff76c1e12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff76c0b4f90 0x7ff76c139f60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 --2- 172.21.15.40:0/3131729813 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff76c070ff0 0x7ff76c14c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 >> 172.21.15.40:0/3131729813 conn(0x7ff76c0be120 msgr2=0x7ff76c1402a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:35.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 shutdown_connections 2023-12-20T04:23:35.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.004+0000 7ff770f47640 1 -- 172.21.15.40:0/3131729813 wait complete. 2023-12-20T04:23:35.015 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-20T04:23:34.528821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218440,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756280,"statfs":{"total":773094113280,"available":772870430720,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002304"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061624+0000","last_change":"2023-12-20T04:23:26.666498+0000","last_active":"2023-12-20T04:23:28.061624+0000","last_peered":"2023-12-20T04:23:28.061624+0000","last_clean":"2023-12-20T04:23:28.061624+0000","last_became_active":"2023-12-20T04:23:26.666246+0000","last_became_peered":"2023-12-20T04:23:26.666246+0000","last_unstale":"2023-12-20T04:23:28.061624+0000","last_undegraded":"2023-12-20T04:23:28.061624+0000","last_fullsized":"2023-12-20T04:23:28.061624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:11.658501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646532+0000","last_change":"2023-12-20T04:23:26.668502+0000","last_active":"2023-12-20T04:23:27.646532+0000","last_peered":"2023-12-20T04:23:27.646532+0000","last_clean":"2023-12-20T04:23:27.646532+0000","last_became_active":"2023-12-20T04:23:26.668226+0000","last_became_peered":"2023-12-20T04:23:26.668226+0000","last_unstale":"2023-12-20T04:23:27.646532+0000","last_undegraded":"2023-12-20T04:23:27.646532+0000","last_fullsized":"2023-12-20T04:23:27.646532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692326+0000","last_change":"2023-12-20T04:23:26.657999+0000","last_active":"2023-12-20T04:23:28.692326+0000","last_peered":"2023-12-20T04:23:28.692326+0000","last_clean":"2023-12-20T04:23:28.692326+0000","last_became_active":"2023-12-20T04:23:26.657747+0000","last_became_peered":"2023-12-20T04:23:26.657747+0000","last_unstale":"2023-12-20T04:23:28.692326+0000","last_undegraded":"2023-12-20T04:23:28.692326+0000","last_fullsized":"2023-12-20T04:23:28.692326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693115+0000","last_change":"2023-12-20T04:23:26.667729+0000","last_active":"2023-12-20T04:23:28.693115+0000","last_peered":"2023-12-20T04:23:28.693115+0000","last_clean":"2023-12-20T04:23:28.693115+0000","last_became_active":"2023-12-20T04:23:26.667465+0000","last_became_peered":"2023-12-20T04:23:26.667465+0000","last_unstale":"2023-12-20T04:23:28.693115+0000","last_undegraded":"2023-12-20T04:23:28.693115+0000","last_fullsized":"2023-12-20T04:23:28.693115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:00.052684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061201+0000","last_change":"2023-12-20T04:23:26.663765+0000","last_active":"2023-12-20T04:23:28.061201+0000","last_peered":"2023-12-20T04:23:28.061201+0000","last_clean":"2023-12-20T04:23:28.061201+0000","last_became_active":"2023-12-20T04:23:26.661392+0000","last_became_peered":"2023-12-20T04:23:26.661392+0000","last_unstale":"2023-12-20T04:23:28.061201+0000","last_undegraded":"2023-12-20T04:23:28.061201+0000","last_fullsized":"2023-12-20T04:23:28.061201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:50:16.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692819+0000","last_change":"2023-12-20T04:23:26.668637+0000","last_active":"2023-12-20T04:23:28.692819+0000","last_peered":"2023-12-20T04:23:28.692819+0000","last_clean":"2023-12-20T04:23:28.692819+0000","last_became_active":"2023-12-20T04:23:26.668371+0000","last_became_peered":"2023-12-20T04:23:26.668371+0000","last_unstale":"2023-12-20T04:23:28.692819+0000","last_undegraded":"2023-12-20T04:23:28.692819+0000","last_fullsized":"2023-12-20T04:23:28.692819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:50:16.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061136+0000","last_change":"2023-12-20T04:23:26.660691+0000","last_active":"2023-12-20T04:23:28.061136+0000","last_peered":"2023-12-20T04:23:28.061136+0000","last_clean":"2023-12-20T04:23:28.061136+0000","last_became_active":"2023-12-20T04:23:26.660437+0000","last_became_peered":"2023-12-20T04:23:26.660437+0000","last_unstale":"2023-12-20T04:23:28.061136+0000","last_undegraded":"2023-12-20T04:23:28.061136+0000","last_fullsized":"2023-12-20T04:23:28.061136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:06:36.081600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579534+0000","last_change":"2023-12-20T04:23:26.670148+0000","last_active":"2023-12-20T04:23:28.579534+0000","last_peered":"2023-12-20T04:23:28.579534+0000","last_clean":"2023-12-20T04:23:28.579534+0000","last_became_active":"2023-12-20T04:23:26.669968+0000","last_became_peered":"2023-12-20T04:23:26.669968+0000","last_unstale":"2023-12-20T04:23:28.579534+0000","last_undegraded":"2023-12-20T04:23:28.579534+0000","last_fullsized":"2023-12-20T04:23:28.579534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061628+0000","last_change":"2023-12-20T04:23:26.671820+0000","last_active":"2023-12-20T04:23:28.061628+0000","last_peered":"2023-12-20T04:23:28.061628+0000","last_clean":"2023-12-20T04:23:28.061628+0000","last_became_active":"2023-12-20T04:23:26.671447+0000","last_became_peered":"2023-12-20T04:23:26.671447+0000","last_unstale":"2023-12-20T04:23:28.061628+0000","last_undegraded":"2023-12-20T04:23:28.061628+0000","last_fullsized":"2023-12-20T04:23:28.061628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648899+0000","last_change":"2023-12-20T04:23:26.667769+0000","last_active":"2023-12-20T04:23:27.648899+0000","last_peered":"2023-12-20T04:23:27.648899+0000","last_clean":"2023-12-20T04:23:27.648899+0000","last_became_active":"2023-12-20T04:23:26.667520+0000","last_became_peered":"2023-12-20T04:23:26.667520+0000","last_unstale":"2023-12-20T04:23:27.648899+0000","last_undegraded":"2023-12-20T04:23:27.648899+0000","last_fullsized":"2023-12-20T04:23:27.648899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648667+0000","last_change":"2023-12-20T04:23:26.668385+0000","last_active":"2023-12-20T04:23:27.648667+0000","last_peered":"2023-12-20T04:23:27.648667+0000","last_clean":"2023-12-20T04:23:27.648667+0000","last_became_active":"2023-12-20T04:23:26.668091+0000","last_became_peered":"2023-12-20T04:23:26.668091+0000","last_unstale":"2023-12-20T04:23:27.648667+0000","last_undegraded":"2023-12-20T04:23:27.648667+0000","last_fullsized":"2023-12-20T04:23:27.648667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648548+0000","last_change":"2023-12-20T04:23:26.664617+0000","last_active":"2023-12-20T04:23:27.648548+0000","last_peered":"2023-12-20T04:23:27.648548+0000","last_clean":"2023-12-20T04:23:27.648548+0000","last_became_active":"2023-12-20T04:23:26.664369+0000","last_became_peered":"2023-12-20T04:23:26.664369+0000","last_unstale":"2023-12-20T04:23:27.648548+0000","last_undegraded":"2023-12-20T04:23:27.648548+0000","last_fullsized":"2023-12-20T04:23:27.648548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:27.375983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.580024+0000","last_change":"2023-12-20T04:23:26.668361+0000","last_active":"2023-12-20T04:23:28.580024+0000","last_peered":"2023-12-20T04:23:28.580024+0000","last_clean":"2023-12-20T04:23:28.580024+0000","last_became_active":"2023-12-20T04:23:26.668035+0000","last_became_peered":"2023-12-20T04:23:26.668035+0000","last_unstale":"2023-12-20T04:23:28.580024+0000","last_undegraded":"2023-12-20T04:23:28.580024+0000","last_fullsized":"2023-12-20T04:23:28.580024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692172+0000","last_change":"2023-12-20T04:23:26.666583+0000","last_active":"2023-12-20T04:23:28.692172+0000","last_peered":"2023-12-20T04:23:28.692172+0000","last_clean":"2023-12-20T04:23:28.692172+0000","last_became_active":"2023-12-20T04:23:26.666196+0000","last_became_peered":"2023-12-20T04:23:26.666196+0000","last_unstale":"2023-12-20T04:23:28.692172+0000","last_undegraded":"2023-12-20T04:23:28.692172+0000","last_fullsized":"2023-12-20T04:23:28.692172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646250+0000","last_change":"2023-12-20T04:23:26.664551+0000","last_active":"2023-12-20T04:23:27.646250+0000","last_peered":"2023-12-20T04:23:27.646250+0000","last_clean":"2023-12-20T04:23:27.646250+0000","last_became_active":"2023-12-20T04:23:26.663982+0000","last_became_peered":"2023-12-20T04:23:26.663982+0000","last_unstale":"2023-12-20T04:23:27.646250+0000","last_undegraded":"2023-12-20T04:23:27.646250+0000","last_fullsized":"2023-12-20T04:23:27.646250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692742+0000","last_change":"2023-12-20T04:23:26.669630+0000","last_active":"2023-12-20T04:23:28.692742+0000","last_peered":"2023-12-20T04:23:28.692742+0000","last_clean":"2023-12-20T04:23:28.692742+0000","last_became_active":"2023-12-20T04:23:26.669031+0000","last_became_peered":"2023-12-20T04:23:26.669031+0000","last_unstale":"2023-12-20T04:23:28.692742+0000","last_undegraded":"2023-12-20T04:23:28.692742+0000","last_fullsized":"2023-12-20T04:23:28.692742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:50.192488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693333+0000","last_change":"2023-12-20T04:23:26.671539+0000","last_active":"2023-12-20T04:23:28.693333+0000","last_peered":"2023-12-20T04:23:28.693333+0000","last_clean":"2023-12-20T04:23:28.693333+0000","last_became_active":"2023-12-20T04:23:26.671276+0000","last_became_peered":"2023-12-20T04:23:26.671276+0000","last_unstale":"2023-12-20T04:23:28.693333+0000","last_undegraded":"2023-12-20T04:23:28.693333+0000","last_fullsized":"2023-12-20T04:23:28.693333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:25.045988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177902+0000","last_change":"2023-12-20T04:23:26.657248+0000","last_active":"2023-12-20T04:23:28.177902+0000","last_peered":"2023-12-20T04:23:28.177902+0000","last_clean":"2023-12-20T04:23:28.177902+0000","last_became_active":"2023-12-20T04:23:26.657002+0000","last_became_peered":"2023-12-20T04:23:26.657002+0000","last_unstale":"2023-12-20T04:23:28.177902+0000","last_undegraded":"2023-12-20T04:23:28.177902+0000","last_fullsized":"2023-12-20T04:23:28.177902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:04.276683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061570+0000","last_change":"2023-12-20T04:23:26.663917+0000","last_active":"2023-12-20T04:23:28.061570+0000","last_peered":"2023-12-20T04:23:28.061570+0000","last_clean":"2023-12-20T04:23:28.061570+0000","last_became_active":"2023-12-20T04:23:26.662376+0000","last_became_peered":"2023-12-20T04:23:26.662376+0000","last_unstale":"2023-12-20T04:23:28.061570+0000","last_undegraded":"2023-12-20T04:23:28.061570+0000","last_fullsized":"2023-12-20T04:23:28.061570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:50.192488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648277+0000","last_change":"2023-12-20T04:23:26.663614+0000","last_active":"2023-12-20T04:23:27.648277+0000","last_peered":"2023-12-20T04:23:27.648277+0000","last_clean":"2023-12-20T04:23:27.648277+0000","last_became_active":"2023-12-20T04:23:26.663349+0000","last_became_peered":"2023-12-20T04:23:26.663349+0000","last_unstale":"2023-12-20T04:23:27.648277+0000","last_undegraded":"2023-12-20T04:23:27.648277+0000","last_fullsized":"2023-12-20T04:23:27.648277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692303+0000","last_change":"2023-12-20T04:23:26.662123+0000","last_active":"2023-12-20T04:23:28.692303+0000","last_peered":"2023-12-20T04:23:28.692303+0000","last_clean":"2023-12-20T04:23:28.692303+0000","last_became_active":"2023-12-20T04:23:26.661842+0000","last_became_peered":"2023-12-20T04:23:26.661842+0000","last_unstale":"2023-12-20T04:23:28.692303+0000","last_undegraded":"2023-12-20T04:23:28.692303+0000","last_fullsized":"2023-12-20T04:23:28.692303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692896+0000","last_change":"2023-12-20T04:23:26.672102+0000","last_active":"2023-12-20T04:23:28.692896+0000","last_peered":"2023-12-20T04:23:28.692896+0000","last_clean":"2023-12-20T04:23:28.692896+0000","last_became_active":"2023-12-20T04:23:26.671824+0000","last_became_peered":"2023-12-20T04:23:26.671824+0000","last_unstale":"2023-12-20T04:23:28.692896+0000","last_undegraded":"2023-12-20T04:23:28.692896+0000","last_fullsized":"2023-12-20T04:23:28.692896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:11.658501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579664+0000","last_change":"2023-12-20T04:23:26.665844+0000","last_active":"2023-12-20T04:23:28.579664+0000","last_peered":"2023-12-20T04:23:28.579664+0000","last_clean":"2023-12-20T04:23:28.579664+0000","last_became_active":"2023-12-20T04:23:26.664538+0000","last_became_peered":"2023-12-20T04:23:26.664538+0000","last_unstale":"2023-12-20T04:23:28.579664+0000","last_undegraded":"2023-12-20T04:23:28.579664+0000","last_fullsized":"2023-12-20T04:23:28.579664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692840+0000","last_change":"2023-12-20T04:23:26.667407+0000","last_active":"2023-12-20T04:23:28.692840+0000","last_peered":"2023-12-20T04:23:28.692840+0000","last_clean":"2023-12-20T04:23:28.692840+0000","last_became_active":"2023-12-20T04:23:26.667140+0000","last_became_peered":"2023-12-20T04:23:26.667140+0000","last_unstale":"2023-12-20T04:23:28.692840+0000","last_undegraded":"2023-12-20T04:23:28.692840+0000","last_fullsized":"2023-12-20T04:23:28.692840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:18:25.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579721+0000","last_change":"2023-12-20T04:23:26.663904+0000","last_active":"2023-12-20T04:23:28.579721+0000","last_peered":"2023-12-20T04:23:28.579721+0000","last_clean":"2023-12-20T04:23:28.579721+0000","last_became_active":"2023-12-20T04:23:26.663613+0000","last_became_peered":"2023-12-20T04:23:26.663613+0000","last_unstale":"2023-12-20T04:23:28.579721+0000","last_undegraded":"2023-12-20T04:23:28.579721+0000","last_fullsized":"2023-12-20T04:23:28.579721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648900+0000","last_change":"2023-12-20T04:23:26.662650+0000","last_active":"2023-12-20T04:23:27.648900+0000","last_peered":"2023-12-20T04:23:27.648900+0000","last_clean":"2023-12-20T04:23:27.648900+0000","last_became_active":"2023-12-20T04:23:26.662377+0000","last_became_peered":"2023-12-20T04:23:26.662377+0000","last_unstale":"2023-12-20T04:23:27.648900+0000","last_undegraded":"2023-12-20T04:23:27.648900+0000","last_fullsized":"2023-12-20T04:23:27.648900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646456+0000","last_change":"2023-12-20T04:23:26.666772+0000","last_active":"2023-12-20T04:23:27.646456+0000","last_peered":"2023-12-20T04:23:27.646456+0000","last_clean":"2023-12-20T04:23:27.646456+0000","last_became_active":"2023-12-20T04:23:26.666531+0000","last_became_peered":"2023-12-20T04:23:26.666531+0000","last_unstale":"2023-12-20T04:23:27.646456+0000","last_undegraded":"2023-12-20T04:23:27.646456+0000","last_fullsized":"2023-12-20T04:23:27.646456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579870+0000","last_change":"2023-12-20T04:23:26.663285+0000","last_active":"2023-12-20T04:23:28.579870+0000","last_peered":"2023-12-20T04:23:28.579870+0000","last_clean":"2023-12-20T04:23:28.579870+0000","last_became_active":"2023-12-20T04:23:26.662878+0000","last_became_peered":"2023-12-20T04:23:26.662878+0000","last_unstale":"2023-12-20T04:23:28.579870+0000","last_undegraded":"2023-12-20T04:23:28.579870+0000","last_fullsized":"2023-12-20T04:23:28.579870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692402+0000","last_change":"2023-12-20T04:23:26.658130+0000","last_active":"2023-12-20T04:23:28.692402+0000","last_peered":"2023-12-20T04:23:28.692402+0000","last_clean":"2023-12-20T04:23:28.692402+0000","last_became_active":"2023-12-20T04:23:26.657806+0000","last_became_peered":"2023-12-20T04:23:26.657806+0000","last_unstale":"2023-12-20T04:23:28.692402+0000","last_undegraded":"2023-12-20T04:23:28.692402+0000","last_fullsized":"2023-12-20T04:23:28.692402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692986+0000","last_change":"2023-12-20T04:23:26.667214+0000","last_active":"2023-12-20T04:23:28.692986+0000","last_peered":"2023-12-20T04:23:28.692986+0000","last_clean":"2023-12-20T04:23:28.692986+0000","last_became_active":"2023-12-20T04:23:26.666941+0000","last_became_peered":"2023-12-20T04:23:26.666941+0000","last_unstale":"2023-12-20T04:23:28.692986+0000","last_undegraded":"2023-12-20T04:23:28.692986+0000","last_fullsized":"2023-12-20T04:23:28.692986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177740+0000","last_change":"2023-12-20T04:23:26.661015+0000","last_active":"2023-12-20T04:23:28.177740+0000","last_peered":"2023-12-20T04:23:28.177740+0000","last_clean":"2023-12-20T04:23:28.177740+0000","last_became_active":"2023-12-20T04:23:26.660710+0000","last_became_peered":"2023-12-20T04:23:26.660710+0000","last_unstale":"2023-12-20T04:23:28.177740+0000","last_undegraded":"2023-12-20T04:23:28.177740+0000","last_fullsized":"2023-12-20T04:23:28.177740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:14.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648277+0000","last_change":"2023-12-20T04:23:26.661715+0000","last_active":"2023-12-20T04:23:27.648277+0000","last_peered":"2023-12-20T04:23:27.648277+0000","last_clean":"2023-12-20T04:23:27.648277+0000","last_became_active":"2023-12-20T04:23:26.660262+0000","last_became_peered":"2023-12-20T04:23:26.660262+0000","last_unstale":"2023-12-20T04:23:27.648277+0000","last_undegraded":"2023-12-20T04:23:27.648277+0000","last_fullsized":"2023-12-20T04:23:27.648277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648886+0000","last_change":"2023-12-20T04:23:26.666784+0000","last_active":"2023-12-20T04:23:27.648886+0000","last_peered":"2023-12-20T04:23:27.648886+0000","last_clean":"2023-12-20T04:23:27.648886+0000","last_became_active":"2023-12-20T04:23:26.666421+0000","last_became_peered":"2023-12-20T04:23:26.666421+0000","last_unstale":"2023-12-20T04:23:27.648886+0000","last_undegraded":"2023-12-20T04:23:27.648886+0000","last_fullsized":"2023-12-20T04:23:27.648886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:20.915118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579911+0000","last_change":"2023-12-20T04:23:26.282457+0000","last_active":"2023-12-20T04:23:28.579911+0000","last_peered":"2023-12-20T04:23:28.579911+0000","last_clean":"2023-12-20T04:23:28.579911+0000","last_became_active":"2023-12-20T04:23:26.281316+0000","last_became_peered":"2023-12-20T04:23:26.281316+0000","last_unstale":"2023-12-20T04:23:28.579911+0000","last_undegraded":"2023-12-20T04:23:28.579911+0000","last_fullsized":"2023-12-20T04:23:28.579911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692426+0000","last_change":"2023-12-20T04:23:26.663926+0000","last_active":"2023-12-20T04:23:28.692426+0000","last_peered":"2023-12-20T04:23:28.692426+0000","last_clean":"2023-12-20T04:23:28.692426+0000","last_became_active":"2023-12-20T04:23:26.663675+0000","last_became_peered":"2023-12-20T04:23:26.663675+0000","last_unstale":"2023-12-20T04:23:28.692426+0000","last_undegraded":"2023-12-20T04:23:28.692426+0000","last_fullsized":"2023-12-20T04:23:28.692426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648259+0000","last_change":"2023-12-20T04:23:26.277616+0000","last_active":"2023-12-20T04:23:27.648259+0000","last_peered":"2023-12-20T04:23:27.648259+0000","last_clean":"2023-12-20T04:23:27.648259+0000","last_became_active":"2023-12-20T04:23:26.277349+0000","last_became_peered":"2023-12-20T04:23:26.277349+0000","last_unstale":"2023-12-20T04:23:27.648259+0000","last_undegraded":"2023-12-20T04:23:27.648259+0000","last_fullsized":"2023-12-20T04:23:27.648259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579656+0000","last_change":"2023-12-20T04:23:26.279099+0000","last_active":"2023-12-20T04:23:28.579656+0000","last_peered":"2023-12-20T04:23:28.579656+0000","last_clean":"2023-12-20T04:23:28.579656+0000","last_became_active":"2023-12-20T04:23:26.278619+0000","last_became_peered":"2023-12-20T04:23:26.278619+0000","last_unstale":"2023-12-20T04:23:28.579656+0000","last_undegraded":"2023-12-20T04:23:28.579656+0000","last_fullsized":"2023-12-20T04:23:28.579656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579626+0000","last_change":"2023-12-20T04:23:26.662251+0000","last_active":"2023-12-20T04:23:28.579626+0000","last_peered":"2023-12-20T04:23:28.579626+0000","last_clean":"2023-12-20T04:23:28.579626+0000","last_became_active":"2023-12-20T04:23:26.661973+0000","last_became_peered":"2023-12-20T04:23:26.661973+0000","last_unstale":"2023-12-20T04:23:28.579626+0000","last_undegraded":"2023-12-20T04:23:28.579626+0000","last_fullsized":"2023-12-20T04:23:28.579626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692924+0000","last_change":"2023-12-20T04:23:26.283773+0000","last_active":"2023-12-20T04:23:28.692924+0000","last_peered":"2023-12-20T04:23:28.692924+0000","last_clean":"2023-12-20T04:23:28.692924+0000","last_became_active":"2023-12-20T04:23:26.283502+0000","last_became_peered":"2023-12-20T04:23:26.283502+0000","last_unstale":"2023-12-20T04:23:28.692924+0000","last_undegraded":"2023-12-20T04:23:28.692924+0000","last_fullsized":"2023-12-20T04:23:28.692924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646247+0000","last_change":"2023-12-20T04:23:26.664741+0000","last_active":"2023-12-20T04:23:27.646247+0000","last_peered":"2023-12-20T04:23:27.646247+0000","last_clean":"2023-12-20T04:23:27.646247+0000","last_became_active":"2023-12-20T04:23:26.664295+0000","last_became_peered":"2023-12-20T04:23:26.664295+0000","last_unstale":"2023-12-20T04:23:27.646247+0000","last_undegraded":"2023-12-20T04:23:27.646247+0000","last_fullsized":"2023-12-20T04:23:27.646247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648893+0000","last_change":"2023-12-20T04:23:26.285849+0000","last_active":"2023-12-20T04:23:27.648893+0000","last_peered":"2023-12-20T04:23:27.648893+0000","last_clean":"2023-12-20T04:23:27.648893+0000","last_became_active":"2023-12-20T04:23:26.285531+0000","last_became_peered":"2023-12-20T04:23:26.285531+0000","last_unstale":"2023-12-20T04:23:27.648893+0000","last_undegraded":"2023-12-20T04:23:27.648893+0000","last_fullsized":"2023-12-20T04:23:27.648893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693176+0000","last_change":"2023-12-20T04:23:26.671630+0000","last_active":"2023-12-20T04:23:28.693176+0000","last_peered":"2023-12-20T04:23:28.693176+0000","last_clean":"2023-12-20T04:23:28.693176+0000","last_became_active":"2023-12-20T04:23:26.671345+0000","last_became_peered":"2023-12-20T04:23:26.671345+0000","last_unstale":"2023-12-20T04:23:28.693176+0000","last_undegraded":"2023-12-20T04:23:28.693176+0000","last_fullsized":"2023-12-20T04:23:28.693176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:15.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693213+0000","last_change":"2023-12-20T04:23:26.284968+0000","last_active":"2023-12-20T04:23:28.693213+0000","last_peered":"2023-12-20T04:23:28.693213+0000","last_clean":"2023-12-20T04:23:28.693213+0000","last_became_active":"2023-12-20T04:23:26.283961+0000","last_became_peered":"2023-12-20T04:23:26.283961+0000","last_unstale":"2023-12-20T04:23:28.693213+0000","last_undegraded":"2023-12-20T04:23:28.693213+0000","last_fullsized":"2023-12-20T04:23:28.693213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692449+0000","last_change":"2023-12-20T04:23:26.668101+0000","last_active":"2023-12-20T04:23:28.692449+0000","last_peered":"2023-12-20T04:23:28.692449+0000","last_clean":"2023-12-20T04:23:28.692449+0000","last_became_active":"2023-12-20T04:23:26.667868+0000","last_became_peered":"2023-12-20T04:23:26.667868+0000","last_unstale":"2023-12-20T04:23:28.692449+0000","last_undegraded":"2023-12-20T04:23:28.692449+0000","last_fullsized":"2023-12-20T04:23:28.692449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:51:34.130960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646469+0000","last_change":"2023-12-20T04:23:26.285125+0000","last_active":"2023-12-20T04:23:27.646469+0000","last_peered":"2023-12-20T04:23:27.646469+0000","last_clean":"2023-12-20T04:23:27.646469+0000","last_became_active":"2023-12-20T04:23:26.284858+0000","last_became_peered":"2023-12-20T04:23:26.284858+0000","last_unstale":"2023-12-20T04:23:27.646469+0000","last_undegraded":"2023-12-20T04:23:27.646469+0000","last_fullsized":"2023-12-20T04:23:27.646469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:13.196722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648778+0000","last_change":"2023-12-20T04:23:26.662730+0000","last_active":"2023-12-20T04:23:27.648778+0000","last_peered":"2023-12-20T04:23:27.648778+0000","last_clean":"2023-12-20T04:23:27.648778+0000","last_became_active":"2023-12-20T04:23:26.662433+0000","last_became_peered":"2023-12-20T04:23:26.662433+0000","last_unstale":"2023-12-20T04:23:27.648778+0000","last_undegraded":"2023-12-20T04:23:27.648778+0000","last_fullsized":"2023-12-20T04:23:27.648778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:04.276683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648317+0000","last_change":"2023-12-20T04:23:26.281774+0000","last_active":"2023-12-20T04:23:27.648317+0000","last_peered":"2023-12-20T04:23:27.648317+0000","last_clean":"2023-12-20T04:23:27.648317+0000","last_became_active":"2023-12-20T04:23:26.281481+0000","last_became_peered":"2023-12-20T04:23:26.281481+0000","last_unstale":"2023-12-20T04:23:27.648317+0000","last_undegraded":"2023-12-20T04:23:27.648317+0000","last_fullsized":"2023-12-20T04:23:27.648317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061436+0000","last_change":"2023-12-20T04:23:26.658159+0000","last_active":"2023-12-20T04:23:28.061436+0000","last_peered":"2023-12-20T04:23:28.061436+0000","last_clean":"2023-12-20T04:23:28.061436+0000","last_became_active":"2023-12-20T04:23:26.657870+0000","last_became_peered":"2023-12-20T04:23:26.657870+0000","last_unstale":"2023-12-20T04:23:28.061436+0000","last_undegraded":"2023-12-20T04:23:28.061436+0000","last_fullsized":"2023-12-20T04:23:28.061436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:25.045988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692465+0000","last_change":"2023-12-20T04:23:26.286048+0000","last_active":"2023-12-20T04:23:28.692465+0000","last_peered":"2023-12-20T04:23:28.692465+0000","last_clean":"2023-12-20T04:23:28.692465+0000","last_became_active":"2023-12-20T04:23:26.285776+0000","last_became_peered":"2023-12-20T04:23:26.285776+0000","last_unstale":"2023-12-20T04:23:28.692465+0000","last_undegraded":"2023-12-20T04:23:28.692465+0000","last_fullsized":"2023-12-20T04:23:28.692465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692226+0000","last_change":"2023-12-20T04:23:26.658401+0000","last_active":"2023-12-20T04:23:28.692226+0000","last_peered":"2023-12-20T04:23:28.692226+0000","last_clean":"2023-12-20T04:23:28.692226+0000","last_became_active":"2023-12-20T04:23:26.658117+0000","last_became_peered":"2023-12-20T04:23:26.658117+0000","last_unstale":"2023-12-20T04:23:28.692226+0000","last_undegraded":"2023-12-20T04:23:28.692226+0000","last_fullsized":"2023-12-20T04:23:28.692226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693041+0000","last_change":"2023-12-20T04:23:26.288724+0000","last_active":"2023-12-20T04:23:28.693041+0000","last_peered":"2023-12-20T04:23:28.693041+0000","last_clean":"2023-12-20T04:23:28.693041+0000","last_became_active":"2023-12-20T04:23:26.288544+0000","last_became_peered":"2023-12-20T04:23:26.288544+0000","last_unstale":"2023-12-20T04:23:28.693041+0000","last_undegraded":"2023-12-20T04:23:28.693041+0000","last_fullsized":"2023-12-20T04:23:28.693041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061274+0000","last_change":"2023-12-20T04:23:26.664506+0000","last_active":"2023-12-20T04:23:28.061274+0000","last_peered":"2023-12-20T04:23:28.061274+0000","last_clean":"2023-12-20T04:23:28.061274+0000","last_became_active":"2023-12-20T04:23:26.664257+0000","last_became_peered":"2023-12-20T04:23:26.664257+0000","last_unstale":"2023-12-20T04:23:28.061274+0000","last_undegraded":"2023-12-20T04:23:28.061274+0000","last_fullsized":"2023-12-20T04:23:28.061274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:26.732551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648216+0000","last_change":"2023-12-20T04:23:26.278212+0000","last_active":"2023-12-20T04:23:27.648216+0000","last_peered":"2023-12-20T04:23:27.648216+0000","last_clean":"2023-12-20T04:23:27.648216+0000","last_became_active":"2023-12-20T04:23:26.277934+0000","last_became_peered":"2023-12-20T04:23:26.277934+0000","last_unstale":"2023-12-20T04:23:27.648216+0000","last_undegraded":"2023-12-20T04:23:27.648216+0000","last_fullsized":"2023-12-20T04:23:27.648216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648152+0000","last_change":"2023-12-20T04:23:26.661558+0000","last_active":"2023-12-20T04:23:27.648152+0000","last_peered":"2023-12-20T04:23:27.648152+0000","last_clean":"2023-12-20T04:23:27.648152+0000","last_became_active":"2023-12-20T04:23:26.659798+0000","last_became_peered":"2023-12-20T04:23:26.659798+0000","last_unstale":"2023-12-20T04:23:27.648152+0000","last_undegraded":"2023-12-20T04:23:27.648152+0000","last_fullsized":"2023-12-20T04:23:27.648152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177704+0000","last_change":"2023-12-20T04:23:26.284487+0000","last_active":"2023-12-20T04:23:28.177704+0000","last_peered":"2023-12-20T04:23:28.177704+0000","last_clean":"2023-12-20T04:23:28.177704+0000","last_became_active":"2023-12-20T04:23:26.283900+0000","last_became_peered":"2023-12-20T04:23:26.283900+0000","last_unstale":"2023-12-20T04:23:28.177704+0000","last_undegraded":"2023-12-20T04:23:28.177704+0000","last_fullsized":"2023-12-20T04:23:28.177704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:43:35.956319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061185+0000","last_change":"2023-12-20T04:23:26.665136+0000","last_active":"2023-12-20T04:23:28.061185+0000","last_peered":"2023-12-20T04:23:28.061185+0000","last_clean":"2023-12-20T04:23:28.061185+0000","last_became_active":"2023-12-20T04:23:26.664875+0000","last_became_peered":"2023-12-20T04:23:26.664875+0000","last_unstale":"2023-12-20T04:23:28.061185+0000","last_undegraded":"2023-12-20T04:23:28.061185+0000","last_fullsized":"2023-12-20T04:23:28.061185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:15.926740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648681+0000","last_change":"2023-12-20T04:23:26.284637+0000","last_active":"2023-12-20T04:23:27.648681+0000","last_peered":"2023-12-20T04:23:27.648681+0000","last_clean":"2023-12-20T04:23:27.648681+0000","last_became_active":"2023-12-20T04:23:26.284372+0000","last_became_peered":"2023-12-20T04:23:26.284372+0000","last_unstale":"2023-12-20T04:23:27.648681+0000","last_undegraded":"2023-12-20T04:23:27.648681+0000","last_fullsized":"2023-12-20T04:23:27.648681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:00:36.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061596+0000","last_change":"2023-12-20T04:23:26.663644+0000","last_active":"2023-12-20T04:23:28.061596+0000","last_peered":"2023-12-20T04:23:28.061596+0000","last_clean":"2023-12-20T04:23:28.061596+0000","last_became_active":"2023-12-20T04:23:26.663233+0000","last_became_peered":"2023-12-20T04:23:26.663233+0000","last_unstale":"2023-12-20T04:23:28.061596+0000","last_undegraded":"2023-12-20T04:23:28.061596+0000","last_fullsized":"2023-12-20T04:23:28.061596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:56.502420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177928+0000","last_change":"2023-12-20T04:23:26.292362+0000","last_active":"2023-12-20T04:23:28.177928+0000","last_peered":"2023-12-20T04:23:28.177928+0000","last_clean":"2023-12-20T04:23:28.177928+0000","last_became_active":"2023-12-20T04:23:26.291998+0000","last_became_peered":"2023-12-20T04:23:26.291998+0000","last_unstale":"2023-12-20T04:23:28.177928+0000","last_undegraded":"2023-12-20T04:23:28.177928+0000","last_fullsized":"2023-12-20T04:23:28.177928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061688+0000","last_change":"2023-12-20T04:23:26.663859+0000","last_active":"2023-12-20T04:23:28.061688+0000","last_peered":"2023-12-20T04:23:28.061688+0000","last_clean":"2023-12-20T04:23:28.061688+0000","last_became_active":"2023-12-20T04:23:26.663615+0000","last_became_peered":"2023-12-20T04:23:26.663615+0000","last_unstale":"2023-12-20T04:23:28.061688+0000","last_undegraded":"2023-12-20T04:23:28.061688+0000","last_fullsized":"2023-12-20T04:23:28.061688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646520+0000","last_change":"2023-12-20T04:23:26.278555+0000","last_active":"2023-12-20T04:23:27.646520+0000","last_peered":"2023-12-20T04:23:27.646520+0000","last_clean":"2023-12-20T04:23:27.646520+0000","last_became_active":"2023-12-20T04:23:26.278297+0000","last_became_peered":"2023-12-20T04:23:26.278297+0000","last_unstale":"2023-12-20T04:23:27.646520+0000","last_undegraded":"2023-12-20T04:23:27.646520+0000","last_fullsized":"2023-12-20T04:23:27.646520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693278+0000","last_change":"2023-12-20T04:23:26.673127+0000","last_active":"2023-12-20T04:23:28.693278+0000","last_peered":"2023-12-20T04:23:28.693278+0000","last_clean":"2023-12-20T04:23:28.693278+0000","last_became_active":"2023-12-20T04:23:26.672852+0000","last_became_peered":"2023-12-20T04:23:26.672852+0000","last_unstale":"2023-12-20T04:23:28.693278+0000","last_undegraded":"2023-12-20T04:23:28.693278+0000","last_fullsized":"2023-12-20T04:23:28.693278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:47.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177875+0000","last_change":"2023-12-20T04:23:26.284610+0000","last_active":"2023-12-20T04:23:28.177875+0000","last_peered":"2023-12-20T04:23:28.177875+0000","last_clean":"2023-12-20T04:23:28.177875+0000","last_became_active":"2023-12-20T04:23:26.284222+0000","last_became_peered":"2023-12-20T04:23:26.284222+0000","last_unstale":"2023-12-20T04:23:28.177875+0000","last_undegraded":"2023-12-20T04:23:28.177875+0000","last_fullsized":"2023-12-20T04:23:28.177875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061438+0000","last_change":"2023-12-20T04:23:26.667851+0000","last_active":"2023-12-20T04:23:28.061438+0000","last_peered":"2023-12-20T04:23:28.061438+0000","last_clean":"2023-12-20T04:23:28.061438+0000","last_became_active":"2023-12-20T04:23:26.667603+0000","last_became_peered":"2023-12-20T04:23:26.667603+0000","last_unstale":"2023-12-20T04:23:28.061438+0000","last_undegraded":"2023-12-20T04:23:28.061438+0000","last_fullsized":"2023-12-20T04:23:28.061438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:00.052684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:23:26.652599+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:23:26.652599+0000","last_peered":"2023-12-20T04:23:26.652599+0000","last_clean":"2023-12-20T04:23:26.652599+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:23:26.652599+0000","last_undegraded":"2023-12-20T04:23:26.652599+0000","last_fullsized":"2023-12-20T04:23:26.652599+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692947+0000","last_change":"2023-12-20T04:23:26.284499+0000","last_active":"2023-12-20T04:23:28.692947+0000","last_peered":"2023-12-20T04:23:28.692947+0000","last_clean":"2023-12-20T04:23:28.692947+0000","last_became_active":"2023-12-20T04:23:26.284235+0000","last_became_peered":"2023-12-20T04:23:26.284235+0000","last_unstale":"2023-12-20T04:23:28.692947+0000","last_undegraded":"2023-12-20T04:23:28.692947+0000","last_fullsized":"2023-12-20T04:23:28.692947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579786+0000","last_change":"2023-12-20T04:23:26.673891+0000","last_active":"2023-12-20T04:23:28.579786+0000","last_peered":"2023-12-20T04:23:28.579786+0000","last_clean":"2023-12-20T04:23:28.579786+0000","last_became_active":"2023-12-20T04:23:26.673596+0000","last_became_peered":"2023-12-20T04:23:26.673596+0000","last_unstale":"2023-12-20T04:23:28.579786+0000","last_undegraded":"2023-12-20T04:23:28.579786+0000","last_fullsized":"2023-12-20T04:23:28.579786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:46:50.507388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061040+0000","last_change":"2023-12-20T04:23:26.285507+0000","last_active":"2023-12-20T04:23:28.061040+0000","last_peered":"2023-12-20T04:23:28.061040+0000","last_clean":"2023-12-20T04:23:28.061040+0000","last_became_active":"2023-12-20T04:23:26.285258+0000","last_became_peered":"2023-12-20T04:23:26.285258+0000","last_unstale":"2023-12-20T04:23:28.061040+0000","last_undegraded":"2023-12-20T04:23:28.061040+0000","last_fullsized":"2023-12-20T04:23:28.061040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692149+0000","last_change":"2023-12-20T04:23:26.664608+0000","last_active":"2023-12-20T04:23:28.692149+0000","last_peered":"2023-12-20T04:23:28.692149+0000","last_clean":"2023-12-20T04:23:28.692149+0000","last_became_active":"2023-12-20T04:23:26.664342+0000","last_became_peered":"2023-12-20T04:23:26.664342+0000","last_unstale":"2023-12-20T04:23:28.692149+0000","last_undegraded":"2023-12-20T04:23:28.692149+0000","last_fullsized":"2023-12-20T04:23:28.692149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:19.585364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.177946+0000","last_change":"2023-12-20T04:23:26.292355+0000","last_active":"2023-12-20T04:23:28.177946+0000","last_peered":"2023-12-20T04:23:28.177946+0000","last_clean":"2023-12-20T04:23:28.177946+0000","last_became_active":"2023-12-20T04:23:26.292011+0000","last_became_peered":"2023-12-20T04:23:26.292011+0000","last_unstale":"2023-12-20T04:23:28.177946+0000","last_undegraded":"2023-12-20T04:23:28.177946+0000","last_fullsized":"2023-12-20T04:23:28.177946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:50.405523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646297+0000","last_change":"2023-12-20T04:23:26.664413+0000","last_active":"2023-12-20T04:23:27.646297+0000","last_peered":"2023-12-20T04:23:27.646297+0000","last_clean":"2023-12-20T04:23:27.646297+0000","last_became_active":"2023-12-20T04:23:26.664071+0000","last_became_peered":"2023-12-20T04:23:26.664071+0000","last_unstale":"2023-12-20T04:23:27.646297+0000","last_undegraded":"2023-12-20T04:23:27.646297+0000","last_fullsized":"2023-12-20T04:23:27.646297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693216+0000","last_change":"2023-12-20T04:23:26.284859+0000","last_active":"2023-12-20T04:23:28.693216+0000","last_peered":"2023-12-20T04:23:28.693216+0000","last_clean":"2023-12-20T04:23:28.693216+0000","last_became_active":"2023-12-20T04:23:26.284584+0000","last_became_peered":"2023-12-20T04:23:26.284584+0000","last_unstale":"2023-12-20T04:23:28.693216+0000","last_undegraded":"2023-12-20T04:23:28.693216+0000","last_fullsized":"2023-12-20T04:23:28.693216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648580+0000","last_change":"2023-12-20T04:23:26.660582+0000","last_active":"2023-12-20T04:23:27.648580+0000","last_peered":"2023-12-20T04:23:27.648580+0000","last_clean":"2023-12-20T04:23:27.648580+0000","last_became_active":"2023-12-20T04:23:26.660268+0000","last_became_peered":"2023-12-20T04:23:26.660268+0000","last_unstale":"2023-12-20T04:23:27.648580+0000","last_undegraded":"2023-12-20T04:23:27.648580+0000","last_fullsized":"2023-12-20T04:23:27.648580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:14.759440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646423+0000","last_change":"2023-12-20T04:23:26.284941+0000","last_active":"2023-12-20T04:23:27.646423+0000","last_peered":"2023-12-20T04:23:27.646423+0000","last_clean":"2023-12-20T04:23:27.646423+0000","last_became_active":"2023-12-20T04:23:26.284623+0000","last_became_peered":"2023-12-20T04:23:26.284623+0000","last_unstale":"2023-12-20T04:23:27.646423+0000","last_undegraded":"2023-12-20T04:23:27.646423+0000","last_fullsized":"2023-12-20T04:23:27.646423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693278+0000","last_change":"2023-12-20T04:23:26.672358+0000","last_active":"2023-12-20T04:23:28.693278+0000","last_peered":"2023-12-20T04:23:28.693278+0000","last_clean":"2023-12-20T04:23:28.693278+0000","last_became_active":"2023-12-20T04:23:26.672111+0000","last_became_peered":"2023-12-20T04:23:26.672111+0000","last_unstale":"2023-12-20T04:23:28.693278+0000","last_undegraded":"2023-12-20T04:23:28.693278+0000","last_fullsized":"2023-12-20T04:23:28.693278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061655+0000","last_change":"2023-12-20T04:23:26.292027+0000","last_active":"2023-12-20T04:23:28.061655+0000","last_peered":"2023-12-20T04:23:28.061655+0000","last_clean":"2023-12-20T04:23:28.061655+0000","last_became_active":"2023-12-20T04:23:26.291668+0000","last_became_peered":"2023-12-20T04:23:26.291668+0000","last_unstale":"2023-12-20T04:23:28.061655+0000","last_undegraded":"2023-12-20T04:23:28.061655+0000","last_fullsized":"2023-12-20T04:23:28.061655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:13.754694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646427+0000","last_change":"2023-12-20T04:23:26.665693+0000","last_active":"2023-12-20T04:23:27.646427+0000","last_peered":"2023-12-20T04:23:27.646427+0000","last_clean":"2023-12-20T04:23:27.646427+0000","last_became_active":"2023-12-20T04:23:26.665421+0000","last_became_peered":"2023-12-20T04:23:26.665421+0000","last_unstale":"2023-12-20T04:23:27.646427+0000","last_undegraded":"2023-12-20T04:23:27.646427+0000","last_fullsized":"2023-12-20T04:23:27.646427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:32:05.004046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:29.545264+0000","last_change":"2023-12-20T04:23:26.280830+0000","last_active":"2023-12-20T04:23:29.545264+0000","last_peered":"2023-12-20T04:23:29.545264+0000","last_clean":"2023-12-20T04:23:29.545264+0000","last_became_active":"2023-12-20T04:23:26.280522+0000","last_became_peered":"2023-12-20T04:23:26.280522+0000","last_unstale":"2023-12-20T04:23:29.545264+0000","last_undegraded":"2023-12-20T04:23:29.545264+0000","last_fullsized":"2023-12-20T04:23:29.545264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:03.271936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579867+0000","last_change":"2023-12-20T04:23:26.669071+0000","last_active":"2023-12-20T04:23:28.579867+0000","last_peered":"2023-12-20T04:23:28.579867+0000","last_clean":"2023-12-20T04:23:28.579867+0000","last_became_active":"2023-12-20T04:23:26.668801+0000","last_became_peered":"2023-12-20T04:23:26.668801+0000","last_unstale":"2023-12-20T04:23:28.579867+0000","last_undegraded":"2023-12-20T04:23:28.579867+0000","last_fullsized":"2023-12-20T04:23:28.579867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648978+0000","last_change":"2023-12-20T04:23:26.282356+0000","last_active":"2023-12-20T04:23:27.648978+0000","last_peered":"2023-12-20T04:23:27.648978+0000","last_clean":"2023-12-20T04:23:27.648978+0000","last_became_active":"2023-12-20T04:23:26.282046+0000","last_became_peered":"2023-12-20T04:23:26.282046+0000","last_unstale":"2023-12-20T04:23:27.648978+0000","last_undegraded":"2023-12-20T04:23:27.648978+0000","last_fullsized":"2023-12-20T04:23:27.648978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692373+0000","last_change":"2023-12-20T04:23:26.666869+0000","last_active":"2023-12-20T04:23:28.692373+0000","last_peered":"2023-12-20T04:23:28.692373+0000","last_clean":"2023-12-20T04:23:28.692373+0000","last_became_active":"2023-12-20T04:23:26.666606+0000","last_became_peered":"2023-12-20T04:23:26.666606+0000","last_unstale":"2023-12-20T04:23:28.692373+0000","last_undegraded":"2023-12-20T04:23:28.692373+0000","last_fullsized":"2023-12-20T04:23:28.692373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:23:26.353312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061005+0000","last_change":"2023-12-20T04:23:26.291924+0000","last_active":"2023-12-20T04:23:28.061005+0000","last_peered":"2023-12-20T04:23:28.061005+0000","last_clean":"2023-12-20T04:23:28.061005+0000","last_became_active":"2023-12-20T04:23:26.291445+0000","last_became_peered":"2023-12-20T04:23:26.291445+0000","last_unstale":"2023-12-20T04:23:28.061005+0000","last_undegraded":"2023-12-20T04:23:28.061005+0000","last_fullsized":"2023-12-20T04:23:28.061005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:13.196722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648824+0000","last_change":"2023-12-20T04:23:26.661472+0000","last_active":"2023-12-20T04:23:27.648824+0000","last_peered":"2023-12-20T04:23:27.648824+0000","last_clean":"2023-12-20T04:23:27.648824+0000","last_became_active":"2023-12-20T04:23:26.661072+0000","last_became_peered":"2023-12-20T04:23:26.661072+0000","last_unstale":"2023-12-20T04:23:27.648824+0000","last_undegraded":"2023-12-20T04:23:27.648824+0000","last_fullsized":"2023-12-20T04:23:27.648824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:03:14.201469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646334+0000","last_change":"2023-12-20T04:23:26.286742+0000","last_active":"2023-12-20T04:23:27.646334+0000","last_peered":"2023-12-20T04:23:27.646334+0000","last_clean":"2023-12-20T04:23:27.646334+0000","last_became_active":"2023-12-20T04:23:26.286439+0000","last_became_peered":"2023-12-20T04:23:26.286439+0000","last_unstale":"2023-12-20T04:23:27.646334+0000","last_undegraded":"2023-12-20T04:23:27.646334+0000","last_fullsized":"2023-12-20T04:23:27.646334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:47:26.371237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579841+0000","last_change":"2023-12-20T04:23:26.665515+0000","last_active":"2023-12-20T04:23:28.579841+0000","last_peered":"2023-12-20T04:23:28.579841+0000","last_clean":"2023-12-20T04:23:28.579841+0000","last_became_active":"2023-12-20T04:23:26.664947+0000","last_became_peered":"2023-12-20T04:23:26.664947+0000","last_unstale":"2023-12-20T04:23:28.579841+0000","last_undegraded":"2023-12-20T04:23:28.579841+0000","last_fullsized":"2023-12-20T04:23:28.579841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:18:25.914489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.646417+0000","last_change":"2023-12-20T04:23:26.280703+0000","last_active":"2023-12-20T04:23:27.646417+0000","last_peered":"2023-12-20T04:23:27.646417+0000","last_clean":"2023-12-20T04:23:27.646417+0000","last_became_active":"2023-12-20T04:23:26.280429+0000","last_became_peered":"2023-12-20T04:23:26.280429+0000","last_unstale":"2023-12-20T04:23:27.646417+0000","last_undegraded":"2023-12-20T04:23:27.646417+0000","last_fullsized":"2023-12-20T04:23:27.646417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:13.641722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579858+0000","last_change":"2023-12-20T04:23:26.664971+0000","last_active":"2023-12-20T04:23:28.579858+0000","last_peered":"2023-12-20T04:23:28.579858+0000","last_clean":"2023-12-20T04:23:28.579858+0000","last_became_active":"2023-12-20T04:23:26.664247+0000","last_became_peered":"2023-12-20T04:23:26.664247+0000","last_unstale":"2023-12-20T04:23:28.579858+0000","last_undegraded":"2023-12-20T04:23:28.579858+0000","last_fullsized":"2023-12-20T04:23:28.579858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:35.565268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061365+0000","last_change":"2023-12-20T04:23:26.292375+0000","last_active":"2023-12-20T04:23:28.061365+0000","last_peered":"2023-12-20T04:23:28.061365+0000","last_clean":"2023-12-20T04:23:28.061365+0000","last_became_active":"2023-12-20T04:23:26.292034+0000","last_became_peered":"2023-12-20T04:23:26.292034+0000","last_unstale":"2023-12-20T04:23:28.061365+0000","last_undegraded":"2023-12-20T04:23:28.061365+0000","last_fullsized":"2023-12-20T04:23:28.061365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:25:49.440661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:27.648275+0000","last_change":"2023-12-20T04:23:26.663174+0000","last_active":"2023-12-20T04:23:27.648275+0000","last_peered":"2023-12-20T04:23:27.648275+0000","last_clean":"2023-12-20T04:23:27.648275+0000","last_became_active":"2023-12-20T04:23:26.662709+0000","last_became_peered":"2023-12-20T04:23:26.662709+0000","last_unstale":"2023-12-20T04:23:27.648275+0000","last_undegraded":"2023-12-20T04:23:27.648275+0000","last_fullsized":"2023-12-20T04:23:27.648275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:52:17.847247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693257+0000","last_change":"2023-12-20T04:23:26.667112+0000","last_active":"2023-12-20T04:23:28.693257+0000","last_peered":"2023-12-20T04:23:28.693257+0000","last_clean":"2023-12-20T04:23:28.693257+0000","last_became_active":"2023-12-20T04:23:26.666537+0000","last_became_peered":"2023-12-20T04:23:26.666537+0000","last_unstale":"2023-12-20T04:23:28.693257+0000","last_undegraded":"2023-12-20T04:23:28.693257+0000","last_fullsized":"2023-12-20T04:23:28.693257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:49.906403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061363+0000","last_change":"2023-12-20T04:23:26.287011+0000","last_active":"2023-12-20T04:23:28.061363+0000","last_peered":"2023-12-20T04:23:28.061363+0000","last_clean":"2023-12-20T04:23:28.061363+0000","last_became_active":"2023-12-20T04:23:26.286702+0000","last_became_peered":"2023-12-20T04:23:26.286702+0000","last_unstale":"2023-12-20T04:23:28.061363+0000","last_undegraded":"2023-12-20T04:23:28.061363+0000","last_fullsized":"2023-12-20T04:23:28.061363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:19.910372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.693236+0000","last_change":"2023-12-20T04:23:26.670705+0000","last_active":"2023-12-20T04:23:28.693236+0000","last_peered":"2023-12-20T04:23:28.693236+0000","last_clean":"2023-12-20T04:23:28.693236+0000","last_became_active":"2023-12-20T04:23:26.670216+0000","last_became_peered":"2023-12-20T04:23:26.670216+0000","last_unstale":"2023-12-20T04:23:28.693236+0000","last_undegraded":"2023-12-20T04:23:28.693236+0000","last_fullsized":"2023-12-20T04:23:28.693236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:18:04.635095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.061565+0000","last_change":"2023-12-20T04:23:26.287007+0000","last_active":"2023-12-20T04:23:28.061565+0000","last_peered":"2023-12-20T04:23:28.061565+0000","last_clean":"2023-12-20T04:23:28.061565+0000","last_became_active":"2023-12-20T04:23:26.286700+0000","last_became_peered":"2023-12-20T04:23:26.286700+0000","last_unstale":"2023-12-20T04:23:28.061565+0000","last_undegraded":"2023-12-20T04:23:28.061565+0000","last_fullsized":"2023-12-20T04:23:28.061565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:16:03.271936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692365+0000","last_change":"2023-12-20T04:23:26.668234+0000","last_active":"2023-12-20T04:23:28.692365+0000","last_peered":"2023-12-20T04:23:28.692365+0000","last_clean":"2023-12-20T04:23:28.692365+0000","last_became_active":"2023-12-20T04:23:26.667991+0000","last_became_peered":"2023-12-20T04:23:26.667991+0000","last_unstale":"2023-12-20T04:23:28.692365+0000","last_undegraded":"2023-12-20T04:23:28.692365+0000","last_fullsized":"2023-12-20T04:23:28.692365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:24:56.720868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579915+0000","last_change":"2023-12-20T04:23:26.284158+0000","last_active":"2023-12-20T04:23:28.579915+0000","last_peered":"2023-12-20T04:23:28.579915+0000","last_clean":"2023-12-20T04:23:28.579915+0000","last_became_active":"2023-12-20T04:23:26.283866+0000","last_became_peered":"2023-12-20T04:23:26.283866+0000","last_unstale":"2023-12-20T04:23:28.579915+0000","last_undegraded":"2023-12-20T04:23:28.579915+0000","last_fullsized":"2023-12-20T04:23:28.579915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:49.682103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.579780+0000","last_change":"2023-12-20T04:23:26.669065+0000","last_active":"2023-12-20T04:23:28.579780+0000","last_peered":"2023-12-20T04:23:28.579780+0000","last_clean":"2023-12-20T04:23:28.579780+0000","last_became_active":"2023-12-20T04:23:26.668822+0000","last_became_peered":"2023-12-20T04:23:26.668822+0000","last_unstale":"2023-12-20T04:23:28.579780+0000","last_undegraded":"2023-12-20T04:23:28.579780+0000","last_fullsized":"2023-12-20T04:23:28.579780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:26.263750+0000","last_clean_scrub_stamp":"2023-12-20T04:23:26.263750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:08:30.070545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:23:28.692475+0000","last_change":"2023-12-20T04:23:26.289452+0000","last_active":"2023-12-20T04:23:28.692475+0000","last_peered":"2023-12-20T04:23:28.692475+0000","last_clean":"2023-12-20T04:23:28.692475+0000","last_became_active":"2023-12-20T04:23:26.289223+0000","last_became_peered":"2023-12-20T04:23:26.289223+0000","last_unstale":"2023-12-20T04:23:28.692475+0000","last_undegraded":"2023-12-20T04:23:28.692475+0000","last_fullsized":"2023-12-20T04:23:28.692475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:25.259003+0000","last_clean_scrub_stamp":"2023-12-20T04:23:25.259003+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:25.367497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:23:35.024 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-20T04:23:35.024 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-20T04:23:35.024 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-20T04:23:35.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-20T04:23:35.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.159+0000 7f0697038640 1 Processor -- start 2023-12-20T04:23:35.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.159+0000 7f0697038640 1 -- start start 2023-12-20T04:23:35.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f0697038640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f06900bab80 0x7f069014b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f0697038640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900b6da0 con 0x7f0690144e30 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f0697038640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900b8090 con 0x7f06900b8b40 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f0697038640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069014afe0 con 0x7f06900bab80 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f0694dd4640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0690144e30 0x7f06900b7600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52956/0 (socket says 172.21.15.40:52956) 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f0694dd4640 1 -- 172.21.15.40:0/1454970136 learned_addr learned my addr 172.21.15.40:0/1454970136 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068ffff640 1 --2- 172.21.15.40:0/1454970136 >> v2:172.21.15.69:3300/0 conn(0x7f06900bab80 0x7f069014b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255745812 0 0) 0x7f0680001110 con 0x7f0690144e30 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0678003520 con 0x7f0690144e30 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4119610434 0 0) 0x7f0678003520 con 0x7f0690144e30 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 >> v2:172.21.15.69:3300/0 conn(0x7f06900bab80 msgr2=0x7f069014b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 --2- 172.21.15.40:0/1454970136 >> v2:172.21.15.69:3300/0 conn(0x7f06900bab80 0x7f069014b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 >> v1:172.21.15.69:6789/0 conn(0x7f06900b8b40 legacy=0x7f0690155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0690145210 con 0x7f0690144e30 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f0680001800 con 0x7f0690144e30 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.160+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 >> v1:172.21.15.40:6789/0 conn(0x7f0690144e30 legacy=0x7f06900b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f068f7fe640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f0678003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f068f7fe640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06780047c0 0x7f0678004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f068f7fe640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0678005180 0x7f067800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069014afe0 con 0x7f0678003970 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067800c030 con 0x7f0678005180 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067800c1f0 con 0x7f06780047c0 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f0694dd4640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f0678003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f06955d5640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0678005180 0x7f067800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f068ffff640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06780047c0 0x7f0678004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f0694dd4640 1 -- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06780047c0 msgr2=0x7f0678004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f0694dd4640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06780047c0 0x7f0678004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f0694dd4640 1 -- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0678005180 msgr2=0x7f067800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:35.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f0694dd4640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0678005180 0x7f067800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f06955d5640 1 -- 172.21.15.40:0/1454970136 reap_dead start 2023-12-20T04:23:35.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.161+0000 7f0694dd4640 1 -- 172.21.15.40:0/1454970136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678003520 con 0x7f0678003970 2023-12-20T04:23:35.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f0694dd4640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f0678003d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f068000c190 tx=0x7f06780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bbdb4a9185e5ad server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680005ad0 con 0x7f0678003970 2023-12-20T04:23:35.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0680037070 con 0x7f0678003970 2023-12-20T04:23:35.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f068f7fe640 1 -- 172.21.15.40:0/1454970136 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680007070 con 0x7f0678003970 2023-12-20T04:23:35.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f0697038640 1 -- 172.21.15.40:0/1454970136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 msgr2=0x7f0678003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f0697038640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f0678003d90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f068000c190 tx=0x7f06780057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f0697038640 1 -- 172.21.15.40:0/1454970136 shutdown_connections 2023-12-20T04:23:35.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f0697038640 1 --2- 172.21.15.40:0/1454970136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f0678003d90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f0697038640 1 -- 172.21.15.40:0/1454970136 >> 172.21.15.40:0/1454970136 conn(0x7f06900c0200 msgr2=0x7f06900c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:35.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.162+0000 7f0697038640 1 -- 172.21.15.40:0/1454970136 shutdown_connections 2023-12-20T04:23:35.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.163+0000 7f0697038640 1 -- 172.21.15.40:0/1454970136 wait complete. 2023-12-20T04:23:35.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.163+0000 7f0697038640 1 Processor -- start 2023-12-20T04:23:35.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0697038640 1 -- start start 2023-12-20T04:23:35.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0697038640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f069014a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0697038640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06900bdfe0 0x7f06901dc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0697038640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06900bfbe0 0x7f06900aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0697038640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069014a660 con 0x7f0678003970 2023-12-20T04:23:35.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0697038640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069014c8f0 con 0x7f06900bdfe0 2023-12-20T04:23:35.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0697038640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06901dc550 con 0x7f06900bfbe0 2023-12-20T04:23:35.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0694dd4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f069014a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0694dd4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f069014a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57596/0 (socket says 172.21.15.40:57596) 2023-12-20T04:23:35.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f0694dd4640 1 -- 172.21.15.40:0/278346843 learned_addr learned my addr 172.21.15.40:0/278346843 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:35.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f06955d5640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06900bfbe0 0x7f06900aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.164+0000 7f068ffff640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06900bdfe0 0x7f06901dc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0694dd4640 1 -- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06900bfbe0 msgr2=0x7f06900aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0694dd4640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06900bfbe0 0x7f06900aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0694dd4640 1 -- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06900bdfe0 msgr2=0x7f06901dc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0694dd4640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06900bdfe0 0x7f06901dc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0694dd4640 1 -- 172.21.15.40:0/278346843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900af2d0 con 0x7f0678003970 2023-12-20T04:23:35.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0694dd4640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f069014a120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f068000c1f0 tx=0x7f069014b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f068d7fa640 1 -- 172.21.15.40:0/278346843 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800049e0 con 0x7f0678003970 2023-12-20T04:23:35.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f068d7fa640 1 -- 172.21.15.40:0/278346843 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0680004b40 con 0x7f0678003970 2023-12-20T04:23:35.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f068d7fa640 1 -- 172.21.15.40:0/278346843 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680007070 con 0x7f0678003970 2023-12-20T04:23:35.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06901db810 con 0x7f0678003970 2023-12-20T04:23:35.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.165+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900aeef0 con 0x7f0678003970 2023-12-20T04:23:35.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.166+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06900af510 con 0x7f0678003970 2023-12-20T04:23:35.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.166+0000 7f068d7fa640 1 -- 172.21.15.40:0/278346843 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0680039030 con 0x7f0678003970 2023-12-20T04:23:35.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.167+0000 7f068d7fa640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f067c06a430 0x7f067c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.167+0000 7f068d7fa640 1 -- 172.21.15.40:0/278346843 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06800b1db0 con 0x7f0678003970 2023-12-20T04:23:35.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.167+0000 7f068ffff640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f067c06a430 0x7f067c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.167+0000 7f068ffff640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f067c06a430 0x7f067c06c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06900be3c0 tx=0x7f0684009110 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.171+0000 7f068d7fa640 1 -- 172.21.15.40:0/278346843 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f06900af510 con 0x7f0678003970 2023-12-20T04:23:35.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.384+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f06900b6da0 con 0x7f0678003970 2023-12-20T04:23:35.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.384+0000 7f068d7fa640 1 -- 172.21.15.40:0/278346843 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f06900b6da0 con 0x7f0678003970 2023-12-20T04:23:35.385 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:35.385 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-20T04:23:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f067c06a430 msgr2=0x7f067c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f067c06a430 0x7f067c06c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f06900be3c0 tx=0x7f0684009110 comp rx=0 tx=0).stop 2023-12-20T04:23:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 msgr2=0x7f069014a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f069014a120 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f068000c1f0 tx=0x7f069014b120 comp rx=0 tx=0).stop 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 shutdown_connections 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f067c06a430 0x7f067c06c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06900bfbe0 0x7f06900aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06900bdfe0 0x7f06901dc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 --2- 172.21.15.40:0/278346843 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0678003970 0x7f069014a120 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 >> 172.21.15.40:0/278346843 conn(0x7f06900c0200 msgr2=0x7f06900bbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 shutdown_connections 2023-12-20T04:23:35.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.386+0000 7f0697038640 1 -- 172.21.15.40:0/278346843 wait complete. 2023-12-20T04:23:35.398 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-20T04:23:35.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:35.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.503+0000 7efef4a43640 1 Processor -- start 2023-12-20T04:23:35.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.503+0000 7efef4a43640 1 -- start start 2023-12-20T04:23:35.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efef4a43640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efef0070ff0 0x7efef0142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efef4a43640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0142d90 0x7efef01531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efef4a43640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efef00b56e0 con 0x7efef00b4f90 2023-12-20T04:23:35.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efef4a43640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef00b6d70 con 0x7efef0070ff0 2023-12-20T04:23:35.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efef4a43640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef00b59c0 con 0x7efef0142d90 2023-12-20T04:23:35.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeee59c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efef0070ff0 0x7efef0142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeeed9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0142d90 0x7efef01531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeee59c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efef0070ff0 0x7efef0142850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:36182/0 (socket says 172.21.15.40:36182) 2023-12-20T04:23:35.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeedd9b640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7efef00b4f90 0x7efef00b78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:44010/0 (socket says 172.21.15.40:44010) 2023-12-20T04:23:35.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeee59c640 1 -- 172.21.15.40:0/3336136451 learned_addr learned my addr 172.21.15.40:0/3336136451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeee59c640 1 -- 172.21.15.40:0/3336136451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0142d90 msgr2=0x7efef01531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeee59c640 1 --2- 172.21.15.40:0/3336136451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0142d90 0x7efef01531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeee59c640 1 -- 172.21.15.40:0/3336136451 >> v1:172.21.15.69:6789/0 conn(0x7efef00b4f90 legacy=0x7efef00b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.504+0000 7efeee59c640 1 -- 172.21.15.40:0/3336136451 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00b5ca0 con 0x7efef0070ff0 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.505+0000 7efeee59c640 1 --2- 172.21.15.40:0/3336136451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0070ff0 0x7efef0142850 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efee0009870 tx=0x7efee002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cdd82beb1f0ee11 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.505+0000 7efeed59a640 1 -- 172.21.15.40:0/3336136451 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee002f840 con 0x7efef0070ff0 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.505+0000 7efeed59a640 1 -- 172.21.15.40:0/3336136451 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee002f9a0 con 0x7efef0070ff0 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.505+0000 7efeed59a640 1 -- 172.21.15.40:0/3336136451 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee002fd30 con 0x7efef0070ff0 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 -- 172.21.15.40:0/3336136451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0070ff0 msgr2=0x7efef0142850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 --2- 172.21.15.40:0/3336136451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0070ff0 0x7efef0142850 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efee0009870 tx=0x7efee002ba20 comp rx=0 tx=0).stop 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 -- 172.21.15.40:0/3336136451 shutdown_connections 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 --2- 172.21.15.40:0/3336136451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0142d90 0x7efef01531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 --2- 172.21.15.40:0/3336136451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0070ff0 0x7efef0142850 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 -- 172.21.15.40:0/3336136451 >> 172.21.15.40:0/3336136451 conn(0x7efef00be120 msgr2=0x7efef00be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 -- 172.21.15.40:0/3336136451 shutdown_connections 2023-12-20T04:23:35.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.506+0000 7efef4a43640 1 -- 172.21.15.40:0/3336136451 wait complete. 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.507+0000 7efef4a43640 1 Processor -- start 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.507+0000 7efef4a43640 1 -- start start 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efef4a43640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0070ff0 0x7efef0139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efef4a43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efef00b4f90 0x7efef014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efef4a43640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0142d90 0x7efef0136800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efef4a43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef013a1d0 con 0x7efef00b4f90 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efef4a43640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef0139470 con 0x7efef0142d90 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efef4a43640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef0139680 con 0x7efef0070ff0 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efef00b4f90 0x7efef014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efef00b4f90 0x7efef014a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57602/0 (socket says 172.21.15.40:57602) 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 -- 172.21.15.40:0/3458242928 learned_addr learned my addr 172.21.15.40:0/3458242928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeee59c640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0070ff0 0x7efef0139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeeed9d640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0142d90 0x7efef0136800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 -- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0070ff0 msgr2=0x7efef0139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0070ff0 0x7efef0139c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 -- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0142d90 msgr2=0x7efef0136800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0142d90 0x7efef0136800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeedd9b640 1 -- 172.21.15.40:0/3458242928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00094d0 con 0x7efef00b4f90 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.508+0000 7efeeed9d640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0142d90 0x7efef0136800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.509+0000 7efeedd9b640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efef00b4f90 0x7efef014a0b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efee400c440 tx=0x7efee4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.509+0000 7efedeffd640 1 -- 172.21.15.40:0/3458242928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee40074e0 con 0x7efef00b4f90 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.509+0000 7efedeffd640 1 -- 172.21.15.40:0/3458242928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee4007640 con 0x7efef00b4f90 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.509+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef014a5f0 con 0x7efef00b4f90 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.509+0000 7efedeffd640 1 -- 172.21.15.40:0/3458242928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee4004a20 con 0x7efef00b4f90 2023-12-20T04:23:35.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.509+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef01e1500 con 0x7efef00b4f90 2023-12-20T04:23:35.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.510+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef01e1370 con 0x7efef00b4f90 2023-12-20T04:23:35.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.510+0000 7efedeffd640 1 -- 172.21.15.40:0/3458242928 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efee4004b80 con 0x7efef00b4f90 2023-12-20T04:23:35.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.511+0000 7efedeffd640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efed006a430 0x7efed006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.511+0000 7efedeffd640 1 -- 172.21.15.40:0/3458242928 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efee40881f0 con 0x7efef00b4f90 2023-12-20T04:23:35.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.511+0000 7efeee59c640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efed006a430 0x7efed006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.511+0000 7efeee59c640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efed006a430 0x7efed006c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efee0036000 tx=0x7efee0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.515+0000 7efedeffd640 1 -- 172.21.15.40:0/3458242928 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efee4053870 con 0x7efef00b4f90 2023-12-20T04:23:35.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.691+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efef01e1180 con 0x7efef00b4f90 2023-12-20T04:23:35.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.692+0000 7efedeffd640 1 -- 172.21.15.40:0/3458242928 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7efef01e1180 con 0x7efef00b4f90 2023-12-20T04:23:35.693 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:35.693 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efed006a430 msgr2=0x7efed006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efed006a430 0x7efed006c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efee0036000 tx=0x7efee0008030 comp rx=0 tx=0).stop 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efef00b4f90 msgr2=0x7efef014a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efef00b4f90 0x7efef014a0b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efee400c440 tx=0x7efee4001e70 comp rx=0 tx=0).stop 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 shutdown_connections 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efed006a430 0x7efed006c8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efef0142d90 0x7efef0136800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efef00b4f90 0x7efef014a0b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 --2- 172.21.15.40:0/3458242928 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efef0070ff0 0x7efef0139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 >> 172.21.15.40:0/3458242928 conn(0x7efef00be120 msgr2=0x7efef0140470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 shutdown_connections 2023-12-20T04:23:35.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.694+0000 7efef4a43640 1 -- 172.21.15.40:0/3458242928 wait complete. 2023-12-20T04:23:35.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:35.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.813+0000 7f6db2db1640 1 Processor -- start 2023-12-20T04:23:35.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6db2db1640 1 -- start start 2023-12-20T04:23:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6db2db1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac0b9b00 0x7f6dac0b9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6db2db1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6dac06fc30 0x7f6dac1416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6db2db1640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac070ef0 con 0x7f6dac14ac60 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6db2db1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac071190 con 0x7f6dac06fc30 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6db2db1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac071470 con 0x7f6dac0b9b00 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6dabfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6dac06fc30 0x7f6dac1416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.814+0000 7f6db0b4d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac0b9b00 0x7f6dac0b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6db0b4d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac0b9b00 0x7f6dac0b9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:45370/0 (socket says 172.21.15.40:45370) 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6db134e640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6dac14ac60 0x7f6dac147700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:49100/0 (socket says 172.21.15.40:49100) 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6dabfff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6dac06fc30 0x7f6dac1416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:41922/0 (socket says 172.21.15.40:41922) 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6db0b4d640 1 -- 172.21.15.40:0/477782076 learned_addr learned my addr 172.21.15.40:0/477782076 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6db0b4d640 1 -- 172.21.15.40:0/477782076 >> v2:172.21.15.69:3300/0 conn(0x7f6dac06fc30 msgr2=0x7f6dac1416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6db0b4d640 1 --2- 172.21.15.40:0/477782076 >> v2:172.21.15.69:3300/0 conn(0x7f6dac06fc30 0x7f6dac1416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6db0b4d640 1 -- 172.21.15.40:0/477782076 >> v1:172.21.15.69:6789/0 conn(0x7f6dac14ac60 legacy=0x7f6dac147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.815+0000 7f6db0b4d640 1 -- 172.21.15.40:0/477782076 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac070150 con 0x7f6dac0b9b00 2023-12-20T04:23:35.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db0b4d640 1 --2- 172.21.15.40:0/477782076 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac0b9b00 0x7f6dac0b9010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6da000bb10 tx=0x7f6da002e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6556ab90a77db0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6dab7fe640 1 -- 172.21.15.40:0/477782076 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0036440 con 0x7f6dac0b9b00 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6dab7fe640 1 -- 172.21.15.40:0/477782076 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da00365a0 con 0x7f6dac0b9b00 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6dab7fe640 1 -- 172.21.15.40:0/477782076 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da0036930 con 0x7f6dac0b9b00 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 -- 172.21.15.40:0/477782076 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac0b9b00 msgr2=0x7f6dac0b9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 --2- 172.21.15.40:0/477782076 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac0b9b00 0x7f6dac0b9010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6da000bb10 tx=0x7f6da002e150 comp rx=0 tx=0).stop 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 -- 172.21.15.40:0/477782076 shutdown_connections 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 --2- 172.21.15.40:0/477782076 >> v2:172.21.15.69:3300/0 conn(0x7f6dac06fc30 0x7f6dac1416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 --2- 172.21.15.40:0/477782076 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac0b9b00 0x7f6dac0b9010 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 -- 172.21.15.40:0/477782076 >> 172.21.15.40:0/477782076 conn(0x7f6dac0bcfe0 msgr2=0x7f6dac0bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 -- 172.21.15.40:0/477782076 shutdown_connections 2023-12-20T04:23:35.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.816+0000 7f6db2db1640 1 -- 172.21.15.40:0/477782076 wait complete. 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.817+0000 7f6db2db1640 1 Processor -- start 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.817+0000 7f6db2db1640 1 -- start start 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db2db1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac06fc30 0x7f6dac146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db2db1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dac0b9b00 0x7f6dac0b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db2db1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dac14ac60 0x7f6dac1e3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db2db1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0b6e40 con 0x7f6dac0b9b00 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db2db1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac149fb0 con 0x7f6dac14ac60 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db2db1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac148c20 con 0x7f6dac06fc30 2023-12-20T04:23:35.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dac0b9b00 0x7f6dac0b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6dabfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dac0b9b00 0x7f6dac0b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47908/0 (socket says 172.21.15.40:47908) 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6dabfff640 1 -- 172.21.15.40:0/3692354460 learned_addr learned my addr 172.21.15.40:0/3692354460 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db0b4d640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac06fc30 0x7f6dac146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.818+0000 7f6db134e640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dac14ac60 0x7f6dac1e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6dabfff640 1 -- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac06fc30 msgr2=0x7f6dac146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6dabfff640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac06fc30 0x7f6dac146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6dabfff640 1 -- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dac14ac60 msgr2=0x7f6dac1e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6dabfff640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dac14ac60 0x7f6dac1e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6dabfff640 1 -- 172.21.15.40:0/3692354460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da000b770 con 0x7f6dac0b9b00 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6dabfff640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dac0b9b00 0x7f6dac0b6900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800e9b0 tx=0x7f6d9800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6da97fa640 1 -- 172.21.15.40:0/3692354460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98009670 con 0x7f6dac0b9b00 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6da97fa640 1 -- 172.21.15.40:0/3692354460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9800c9a0 con 0x7f6dac0b9b00 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac14a200 con 0x7f6dac0b9b00 2023-12-20T04:23:35.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6da97fa640 1 -- 172.21.15.40:0/3692354460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800cd50 con 0x7f6dac0b9b00 2023-12-20T04:23:35.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.819+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac14aa00 con 0x7f6dac0b9b00 2023-12-20T04:23:35.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.820+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac0740a0 con 0x7f6dac0b9b00 2023-12-20T04:23:35.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.821+0000 7f6da97fa640 1 -- 172.21.15.40:0/3692354460 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6d98013470 con 0x7f6dac0b9b00 2023-12-20T04:23:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.821+0000 7f6da97fa640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6d9006a430 0x7f6d9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.821+0000 7f6da97fa640 1 -- 172.21.15.40:0/3692354460 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d98088b20 con 0x7f6dac0b9b00 2023-12-20T04:23:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.821+0000 7f6db0b4d640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6d9006a430 0x7f6d9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:35.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.822+0000 7f6db0b4d640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6d9006a430 0x7f6d9006c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6da0038000 tx=0x7f6da0032000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:35.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.825+0000 7f6da97fa640 1 -- 172.21.15.40:0/3692354460 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6d980541d0 con 0x7f6dac0b9b00 2023-12-20T04:23:35.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.998+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dac066d80 con 0x7f6dac0b9b00 2023-12-20T04:23:36.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:35.999+0000 7f6da97fa640 1 -- 172.21.15.40:0/3692354460 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d980577f0 con 0x7f6dac0b9b00 2023-12-20T04:23:36.000 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6d9006a430 msgr2=0x7f6d9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6d9006a430 0x7f6d9006c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6da0038000 tx=0x7f6da0032000 comp rx=0 tx=0).stop 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dac0b9b00 msgr2=0x7f6dac0b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dac0b9b00 0x7f6dac0b6900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800e9b0 tx=0x7f6d9800ee70 comp rx=0 tx=0).stop 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 shutdown_connections 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6d9006a430 0x7f6d9006c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6dac14ac60 0x7f6dac1e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dac0b9b00 0x7f6dac0b6900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 --2- 172.21.15.40:0/3692354460 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6dac06fc30 0x7f6dac146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 >> 172.21.15.40:0/3692354460 conn(0x7f6dac0bcfe0 msgr2=0x7f6dac0b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 shutdown_connections 2023-12-20T04:23:36.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.001+0000 7f6db2db1640 1 -- 172.21.15.40:0/3692354460 wait complete. 2023-12-20T04:23:36.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.120+0000 7f2ec0821640 1 Processor -- start 2023-12-20T04:23:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.120+0000 7f2ec0821640 1 -- start start 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2ec0821640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ebc0bb140 0x7f2ebc0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2ec0821640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2ec0821640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0bfa50 con 0x7f2ebc0bee00 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2ec0821640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc0bbda0 con 0x7f2ebc0bb140 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2ec0821640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc06b040 con 0x7f2ebc06a950 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2eba59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ebc0bb140 0x7f2ebc0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2ebad9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2ebc0bee00 0x7f2ebc14e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48040/0 (socket says 172.21.15.40:48040) 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2ebad9d640 1 -- 172.21.15.40:0/3571117376 learned_addr learned my addr 172.21.15.40:0/3571117376 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2eb9d9b640 1 --2- 172.21.15.40:0/3571117376 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2eba59c640 1 -- 172.21.15.40:0/3571117376 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 msgr2=0x7f2ebc0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2eba59c640 1 --2- 172.21.15.40:0/3571117376 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2eba59c640 1 -- 172.21.15.40:0/3571117376 >> v1:172.21.15.40:6789/0 conn(0x7f2ebc0bee00 legacy=0x7f2ebc14e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2eba59c640 1 -- 172.21.15.40:0/3571117376 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc0bb520 con 0x7f2ebc0bb140 2023-12-20T04:23:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.121+0000 7f2eb9d9b640 1 --2- 172.21.15.40:0/3571117376 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.122+0000 7f2eba59c640 1 --2- 172.21.15.40:0/3571117376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bb140 0x7f2ebc0be350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40097a0 tx=0x7f2eb402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975c0bfd5ac09694 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.122+0000 7f2eb959a640 1 -- 172.21.15.40:0/3571117376 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb402e070 con 0x7f2ebc0bb140 2023-12-20T04:23:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.122+0000 7f2eb959a640 1 -- 172.21.15.40:0/3571117376 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb40315a0 con 0x7f2ebc0bb140 2023-12-20T04:23:36.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.122+0000 7f2eb959a640 1 -- 172.21.15.40:0/3571117376 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb4031930 con 0x7f2ebc0bb140 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 -- 172.21.15.40:0/3571117376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bb140 msgr2=0x7f2ebc0be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 --2- 172.21.15.40:0/3571117376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bb140 0x7f2ebc0be350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2eb40097a0 tx=0x7f2eb402b840 comp rx=0 tx=0).stop 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 -- 172.21.15.40:0/3571117376 shutdown_connections 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 --2- 172.21.15.40:0/3571117376 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 --2- 172.21.15.40:0/3571117376 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bb140 0x7f2ebc0be350 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 -- 172.21.15.40:0/3571117376 >> 172.21.15.40:0/3571117376 conn(0x7f2ebc0bcfd0 msgr2=0x7f2ebc0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 -- 172.21.15.40:0/3571117376 shutdown_connections 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.123+0000 7f2ec0821640 1 -- 172.21.15.40:0/3571117376 wait complete. 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.124+0000 7f2ec0821640 1 Processor -- start 2023-12-20T04:23:36.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.124+0000 7f2ec0821640 1 -- start start 2023-12-20T04:23:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ec0821640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc1447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ec0821640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0bb140 0x7f2ebc1e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ec0821640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bee00 0x7f2ebc0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ec0821640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc141fe0 con 0x7f2ebc0bee00 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ec0821640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc1dfa90 con 0x7f2ebc0bb140 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ec0821640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc0be620 con 0x7f2ebc06a950 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bee00 0x7f2ebc0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bee00 0x7f2ebc0b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47922/0 (socket says 172.21.15.40:47922) 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 -- 172.21.15.40:0/380325961 learned_addr learned my addr 172.21.15.40:0/380325961 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2eba59c640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc1447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2eb9d9b640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0bb140 0x7f2ebc1e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 -- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 msgr2=0x7f2ebc1447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc1447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 -- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0bb140 msgr2=0x7f2ebc1e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0bb140 0x7f2ebc1e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 -- 172.21.15.40:0/380325961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb4009400 con 0x7f2ebc0bee00 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2ebad9d640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bee00 0x7f2ebc0b2ec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00cbc0 tx=0x7f2eac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.125+0000 7f2eb2ffd640 1 -- 172.21.15.40:0/380325961 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00ad40 con 0x7f2ebc0bee00 2023-12-20T04:23:36.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.126+0000 7f2eb2ffd640 1 -- 172.21.15.40:0/380325961 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac012400 con 0x7f2ebc0bee00 2023-12-20T04:23:36.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.126+0000 7f2eb2ffd640 1 -- 172.21.15.40:0/380325961 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00aea0 con 0x7f2ebc0bee00 2023-12-20T04:23:36.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.126+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ebc0a2570 con 0x7f2ebc0bee00 2023-12-20T04:23:36.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.126+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc1dfc80 con 0x7f2ebc0bee00 2023-12-20T04:23:36.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.127+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc0a2a90 con 0x7f2ebc0bee00 2023-12-20T04:23:36.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.127+0000 7f2eb2ffd640 1 -- 172.21.15.40:0/380325961 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2eac007070 con 0x7f2ebc0bee00 2023-12-20T04:23:36.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.128+0000 7f2eb2ffd640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2e9c06a430 0x7f2e9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.128+0000 7f2eb2ffd640 1 -- 172.21.15.40:0/380325961 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2eac0886f0 con 0x7f2ebc0bee00 2023-12-20T04:23:36.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.128+0000 7f2eba59c640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2e9c06a430 0x7f2e9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.128+0000 7f2eba59c640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2e9c06a430 0x7f2e9c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4036000 tx=0x7f2eb403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.132+0000 7f2eb2ffd640 1 -- 172.21.15.40:0/380325961 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2ebc0a2a90 con 0x7f2ebc0bee00 2023-12-20T04:23:36.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.308+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ebc0a2a90 con 0x7f2ebc0bee00 2023-12-20T04:23:36.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.308+0000 7f2eb2ffd640 1 -- 172.21.15.40:0/380325961 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2eac017020 con 0x7f2ebc0bee00 2023-12-20T04:23:36.309 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:36.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2e9c06a430 msgr2=0x7f2e9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2e9c06a430 0x7f2e9c06c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4036000 tx=0x7f2eb403d040 comp rx=0 tx=0).stop 2023-12-20T04:23:36.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bee00 msgr2=0x7f2ebc0b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bee00 0x7f2ebc0b2ec0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00cbc0 tx=0x7f2eac00a430 comp rx=0 tx=0).stop 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 shutdown_connections 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2e9c06a430 0x7f2e9c06c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ebc0bee00 0x7f2ebc0b2ec0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0bb140 0x7f2ebc1e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 --2- 172.21.15.40:0/380325961 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ebc06a950 0x7f2ebc1447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 >> 172.21.15.40:0/380325961 conn(0x7f2ebc0bcfd0 msgr2=0x7f2ebc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 shutdown_connections 2023-12-20T04:23:36.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.310+0000 7f2ec0821640 1 -- 172.21.15.40:0/380325961 wait complete. 2023-12-20T04:23:36.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:36.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.429+0000 7f4074db9640 1 Processor -- start 2023-12-20T04:23:36.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.429+0000 7f4074db9640 1 -- start start 2023-12-20T04:23:36.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f4074db9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4070145160 0x7f40700b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f4074db9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407006b3c0 con 0x7f407006c920 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f4074db9640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40700bb230 con 0x7f40700ba650 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f4074db9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700b9260 con 0x7f4070145160 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f406e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4070145160 0x7f40700b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f406ed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f407006c920 0x7f4070155490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48056/0 (socket says 172.21.15.40:48056) 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f406ed9d640 1 -- 172.21.15.40:0/4288394885 learned_addr learned my addr 172.21.15.40:0/4288394885 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f406e59c640 1 -- 172.21.15.40:0/4288394885 >> v1:172.21.15.69:6789/0 conn(0x7f40700ba650 legacy=0x7f407006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f406e59c640 1 -- 172.21.15.40:0/4288394885 >> v1:172.21.15.40:6789/0 conn(0x7f407006c920 legacy=0x7f4070155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.430+0000 7f406e59c640 1 -- 172.21.15.40:0/4288394885 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700bac70 con 0x7f4070145160 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.431+0000 7f406e59c640 1 --2- 172.21.15.40:0/4288394885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4070145160 0x7f40700b9680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4060009d90 tx=0x7f406002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161b119fbdd85094 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.431+0000 7f406d59a640 1 -- 172.21.15.40:0/4288394885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406002cc60 con 0x7f4070145160 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.431+0000 7f406d59a640 1 -- 172.21.15.40:0/4288394885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406002cdc0 con 0x7f4070145160 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.431+0000 7f406d59a640 1 -- 172.21.15.40:0/4288394885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060034660 con 0x7f4070145160 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.432+0000 7f4074db9640 1 -- 172.21.15.40:0/4288394885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4070145160 msgr2=0x7f40700b9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.432+0000 7f4074db9640 1 --2- 172.21.15.40:0/4288394885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4070145160 0x7f40700b9680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4060009d90 tx=0x7f406002beb0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.432+0000 7f4074db9640 1 -- 172.21.15.40:0/4288394885 shutdown_connections 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.432+0000 7f4074db9640 1 --2- 172.21.15.40:0/4288394885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4070145160 0x7f40700b9680 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.432+0000 7f4074db9640 1 -- 172.21.15.40:0/4288394885 >> 172.21.15.40:0/4288394885 conn(0x7f40700be0c0 msgr2=0x7f40700be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.432+0000 7f4074db9640 1 -- 172.21.15.40:0/4288394885 shutdown_connections 2023-12-20T04:23:36.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.432+0000 7f4074db9640 1 -- 172.21.15.40:0/4288394885 wait complete. 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.433+0000 7f4074db9640 1 Processor -- start 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.433+0000 7f4074db9640 1 -- start start 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f407006c920 0x7f4070143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40700ba650 0x7f40701467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4070145160 0x7f407014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4070144220 con 0x7f407006c920 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b4270 con 0x7f40700ba650 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4070146010 con 0x7f4070145160 2023-12-20T04:23:36.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f407006c920 0x7f4070143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f407006c920 0x7f4070143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47936/0 (socket says 172.21.15.40:47936) 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 -- 172.21.15.40:0/3774280203 learned_addr learned my addr 172.21.15.40:0/3774280203 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406dd9b640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40700ba650 0x7f40701467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 -- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4070145160 msgr2=0x7f407014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4070145160 0x7f407014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 -- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40700ba650 msgr2=0x7f40701467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40700ba650 0x7f40701467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 -- 172.21.15.40:0/3774280203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4060009a70 con 0x7f407006c920 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f406e59c640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f407006c920 0x7f4070143ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4060009d90 tx=0x7f4060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4066ffd640 1 -- 172.21.15.40:0/3774280203 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406003e610 con 0x7f407006c920 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4066ffd640 1 -- 172.21.15.40:0/3774280203 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406003e770 con 0x7f407006c920 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4070147160 con 0x7f407006c920 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4066ffd640 1 -- 172.21.15.40:0/3774280203 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406003eb20 con 0x7f407006c920 2023-12-20T04:23:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.434+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407014a590 con 0x7f407006c920 2023-12-20T04:23:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.435+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4070145b60 con 0x7f407006c920 2023-12-20T04:23:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.436+0000 7f4066ffd640 1 -- 172.21.15.40:0/3774280203 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f406003b050 con 0x7f407006c920 2023-12-20T04:23:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.436+0000 7f4066ffd640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f405006a430 0x7f405006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.436+0000 7f4066ffd640 1 -- 172.21.15.40:0/3774280203 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40600ab360 con 0x7f407006c920 2023-12-20T04:23:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.436+0000 7f406dd9b640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f405006a430 0x7f405006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.437+0000 7f406dd9b640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f405006a430 0x7f405006c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40700bd3e0 tx=0x7f4058009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.440+0000 7f4066ffd640 1 -- 172.21.15.40:0/3774280203 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4060076b00 con 0x7f407006c920 2023-12-20T04:23:36.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.620+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40700740a0 con 0x7f407006c920 2023-12-20T04:23:36.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.620+0000 7f4066ffd640 1 -- 172.21.15.40:0/3774280203 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4060039020 con 0x7f407006c920 2023-12-20T04:23:36.621 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:36.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f405006a430 msgr2=0x7f405006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f405006a430 0x7f405006c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40700bd3e0 tx=0x7f4058009040 comp rx=0 tx=0).stop 2023-12-20T04:23:36.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f407006c920 msgr2=0x7f4070143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f407006c920 0x7f4070143ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4060009d90 tx=0x7f4060004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 shutdown_connections 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f405006a430 0x7f405006c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4070145160 0x7f407014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40700ba650 0x7f40701467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 --2- 172.21.15.40:0/3774280203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f407006c920 0x7f4070143ce0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 >> 172.21.15.40:0/3774280203 conn(0x7f40700be0c0 msgr2=0x7f40700bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 shutdown_connections 2023-12-20T04:23:36.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.622+0000 7f4074db9640 1 -- 172.21.15.40:0/3774280203 wait complete. 2023-12-20T04:23:36.634 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:36.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.739+0000 7f68d2918640 1 Processor -- start 2023-12-20T04:23:36.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.739+0000 7f68d2918640 1 -- start start 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68d2918640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc144ea0 0x7f68cc156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68d2918640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc0bc6b0 con 0x7f68cc0bcdd0 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68d2918640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc0a59f0 con 0x7f68cc0b6690 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68d2918640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0bc0a0 con 0x7f68cc144ea0 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68cbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f68cc0bcdd0 0x7f68cc0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48058/0 (socket says 172.21.15.40:48058) 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68cbfff640 1 -- 172.21.15.40:0/1075814575 learned_addr learned my addr 172.21.15.40:0/1075814575 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68d0eb5640 1 --2- 172.21.15.40:0/1075814575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc144ea0 0x7f68cc156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.740+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509214013 0 0) 0x7f68cc0bc6b0 con 0x7f68cc0bcdd0 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.741+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b4003520 con 0x7f68cc0bcdd0 2023-12-20T04:23:36.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.741+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714070256 0 0) 0x7f68cc0a59f0 con 0x7f68cc0b6690 2023-12-20T04:23:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.741+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68cc0bc6b0 con 0x7f68cc0b6690 2023-12-20T04:23:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.741+0000 7f68d0eb5640 1 -- 172.21.15.40:0/1075814575 >> v1:172.21.15.69:6789/0 conn(0x7f68cc0b6690 legacy=0x7f68cc144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.741+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2276943526 0 0) 0x7f68b4003520 con 0x7f68cc0bcdd0 2023-12-20T04:23:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.741+0000 7f68d0eb5640 1 -- 172.21.15.40:0/1075814575 >> v1:172.21.15.40:6789/0 conn(0x7f68cc0bcdd0 legacy=0x7f68cc0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.741+0000 7f68d0eb5640 1 -- 172.21.15.40:0/1075814575 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc0bc340 con 0x7f68cc144ea0 2023-12-20T04:23:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d0eb5640 1 --2- 172.21.15.40:0/1075814575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc144ea0 0x7f68cc156350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009dc0 tx=0x7f68c402be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e0876fe0357c679 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0001670 con 0x7f68cc144ea0 2023-12-20T04:23:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c402c9a0 con 0x7f68cc144ea0 2023-12-20T04:23:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68caffd640 1 -- 172.21.15.40:0/1075814575 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c402cd10 con 0x7f68cc144ea0 2023-12-20T04:23:36.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d2918640 1 -- 172.21.15.40:0/1075814575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc144ea0 msgr2=0x7f68cc156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d2918640 1 --2- 172.21.15.40:0/1075814575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc144ea0 0x7f68cc156350 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009dc0 tx=0x7f68c402be70 comp rx=0 tx=0).stop 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d2918640 1 -- 172.21.15.40:0/1075814575 shutdown_connections 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d2918640 1 --2- 172.21.15.40:0/1075814575 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc144ea0 0x7f68cc156350 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d2918640 1 -- 172.21.15.40:0/1075814575 >> 172.21.15.40:0/1075814575 conn(0x7f68cc071e60 msgr2=0x7f68cc0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d2918640 1 -- 172.21.15.40:0/1075814575 shutdown_connections 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.742+0000 7f68d2918640 1 -- 172.21.15.40:0/1075814575 wait complete. 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.743+0000 7f68d2918640 1 Processor -- start 2023-12-20T04:23:36.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.743+0000 7f68d2918640 1 -- start start 2023-12-20T04:23:36.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d2918640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68cc0b6690 0x7f68cc147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d2918640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc0bcdd0 0x7f68cc1e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d2918640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc144ea0 0x7f68cc1e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d2918640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc147d90 con 0x7f68cc144ea0 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d2918640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc099450 con 0x7f68cc0b6690 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d2918640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1e2e20 con 0x7f68cc0bcdd0 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc144ea0 0x7f68cc1e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc144ea0 0x7f68cc1e3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47944/0 (socket says 172.21.15.40:47944) 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 -- 172.21.15.40:0/494044335 learned_addr learned my addr 172.21.15.40:0/494044335 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68cbfff640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68cc0b6690 0x7f68cc147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68cb7fe640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc0bcdd0 0x7f68cc1e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 -- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc0bcdd0 msgr2=0x7f68cc1e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc0bcdd0 0x7f68cc1e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 -- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68cc0b6690 msgr2=0x7f68cc147850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68cc0b6690 0x7f68cc147850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68d0eb5640 1 -- 172.21.15.40:0/494044335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c4009a70 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.744+0000 7f68cbfff640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68cc0b6690 0x7f68cc147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.745+0000 7f68d0eb5640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc144ea0 0x7f68cc1e3840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f68c402c480 tx=0x7f68c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.745+0000 7f68c8ff9640 1 -- 172.21.15.40:0/494044335 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4007000 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.745+0000 7f68c8ff9640 1 -- 172.21.15.40:0/494044335 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4009450 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.745+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc099c20 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.745+0000 7f68c8ff9640 1 -- 172.21.15.40:0/494044335 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c403e650 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.745+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc099940 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.746+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc066390 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.746+0000 7f68c8ff9640 1 -- 172.21.15.40:0/494044335 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f68c403b050 con 0x7f68cc144ea0 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.747+0000 7f68c8ff9640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f68b806a430 0x7f68b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:36.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.747+0000 7f68c8ff9640 1 -- 172.21.15.40:0/494044335 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68c40ab440 con 0x7f68cc144ea0 2023-12-20T04:23:36.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.747+0000 7f68cbfff640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f68b806a430 0x7f68b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:36.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.747+0000 7f68cbfff640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f68b806a430 0x7f68b806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68c0000fd0 tx=0x7f68c0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:36.751 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.751+0000 7f68c8ff9640 1 -- 172.21.15.40:0/494044335 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f68c4076ac0 con 0x7f68cc144ea0 2023-12-20T04:23:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.962+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68cc1e2c80 con 0x7f68cc144ea0 2023-12-20T04:23:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.963+0000 7f68c8ff9640 1 -- 172.21.15.40:0/494044335 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7f68cc1e2c80 con 0x7f68cc144ea0 2023-12-20T04:23:36.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:36.964 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:36.964 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f68b806a430 msgr2=0x7f68b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f68b806a430 0x7f68b806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68c0000fd0 tx=0x7f68c0009040 comp rx=0 tx=0).stop 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc144ea0 msgr2=0x7f68cc1e3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc144ea0 0x7f68cc1e3840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f68c402c480 tx=0x7f68c4004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 shutdown_connections 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f68b806a430 0x7f68b806c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68cc144ea0 0x7f68cc1e3840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68cc0bcdd0 0x7f68cc1e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 --2- 172.21.15.40:0/494044335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68cc0b6690 0x7f68cc147850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 >> 172.21.15.40:0/494044335 conn(0x7f68cc071e60 msgr2=0x7f68cc0b8630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 shutdown_connections 2023-12-20T04:23:36.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:36.965+0000 7f68d2918640 1 -- 172.21.15.40:0/494044335 wait complete. 2023-12-20T04:23:36.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.081+0000 7fbe02ce7640 1 Processor -- start 2023-12-20T04:23:37.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.081+0000 7fbe02ce7640 1 -- start start 2023-12-20T04:23:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe02ce7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbdfc0bcdd0 0x7fbdfc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe02ce7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc0bc6b0 con 0x7fbdfc0b64c0 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe02ce7640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc0b6900 con 0x7fbdfc144ea0 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe02ce7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0a59f0 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe00a83640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbdfc0bcdd0 0x7fbdfc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbdfbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbdfc0b64c0 0x7fbdfc144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48066/0 (socket says 172.21.15.40:48066) 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbdfbfff640 1 -- 172.21.15.40:0/657459649 learned_addr learned my addr 172.21.15.40:0/657459649 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe00a83640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbdfc0bcdd0 0x7fbdfc0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47960/0 (socket says 172.21.15.40:47960) 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe00a83640 1 -- 172.21.15.40:0/657459649 >> v1:172.21.15.69:6789/0 conn(0x7fbdfc144ea0 legacy=0x7fbdfc155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe00a83640 1 -- 172.21.15.40:0/657459649 >> v1:172.21.15.40:6789/0 conn(0x7fbdfc0b64c0 legacy=0x7fbdfc144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbdfb7fe640 1 -- 172.21.15.40:0/657459649 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644126126 0 0) 0x7fbdfc0bc6b0 con 0x7fbdfc0b64c0 2023-12-20T04:23:37.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.082+0000 7fbe00a83640 1 -- 172.21.15.40:0/657459649 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0bc0a0 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.083+0000 7fbe00a83640 1 --2- 172.21.15.40:0/657459649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc0b5f80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009d90 tx=0x7fbdf402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6928469601c49be server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.083+0000 7fbdfb7fe640 1 -- 172.21.15.40:0/657459649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf402cd80 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.083+0000 7fbdfb7fe640 1 -- 172.21.15.40:0/657459649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf4034440 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.083+0000 7fbdfb7fe640 1 -- 172.21.15.40:0/657459649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf40347d0 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.084+0000 7fbe02ce7640 1 -- 172.21.15.40:0/657459649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 msgr2=0x7fbdfc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.084+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/657459649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc0b5f80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009d90 tx=0x7fbdf402bfd0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.084+0000 7fbe02ce7640 1 -- 172.21.15.40:0/657459649 shutdown_connections 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.084+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/657459649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc0b5f80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.084+0000 7fbe02ce7640 1 -- 172.21.15.40:0/657459649 >> 172.21.15.40:0/657459649 conn(0x7fbdfc071e60 msgr2=0x7fbdfc0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:37.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.084+0000 7fbe02ce7640 1 -- 172.21.15.40:0/657459649 shutdown_connections 2023-12-20T04:23:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.084+0000 7fbe02ce7640 1 -- 172.21.15.40:0/657459649 wait complete. 2023-12-20T04:23:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.085+0000 7fbe02ce7640 1 Processor -- start 2023-12-20T04:23:37.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.085+0000 7fbe02ce7640 1 -- start start 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe02ce7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbdfc0b64c0 0x7fbdfc148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe02ce7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc1d1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe02ce7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdfc144ea0 0x7fbdfc1d3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe02ce7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1d2350 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe02ce7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1d4740 con 0x7fbdfc144ea0 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe02ce7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc145410 con 0x7fbdfc0b64c0 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc1d1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc1d1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47964/0 (socket says 172.21.15.40:47964) 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 -- 172.21.15.40:0/2952655182 learned_addr learned my addr 172.21.15.40:0/2952655182 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:37.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe00a83640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbdfc0b64c0 0x7fbdfc148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe01284640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdfc144ea0 0x7fbdfc1d3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 -- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbdfc0b64c0 msgr2=0x7fbdfc148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbdfc0b64c0 0x7fbdfc148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 -- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdfc144ea0 msgr2=0x7fbdfc1d3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdfc144ea0 0x7fbdfc1d3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbdfbfff640 1 -- 172.21.15.40:0/2952655182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf4009a70 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe00a83640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbdfc0b64c0 0x7fbdfc148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.086+0000 7fbe01284640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdfc144ea0 0x7fbdfc1d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.087+0000 7fbdfbfff640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc1d1e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000c4a0 tx=0x7fbdf000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.087+0000 7fbdf97fa640 1 -- 172.21.15.40:0/2952655182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00074e0 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.087+0000 7fbdf97fa640 1 -- 172.21.15.40:0/2952655182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0007640 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.087+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc146d20 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.087+0000 7fbdf97fa640 1 -- 172.21.15.40:0/2952655182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0004a00 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.087+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc1d4c70 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.088+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc04e840 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.088+0000 7fbdf97fa640 1 -- 172.21.15.40:0/2952655182 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbdf0004b60 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.089+0000 7fbdf97fa640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.089+0000 7fbdf97fa640 1 -- 172.21.15.40:0/2952655182 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdf0087b10 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.089+0000 7fbe00a83640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.089+0000 7fbe00a83640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbde806a430 0x7fbde806c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4036000 tx=0x7fbdf4030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.093+0000 7fbdf97fa640 1 -- 172.21.15.40:0/2952655182 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbdf0053190 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.270+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdfc1d4520 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.271+0000 7fbdf97fa640 1 -- 172.21.15.40:0/2952655182 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fbdf0018070 con 0x7fbdfc0bcdd0 2023-12-20T04:23:37.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:37.272 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:37.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbde806a430 msgr2=0x7fbde806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbde806a430 0x7fbde806c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4036000 tx=0x7fbdf4030000 comp rx=0 tx=0).stop 2023-12-20T04:23:37.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 msgr2=0x7fbdfc1d1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc1d1e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000c4a0 tx=0x7fbdf000c960 comp rx=0 tx=0).stop 2023-12-20T04:23:37.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 shutdown_connections 2023-12-20T04:23:37.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbde806a430 0x7fbde806c8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdfc144ea0 0x7fbdfc1d3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdfc0bcdd0 0x7fbdfc1d1e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 --2- 172.21.15.40:0/2952655182 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbdfc0b64c0 0x7fbdfc148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 >> 172.21.15.40:0/2952655182 conn(0x7fbdfc071e60 msgr2=0x7fbdfc0b8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 shutdown_connections 2023-12-20T04:23:37.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.273+0000 7fbe02ce7640 1 -- 172.21.15.40:0/2952655182 wait complete. 2023-12-20T04:23:37.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:37.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.393+0000 7ff37abab640 1 Processor -- start 2023-12-20T04:23:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.393+0000 7ff37abab640 1 -- start start 2023-12-20T04:23:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff37abab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3740bb140 0x7ff3740be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff37abab640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff3740bf510 0x7ff3740bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff37abab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3740bfa50 con 0x7ff37406a950 2023-12-20T04:23:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff37abab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3740bbda0 con 0x7ff3740bb140 2023-12-20T04:23:37.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff37abab640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37406b040 con 0x7ff3740bf510 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff378947640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3740bb140 0x7ff3740be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff373fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff37406a950 0x7ff3740bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48082/0 (socket says 172.21.15.40:48082) 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff373fff640 1 -- 172.21.15.40:0/1941462230 learned_addr learned my addr 172.21.15.40:0/1941462230 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff379148640 1 --2- 172.21.15.40:0/1941462230 >> v2:172.21.15.69:3300/0 conn(0x7ff3740bf510 0x7ff3740bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff378947640 1 -- 172.21.15.40:0/1941462230 >> v2:172.21.15.69:3300/0 conn(0x7ff3740bf510 msgr2=0x7ff3740bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff378947640 1 --2- 172.21.15.40:0/1941462230 >> v2:172.21.15.69:3300/0 conn(0x7ff3740bf510 0x7ff3740bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff378947640 1 -- 172.21.15.40:0/1941462230 >> v1:172.21.15.40:6789/0 conn(0x7ff37406a950 legacy=0x7ff3740bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff3737fe640 1 -- 172.21.15.40:0/1941462230 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192181860 0 0) 0x7ff3740bfa50 con 0x7ff37406a950 2023-12-20T04:23:37.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.394+0000 7ff378947640 1 -- 172.21.15.40:0/1941462230 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740bb520 con 0x7ff3740bb140 2023-12-20T04:23:37.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.395+0000 7ff378947640 1 --2- 172.21.15.40:0/1941462230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740bb140 0x7ff3740be350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff3740b75b0 tx=0x7ff36402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06415bab4108020 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.395+0000 7ff3737fe640 1 -- 172.21.15.40:0/1941462230 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36402e070 con 0x7ff3740bb140 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.395+0000 7ff3737fe640 1 -- 172.21.15.40:0/1941462230 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3640315a0 con 0x7ff3740bb140 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.395+0000 7ff3737fe640 1 -- 172.21.15.40:0/1941462230 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364031930 con 0x7ff3740bb140 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.395+0000 7ff37abab640 1 -- 172.21.15.40:0/1941462230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740bb140 msgr2=0x7ff3740be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.395+0000 7ff37abab640 1 --2- 172.21.15.40:0/1941462230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740bb140 0x7ff3740be350 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff3740b75b0 tx=0x7ff36402b840 comp rx=0 tx=0).stop 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.396+0000 7ff37abab640 1 -- 172.21.15.40:0/1941462230 shutdown_connections 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.396+0000 7ff37abab640 1 --2- 172.21.15.40:0/1941462230 >> v2:172.21.15.69:3300/0 conn(0x7ff3740bf510 0x7ff3740bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.396+0000 7ff37abab640 1 --2- 172.21.15.40:0/1941462230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3740bb140 0x7ff3740be350 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.396+0000 7ff37abab640 1 -- 172.21.15.40:0/1941462230 >> 172.21.15.40:0/1941462230 conn(0x7ff3740bcfd0 msgr2=0x7ff3740bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:37.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.396+0000 7ff37abab640 1 -- 172.21.15.40:0/1941462230 shutdown_connections 2023-12-20T04:23:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.396+0000 7ff37abab640 1 -- 172.21.15.40:0/1941462230 wait complete. 2023-12-20T04:23:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 Processor -- start 2023-12-20T04:23:37.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 -- start start 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff37406a950 0x7ff3740a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff3740bb140 0x7ff37414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3740bf510 0x7ff374146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37414d6d0 con 0x7ff37406a950 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740b3970 con 0x7ff3740bf510 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.397+0000 7ff37abab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37414e1f0 con 0x7ff3740bb140 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff37406a950 0x7ff3740a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff37406a950 0x7ff3740a2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47972/0 (socket says 172.21.15.40:47972) 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 -- 172.21.15.40:0/1062054943 learned_addr learned my addr 172.21.15.40:0/1062054943 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff379148640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3740bf510 0x7ff374146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff373fff640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff3740bb140 0x7ff37414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 -- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff3740bb140 msgr2=0x7ff37414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff3740bb140 0x7ff37414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 -- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3740bf510 msgr2=0x7ff374146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3740bf510 0x7ff374146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 -- 172.21.15.40:0/1062054943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364009400 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff373fff640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff3740bb140 0x7ff37414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff379148640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3740bf510 0x7ff374146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff378947640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff37406a950 0x7ff3740a2920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff36402be50 tx=0x7ff3640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff3717fa640 1 -- 172.21.15.40:0/1062054943 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364032840 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff3717fa640 1 -- 172.21.15.40:0/1062054943 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3640329a0 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37414ebc0 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff3717fa640 1 -- 172.21.15.40:0/1062054943 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364032d50 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.398+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37414dba0 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.399+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3740740a0 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.400+0000 7ff3717fa640 1 -- 172.21.15.40:0/1062054943 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff3640453f0 con 0x7ff37406a950 2023-12-20T04:23:37.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.400+0000 7ff3717fa640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff36006a430 0x7ff36006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.400+0000 7ff3717fa640 1 -- 172.21.15.40:0/1062054943 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3640aaa70 con 0x7ff37406a950 2023-12-20T04:23:37.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.400+0000 7ff373fff640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff36006a430 0x7ff36006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.401+0000 7ff373fff640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff36006a430 0x7ff36006c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff37414bc30 tx=0x7ff368009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.404+0000 7ff3717fa640 1 -- 172.21.15.40:0/1062054943 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff364076190 con 0x7ff37406a950 2023-12-20T04:23:37.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.581+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3740ba4a0 con 0x7ff37406a950 2023-12-20T04:23:37.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.581+0000 7ff3717fa640 1 -- 172.21.15.40:0/1062054943 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3640797b0 con 0x7ff37406a950 2023-12-20T04:23:37.582 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff36006a430 msgr2=0x7ff36006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff36006a430 0x7ff36006c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff37414bc30 tx=0x7ff368009040 comp rx=0 tx=0).stop 2023-12-20T04:23:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff37406a950 msgr2=0x7ff3740a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff37406a950 0x7ff3740a2920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff36402be50 tx=0x7ff3640046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 shutdown_connections 2023-12-20T04:23:37.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff36006a430 0x7ff36006c8f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3740bf510 0x7ff374146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff3740bb140 0x7ff37414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 --2- 172.21.15.40:0/1062054943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff37406a950 0x7ff3740a2920 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 >> 172.21.15.40:0/1062054943 conn(0x7ff3740bcfd0 msgr2=0x7ff3740a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:37.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 shutdown_connections 2023-12-20T04:23:37.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.583+0000 7ff37abab640 1 -- 172.21.15.40:0/1062054943 wait complete. 2023-12-20T04:23:37.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:37.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.702+0000 7f63e86e0640 1 Processor -- start 2023-12-20T04:23:37.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.702+0000 7f63e86e0640 1 -- start start 2023-12-20T04:23:37.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e86e0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bf510 0x7f63e00be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e86e0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63e006a950 0x7f63e00bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e86e0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00bfa50 con 0x7f63e00bb140 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e86e0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e00bbda0 con 0x7f63e006a950 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e86e0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e006b040 con 0x7f63e00bf510 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e6c7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63e006a950 0x7f63e00bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e6c7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63e006a950 0x7f63e00bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47980/0 (socket says 172.21.15.40:47980) 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e6c7d640 1 -- 172.21.15.40:0/30493238 learned_addr learned my addr 172.21.15.40:0/30493238 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e5c7b640 1 --2- 172.21.15.40:0/30493238 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bf510 0x7f63e00be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e6c7d640 1 -- 172.21.15.40:0/30493238 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bf510 msgr2=0x7f63e00be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:37.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e6c7d640 1 --2- 172.21.15.40:0/30493238 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bf510 0x7f63e00be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.703+0000 7f63e6c7d640 1 -- 172.21.15.40:0/30493238 >> v1:172.21.15.69:6789/0 conn(0x7f63e00bb140 legacy=0x7f63e00bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.704+0000 7f63e6c7d640 1 -- 172.21.15.40:0/30493238 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00bb520 con 0x7f63e006a950 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.704+0000 7f63e6c7d640 1 --2- 172.21.15.40:0/30493238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00bfee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009e50 tx=0x7f63d002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f637450d766bb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.704+0000 7f63e547a640 1 -- 172.21.15.40:0/30493238 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d002c9e0 con 0x7f63e006a950 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.704+0000 7f63e547a640 1 -- 172.21.15.40:0/30493238 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d002cb40 con 0x7f63e006a950 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.704+0000 7f63e547a640 1 -- 172.21.15.40:0/30493238 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00343f0 con 0x7f63e006a950 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 -- 172.21.15.40:0/30493238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 msgr2=0x7f63e00bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 --2- 172.21.15.40:0/30493238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00bfee0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009e50 tx=0x7f63d002be40 comp rx=0 tx=0).stop 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 -- 172.21.15.40:0/30493238 shutdown_connections 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 --2- 172.21.15.40:0/30493238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00bfee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 --2- 172.21.15.40:0/30493238 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bf510 0x7f63e00be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 -- 172.21.15.40:0/30493238 >> 172.21.15.40:0/30493238 conn(0x7f63e00bcfd0 msgr2=0x7f63e00bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:37.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 -- 172.21.15.40:0/30493238 shutdown_connections 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.705+0000 7f63e86e0640 1 -- 172.21.15.40:0/30493238 wait complete. 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.706+0000 7f63e86e0640 1 Processor -- start 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.706+0000 7f63e86e0640 1 -- start start 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e86e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e86e0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bb140 0x7f63e0147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e86e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63e00bf510 0x7f63e0143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e86e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00a2ef0 con 0x7f63e006a950 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e86e0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00b5500 con 0x7f63e00bf510 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e86e0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00b5220 con 0x7f63e00bb140 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47986/0 (socket says 172.21.15.40:47986) 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 -- 172.21.15.40:0/216661013 learned_addr learned my addr 172.21.15.40:0/216661013 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e5c7b640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bb140 0x7f63e0147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e6c7d640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63e00bf510 0x7f63e0143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 -- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bb140 msgr2=0x7f63e0147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bb140 0x7f63e0147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 -- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63e00bf510 msgr2=0x7f63e0143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63e00bf510 0x7f63e0143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 -- 172.21.15.40:0/216661013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009b30 con 0x7f63e006a950 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63e647c640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00a29b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f63d800b3f0 tx=0x7f63d800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.707+0000 7f63deffd640 1 -- 172.21.15.40:0/216661013 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8011830 con 0x7f63e006a950 2023-12-20T04:23:37.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.708+0000 7f63deffd640 1 -- 172.21.15.40:0/216661013 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d8011990 con 0x7f63e006a950 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.708+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e00b4f80 con 0x7f63e006a950 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.708+0000 7f63deffd640 1 -- 172.21.15.40:0/216661013 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d8011d40 con 0x7f63e006a950 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.708+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e00b6be0 con 0x7f63e006a950 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.708+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e00740a0 con 0x7f63e006a950 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.709+0000 7f63deffd640 1 -- 172.21.15.40:0/216661013 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f63d801a400 con 0x7f63e006a950 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.709+0000 7f63deffd640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f63cc06a460 0x7f63cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.710+0000 7f63deffd640 1 -- 172.21.15.40:0/216661013 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63d8088770 con 0x7f63e006a950 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.710+0000 7f63e5c7b640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f63cc06a460 0x7f63cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.710+0000 7f63e5c7b640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f63cc06a460 0x7f63cc06c920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63e00b74d0 tx=0x7f63d4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:37.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.714+0000 7f63deffd640 1 -- 172.21.15.40:0/216661013 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f63d8053d60 con 0x7f63e006a950 2023-12-20T04:23:37.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.888+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63e00ba4a0 con 0x7f63e006a950 2023-12-20T04:23:37.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.889+0000 7f63deffd640 1 -- 172.21.15.40:0/216661013 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63d8057380 con 0x7f63e006a950 2023-12-20T04:23:37.890 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f63cc06a460 msgr2=0x7f63cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f63cc06a460 0x7f63cc06c920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f63e00b74d0 tx=0x7f63d4008040 comp rx=0 tx=0).stop 2023-12-20T04:23:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 msgr2=0x7f63e00a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:37.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00a29b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f63d800b3f0 tx=0x7f63d800b8b0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 shutdown_connections 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f63cc06a460 0x7f63cc06c920 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63e00bf510 0x7f63e0143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f63e00bb140 0x7f63e0147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 --2- 172.21.15.40:0/216661013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63e006a950 0x7f63e00a29b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 >> 172.21.15.40:0/216661013 conn(0x7f63e00bcfd0 msgr2=0x7f63e00a49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 shutdown_connections 2023-12-20T04:23:37.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:37.890+0000 7f63e86e0640 1 -- 172.21.15.40:0/216661013 wait complete. 2023-12-20T04:23:37.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:38.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.009+0000 7fdb2412e640 1 Processor -- start 2023-12-20T04:23:38.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb2412e640 1 -- start start 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb2412e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb1c141c10 0x7fdb1c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb2412e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdb1c06f170 0x7fdb1c0b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb2412e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c147d90 0x7fdb1c1481e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb2412e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c06fba0 con 0x7fdb1c141c10 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb2412e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c148720 con 0x7fdb1c06f170 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb2412e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c147900 con 0x7fdb1c147d90 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.010+0000 7fdb21eca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb1c141c10 0x7fdb1c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb21eca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdb1c141c10 0x7fdb1c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47988/0 (socket says 172.21.15.40:47988) 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb21eca640 1 -- 172.21.15.40:0/888513907 learned_addr learned my addr 172.21.15.40:0/888513907 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb226cb640 1 --2- 172.21.15.40:0/888513907 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c147d90 0x7fdb1c1481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb216c9640 1 --2- 172.21.15.40:0/888513907 >> v2:172.21.15.69:3300/0 conn(0x7fdb1c06f170 0x7fdb1c0b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb21eca640 1 -- 172.21.15.40:0/888513907 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c147d90 msgr2=0x7fdb1c1481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:38.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb21eca640 1 --2- 172.21.15.40:0/888513907 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c147d90 0x7fdb1c1481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb21eca640 1 -- 172.21.15.40:0/888513907 >> v2:172.21.15.69:3300/0 conn(0x7fdb1c06f170 msgr2=0x7fdb1c0b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:38.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb21eca640 1 --2- 172.21.15.40:0/888513907 >> v2:172.21.15.69:3300/0 conn(0x7fdb1c06f170 0x7fdb1c0b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.011+0000 7fdb21eca640 1 -- 172.21.15.40:0/888513907 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c0b2b40 con 0x7fdb1c141c10 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb21eca640 1 --2- 172.21.15.40:0/888513907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c141c10 0x7fdb1c06fd70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0b9b40 tx=0x7fdb1402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b8ca73d705400f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb20ec8640 1 -- 172.21.15.40:0/888513907 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1402ee00 con 0x7fdb1c141c10 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb20ec8640 1 -- 172.21.15.40:0/888513907 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb14036440 con 0x7fdb1c141c10 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb20ec8640 1 -- 172.21.15.40:0/888513907 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb140367d0 con 0x7fdb1c141c10 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 -- 172.21.15.40:0/888513907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c141c10 msgr2=0x7fdb1c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 --2- 172.21.15.40:0/888513907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c141c10 0x7fdb1c06fd70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c0b9b40 tx=0x7fdb1402e050 comp rx=0 tx=0).stop 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 -- 172.21.15.40:0/888513907 shutdown_connections 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 --2- 172.21.15.40:0/888513907 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c147d90 0x7fdb1c1481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 --2- 172.21.15.40:0/888513907 >> v2:172.21.15.69:3300/0 conn(0x7fdb1c06f170 0x7fdb1c0b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 --2- 172.21.15.40:0/888513907 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c141c10 0x7fdb1c06fd70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 -- 172.21.15.40:0/888513907 >> 172.21.15.40:0/888513907 conn(0x7fdb1c0b8a40 msgr2=0x7fdb1c0b8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 -- 172.21.15.40:0/888513907 shutdown_connections 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.012+0000 7fdb2412e640 1 -- 172.21.15.40:0/888513907 wait complete. 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.013+0000 7fdb2412e640 1 Processor -- start 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.013+0000 7fdb2412e640 1 -- start start 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb2412e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c06f170 0x7fdb1c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb2412e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c141c10 0x7fdb1c1df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb2412e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb1c147d90 0x7fdb1c1dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb2412e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1df030 con 0x7fdb1c06f170 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb2412e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0b61b0 con 0x7fdb1c147d90 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb2412e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c13be30 con 0x7fdb1c141c10 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c06f170 0x7fdb1c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c06f170 0x7fdb1c0b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48002/0 (socket says 172.21.15.40:48002) 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 -- 172.21.15.40:0/848316774 learned_addr learned my addr 172.21.15.40:0/848316774 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:38.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb216c9640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c141c10 0x7fdb1c1df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb226cb640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb1c147d90 0x7fdb1c1dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 -- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c141c10 msgr2=0x7fdb1c1df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c141c10 0x7fdb1c1df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 -- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb1c147d90 msgr2=0x7fdb1c1dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb1c147d90 0x7fdb1c1dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb21eca640 1 -- 172.21.15.40:0/848316774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1400b770 con 0x7fdb1c06f170 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb216c9640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c141c10 0x7fdb1c1df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.014+0000 7fdb226cb640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb1c147d90 0x7fdb1c1dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.015+0000 7fdb21eca640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c06f170 0x7fdb1c0b3480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb1402e090 tx=0x7fdb140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.015+0000 7fdb127fc640 1 -- 172.21.15.40:0/848316774 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14034850 con 0x7fdb1c06f170 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.015+0000 7fdb127fc640 1 -- 172.21.15.40:0/848316774 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb140349b0 con 0x7fdb1c06f170 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.015+0000 7fdb127fc640 1 -- 172.21.15.40:0/848316774 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14034d60 con 0x7fdb1c06f170 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.015+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c0b3ca0 con 0x7fdb1c06f170 2023-12-20T04:23:38.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.015+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c13b0c0 con 0x7fdb1c06f170 2023-12-20T04:23:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.016+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c0740a0 con 0x7fdb1c06f170 2023-12-20T04:23:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.016+0000 7fdb127fc640 1 -- 172.21.15.40:0/848316774 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdb1403d040 con 0x7fdb1c06f170 2023-12-20T04:23:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.017+0000 7fdb127fc640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdb0006a430 0x7fdb0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.017+0000 7fdb127fc640 1 -- 172.21.15.40:0/848316774 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb140ad6d0 con 0x7fdb1c06f170 2023-12-20T04:23:38.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.017+0000 7fdb216c9640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdb0006a430 0x7fdb0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.017+0000 7fdb216c9640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdb0006a430 0x7fdb0006c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c138640 tx=0x7fdb0c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.021+0000 7fdb127fc640 1 -- 172.21.15.40:0/848316774 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdb14078d50 con 0x7fdb1c06f170 2023-12-20T04:23:38.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.195+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb1c0b7050 con 0x7fdb1c06f170 2023-12-20T04:23:38.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.196+0000 7fdb127fc640 1 -- 172.21.15.40:0/848316774 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb1407c370 con 0x7fdb1c06f170 2023-12-20T04:23:38.197 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdb0006a430 msgr2=0x7fdb0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdb0006a430 0x7fdb0006c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c138640 tx=0x7fdb0c008040 comp rx=0 tx=0).stop 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c06f170 msgr2=0x7fdb1c0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c06f170 0x7fdb1c0b3480 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb1402e090 tx=0x7fdb140046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 shutdown_connections 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdb0006a430 0x7fdb0006c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb1c147d90 0x7fdb1c1dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdb1c141c10 0x7fdb1c1df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 --2- 172.21.15.40:0/848316774 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb1c06f170 0x7fdb1c0b3480 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 >> 172.21.15.40:0/848316774 conn(0x7fdb1c0b8a40 msgr2=0x7fdb1c13df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 shutdown_connections 2023-12-20T04:23:38.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.197+0000 7fdb2412e640 1 -- 172.21.15.40:0/848316774 wait complete. 2023-12-20T04:23:38.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.313+0000 7fd975e1e640 1 Processor -- start 2023-12-20T04:23:38.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.313+0000 7fd975e1e640 1 -- start start 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.314+0000 7fd975e1e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd9700b6730 0x7fd97014aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.314+0000 7fd975e1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700b4110 con 0x7fd9700b6b10 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.314+0000 7fd975e1e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97014b010 con 0x7fd9700710b0 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.314+0000 7fd975e1e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97006b800 con 0x7fd9700b6730 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.314+0000 7fd96effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd9700b6b10 0x7fd970069ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48086/0 (socket says 172.21.15.40:48086) 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.314+0000 7fd96effd640 1 -- 172.21.15.40:0/3949785633 learned_addr learned my addr 172.21.15.40:0/3949785633 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.314+0000 7fd96f7fe640 1 --2- 172.21.15.40:0/3949785633 >> v2:172.21.15.69:3300/0 conn(0x7fd9700b6730 0x7fd97014aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.315+0000 7fd96e7fc640 1 -- 172.21.15.40:0/3949785633 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638504501 0 0) 0x7fd9700b4110 con 0x7fd9700b6b10 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.315+0000 7fd96e7fc640 1 -- 172.21.15.40:0/3949785633 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd958003520 con 0x7fd9700b6b10 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.315+0000 7fd96f7fe640 1 -- 172.21.15.40:0/3949785633 >> v1:172.21.15.69:6789/0 conn(0x7fd9700710b0 legacy=0x7fd970155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.315+0000 7fd96f7fe640 1 -- 172.21.15.40:0/3949785633 >> v1:172.21.15.40:6789/0 conn(0x7fd9700b6b10 legacy=0x7fd970069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.315+0000 7fd96f7fe640 1 -- 172.21.15.40:0/3949785633 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700b3b50 con 0x7fd9700b6730 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.315+0000 7fd96f7fe640 1 --2- 172.21.15.40:0/3949785633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700b6730 0x7fd97014aad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9640097a0 tx=0x7fd96402b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9788017266386ac server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd96e7fc640 1 -- 172.21.15.40:0/3949785633 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96402f810 con 0x7fd9700b6730 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd96e7fc640 1 -- 172.21.15.40:0/3949785633 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96402f970 con 0x7fd9700b6730 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd96e7fc640 1 -- 172.21.15.40:0/3949785633 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96402fd00 con 0x7fd9700b6730 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd975e1e640 1 -- 172.21.15.40:0/3949785633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700b6730 msgr2=0x7fd97014aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd975e1e640 1 --2- 172.21.15.40:0/3949785633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700b6730 0x7fd97014aad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9640097a0 tx=0x7fd96402b9f0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd975e1e640 1 -- 172.21.15.40:0/3949785633 shutdown_connections 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd975e1e640 1 --2- 172.21.15.40:0/3949785633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700b6730 0x7fd97014aad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd975e1e640 1 -- 172.21.15.40:0/3949785633 >> 172.21.15.40:0/3949785633 conn(0x7fd9700bcf60 msgr2=0x7fd9700bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:38.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd975e1e640 1 -- 172.21.15.40:0/3949785633 shutdown_connections 2023-12-20T04:23:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.316+0000 7fd975e1e640 1 -- 172.21.15.40:0/3949785633 wait complete. 2023-12-20T04:23:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.317+0000 7fd975e1e640 1 Processor -- start 2023-12-20T04:23:38.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.317+0000 7fd975e1e640 1 -- start start 2023-12-20T04:23:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd975e1e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700710b0 0x7fd97013f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd975e1e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700b6730 0x7fd970145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd975e1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b6b10 0x7fd9701472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd975e1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97013f9f0 con 0x7fd9700b6b10 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd975e1e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701dfbd0 con 0x7fd9700710b0 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd975e1e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701dfe10 con 0x7fd9700b6730 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b6b10 0x7fd9701472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b6b10 0x7fd9701472e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48014/0 (socket says 172.21.15.40:48014) 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96ffff640 1 -- 172.21.15.40:0/999405336 learned_addr learned my addr 172.21.15.40:0/999405336 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96f7fe640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700710b0 0x7fd97013f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96effd640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700b6730 0x7fd970145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96ffff640 1 -- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700b6730 msgr2=0x7fd970145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96ffff640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700b6730 0x7fd970145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96ffff640 1 -- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700710b0 msgr2=0x7fd97013f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.318+0000 7fd96ffff640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700710b0 0x7fd97013f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.319+0000 7fd96ffff640 1 -- 172.21.15.40:0/999405336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964009400 con 0x7fd9700b6b10 2023-12-20T04:23:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.319+0000 7fd96ffff640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b6b10 0x7fd9701472e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c6b0 tx=0x7fd96800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.319+0000 7fd957fff640 1 -- 172.21.15.40:0/999405336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968003b70 con 0x7fd9700b6b10 2023-12-20T04:23:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.319+0000 7fd957fff640 1 -- 172.21.15.40:0/999405336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968003cf0 con 0x7fd9700b6b10 2023-12-20T04:23:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.319+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9701e00f0 con 0x7fd9700b6b10 2023-12-20T04:23:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.319+0000 7fd957fff640 1 -- 172.21.15.40:0/999405336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968003ea0 con 0x7fd9700b6b10 2023-12-20T04:23:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.319+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9701e06b0 con 0x7fd9700b6b10 2023-12-20T04:23:38.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.320+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97004e840 con 0x7fd9700b6b10 2023-12-20T04:23:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.320+0000 7fd957fff640 1 -- 172.21.15.40:0/999405336 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd968005310 con 0x7fd9700b6b10 2023-12-20T04:23:38.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.321+0000 7fd957fff640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95c06a430 0x7fd95c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.321+0000 7fd957fff640 1 -- 172.21.15.40:0/999405336 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9680884c0 con 0x7fd9700b6b10 2023-12-20T04:23:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.321+0000 7fd96f7fe640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95c06a430 0x7fd95c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.321+0000 7fd96f7fe640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95c06a430 0x7fd95c06c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd964036000 tx=0x7fd964008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.325+0000 7fd957fff640 1 -- 172.21.15.40:0/999405336 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd968053bf0 con 0x7fd9700b6b10 2023-12-20T04:23:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.537+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd970070580 con 0x7fd9700b6b10 2023-12-20T04:23:38.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.538+0000 7fd957fff640 1 -- 172.21.15.40:0/999405336 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7fd968057210 con 0x7fd9700b6b10 2023-12-20T04:23:38.539 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:38.539 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:38.539 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95c06a430 msgr2=0x7fd95c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95c06a430 0x7fd95c06c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd964036000 tx=0x7fd964008030 comp rx=0 tx=0).stop 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b6b10 msgr2=0x7fd9701472e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b6b10 0x7fd9701472e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd96800c6b0 tx=0x7fd96800cb70 comp rx=0 tx=0).stop 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 shutdown_connections 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95c06a430 0x7fd95c06c8f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b6b10 0x7fd9701472e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700b6730 0x7fd970145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 --2- 172.21.15.40:0/999405336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9700710b0 0x7fd97013f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 >> 172.21.15.40:0/999405336 conn(0x7fd9700bcf60 msgr2=0x7fd9700bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:38.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 shutdown_connections 2023-12-20T04:23:38.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.540+0000 7fd975e1e640 1 -- 172.21.15.40:0/999405336 wait complete. 2023-12-20T04:23:38.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:38.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.656+0000 7f39746db640 1 Processor -- start 2023-12-20T04:23:38.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.656+0000 7f39746db640 1 -- start start 2023-12-20T04:23:38.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f39746db640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f396c0bcdd0 0x7f396c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f39746db640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f39746db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f396c0bc6b0 con 0x7f396c0b64c0 2023-12-20T04:23:38.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f39746db640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f396c0b6900 con 0x7f396c0bcdd0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f39746db640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c0a59f0 con 0x7f396c144ea0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f3971c76640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f396c0b64c0 0x7f396c144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48092/0 (socket says 172.21.15.40:48092) 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f3971c76640 1 -- 172.21.15.40:0/3360777086 learned_addr learned my addr 172.21.15.40:0/3360777086 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f3972c78640 1 --2- 172.21.15.40:0/3360777086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f3972477640 1 --2- 172.21.15.40:0/3360777086 >> v2:172.21.15.69:3300/0 conn(0x7f396c0bcdd0 0x7f396c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.657+0000 7f3971475640 1 -- 172.21.15.40:0/3360777086 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132277257 0 0) 0x7f396c0bc6b0 con 0x7f396c0b64c0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.658+0000 7f3971475640 1 -- 172.21.15.40:0/3360777086 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3958003520 con 0x7f396c0b64c0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.658+0000 7f3972c78640 1 -- 172.21.15.40:0/3360777086 >> v2:172.21.15.69:3300/0 conn(0x7f396c0bcdd0 msgr2=0x7f396c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.658+0000 7f3972c78640 1 --2- 172.21.15.40:0/3360777086 >> v2:172.21.15.69:3300/0 conn(0x7f396c0bcdd0 0x7f396c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.658+0000 7f3972c78640 1 -- 172.21.15.40:0/3360777086 >> v1:172.21.15.40:6789/0 conn(0x7f396c0b64c0 legacy=0x7f396c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.658+0000 7f3972c78640 1 -- 172.21.15.40:0/3360777086 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c0bc0a0 con 0x7f396c144ea0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.658+0000 7f3972477640 1 --2- 172.21.15.40:0/3360777086 >> v2:172.21.15.69:3300/0 conn(0x7f396c0bcdd0 0x7f396c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.658+0000 7f3972c78640 1 --2- 172.21.15.40:0/3360777086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c155340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3964009d90 tx=0x7f396402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c753876d5c8eee5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f3971475640 1 -- 172.21.15.40:0/3360777086 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396402cce0 con 0x7f396c144ea0 2023-12-20T04:23:38.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f3971475640 1 -- 172.21.15.40:0/3360777086 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396402ce40 con 0x7f396c144ea0 2023-12-20T04:23:38.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f3971475640 1 -- 172.21.15.40:0/3360777086 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3964034640 con 0x7f396c144ea0 2023-12-20T04:23:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 -- 172.21.15.40:0/3360777086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 msgr2=0x7f396c155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 --2- 172.21.15.40:0/3360777086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c155340 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3964009d90 tx=0x7f396402bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 -- 172.21.15.40:0/3360777086 shutdown_connections 2023-12-20T04:23:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 --2- 172.21.15.40:0/3360777086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c155340 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 --2- 172.21.15.40:0/3360777086 >> v2:172.21.15.69:3300/0 conn(0x7f396c0bcdd0 0x7f396c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 -- 172.21.15.40:0/3360777086 >> 172.21.15.40:0/3360777086 conn(0x7f396c071e60 msgr2=0x7f396c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 -- 172.21.15.40:0/3360777086 shutdown_connections 2023-12-20T04:23:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.659+0000 7f39746db640 1 -- 172.21.15.40:0/3360777086 wait complete. 2023-12-20T04:23:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.660+0000 7f39746db640 1 Processor -- start 2023-12-20T04:23:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.660+0000 7f39746db640 1 -- start start 2023-12-20T04:23:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f39746db640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f396c0b64c0 0x7f396c1431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f39746db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0bcdd0 0x7f396c1e26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f39746db640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c13e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f39746db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c145c00 con 0x7f396c0bcdd0 2023-12-20T04:23:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f39746db640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396c1436e0 con 0x7f396c0b64c0 2023-12-20T04:23:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f39746db640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396c1d3760 con 0x7f396c144ea0 2023-12-20T04:23:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0bcdd0 0x7f396c1e26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0bcdd0 0x7f396c1e26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48030/0 (socket says 172.21.15.40:48030) 2023-12-20T04:23:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 -- 172.21.15.40:0/3491591359 learned_addr learned my addr 172.21.15.40:0/3491591359 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3972c78640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c13e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3972477640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f396c0b64c0 0x7f396c1431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 -- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 msgr2=0x7f396c13e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c13e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 -- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f396c0b64c0 msgr2=0x7f396c1431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f396c0b64c0 0x7f396c1431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.661+0000 7f3971c76640 1 -- 172.21.15.40:0/3491591359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968009400 con 0x7f396c0bcdd0 2023-12-20T04:23:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.662+0000 7f3971c76640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0bcdd0 0x7f396c1e26d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c430 tx=0x7f395c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.662+0000 7f3962ffd640 1 -- 172.21.15.40:0/3491591359 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c005ce0 con 0x7f396c0bcdd0 2023-12-20T04:23:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.662+0000 7f3962ffd640 1 -- 172.21.15.40:0/3491591359 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c005e40 con 0x7f396c0bcdd0 2023-12-20T04:23:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.662+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3964009a70 con 0x7f396c0bcdd0 2023-12-20T04:23:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.662+0000 7f3962ffd640 1 -- 172.21.15.40:0/3491591359 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c0072f0 con 0x7f396c0bcdd0 2023-12-20T04:23:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.662+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396c1d3d20 con 0x7f396c0bcdd0 2023-12-20T04:23:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.663+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396c1d3b30 con 0x7f396c0bcdd0 2023-12-20T04:23:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.663+0000 7f3962ffd640 1 -- 172.21.15.40:0/3491591359 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f395c007450 con 0x7f396c0bcdd0 2023-12-20T04:23:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.663+0000 7f3962ffd640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f395006a430 0x7f395006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.664+0000 7f3962ffd640 1 -- 172.21.15.40:0/3491591359 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f395c087ea0 con 0x7f396c0bcdd0 2023-12-20T04:23:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.664+0000 7f3972477640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f395006a430 0x7f395006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.664+0000 7f3972477640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f395006a430 0x7f395006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3968009cd0 tx=0x7f3968009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.668+0000 7f3962ffd640 1 -- 172.21.15.40:0/3491591359 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f396c1d3b30 con 0x7f396c0bcdd0 2023-12-20T04:23:38.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.846+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f396c1d3b30 con 0x7f396c0bcdd0 2023-12-20T04:23:38.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.847+0000 7f3962ffd640 1 -- 172.21.15.40:0/3491591359 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f396c1d3b30 con 0x7f396c0bcdd0 2023-12-20T04:23:38.848 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:38.848 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f395006a430 msgr2=0x7f395006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f395006a430 0x7f395006c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3968009cd0 tx=0x7f3968009190 comp rx=0 tx=0).stop 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0bcdd0 msgr2=0x7f396c1e26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0bcdd0 0x7f396c1e26d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f395c00c430 tx=0x7f395c00c8f0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 shutdown_connections 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f395006a430 0x7f395006c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f396c144ea0 0x7f396c13e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f396c0bcdd0 0x7f396c1e26d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 --2- 172.21.15.40:0/3491591359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f396c0b64c0 0x7f396c1431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 >> 172.21.15.40:0/3491591359 conn(0x7f396c071e60 msgr2=0x7f396c1407c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:38.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 shutdown_connections 2023-12-20T04:23:38.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.849+0000 7f39746db640 1 -- 172.21.15.40:0/3491591359 wait complete. 2023-12-20T04:23:38.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:38.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc1cdea640 1 Processor -- start 2023-12-20T04:23:38.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc1cdea640 1 -- start start 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc1cdea640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc18070ff0 0x7fcc1814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc1cdea640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc1814af90 con 0x7fcc180ba700 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc1cdea640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc18071d10 con 0x7fcc180ba0e0 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc1cdea640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180b8630 con 0x7fcc18070ff0 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc16d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcc180ba700 0x7fcc18155390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48104/0 (socket says 172.21.15.40:48104) 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.966+0000 7fcc16d9d640 1 -- 172.21.15.40:0/3141331100 learned_addr learned my addr 172.21.15.40:0/3141331100 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.967+0000 7fcc1659c640 1 --2- 172.21.15.40:0/3141331100 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc18070ff0 0x7fcc1814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.967+0000 7fcc15d9b640 1 -- 172.21.15.40:0/3141331100 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224830252 0 0) 0x7fcc1814af90 con 0x7fcc180ba700 2023-12-20T04:23:38.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.967+0000 7fcc15d9b640 1 -- 172.21.15.40:0/3141331100 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc04003520 con 0x7fcc180ba700 2023-12-20T04:23:38.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.967+0000 7fcc1659c640 1 -- 172.21.15.40:0/3141331100 >> v1:172.21.15.69:6789/0 conn(0x7fcc180ba0e0 legacy=0x7fcc180b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.967+0000 7fcc1659c640 1 -- 172.21.15.40:0/3141331100 >> v1:172.21.15.40:6789/0 conn(0x7fcc180ba700 legacy=0x7fcc18155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.967+0000 7fcc1659c640 1 -- 172.21.15.40:0/3141331100 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18071750 con 0x7fcc18070ff0 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1659c640 1 --2- 172.21.15.40:0/3141331100 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc18070ff0 0x7fcc1814aa50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009800 tx=0x7fcc0802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95258474cfa28d5a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc15d9b640 1 -- 172.21.15.40:0/3141331100 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08031890 con 0x7fcc18070ff0 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc15d9b640 1 -- 172.21.15.40:0/3141331100 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080319f0 con 0x7fcc18070ff0 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc15d9b640 1 -- 172.21.15.40:0/3141331100 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08031d60 con 0x7fcc18070ff0 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3141331100 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc18070ff0 msgr2=0x7fcc1814aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3141331100 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc18070ff0 0x7fcc1814aa50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009800 tx=0x7fcc0802b930 comp rx=0 tx=0).stop 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3141331100 shutdown_connections 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3141331100 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc18070ff0 0x7fcc1814aa50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3141331100 >> 172.21.15.40:0/3141331100 conn(0x7fcc180be120 msgr2=0x7fcc180be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3141331100 shutdown_connections 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.968+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3141331100 wait complete. 2023-12-20T04:23:38.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 Processor -- start 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 -- start start 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc18070ff0 0x7fcc1814e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc180ba0e0 0x7fcc181e36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcc180ba700 0x7fcc181e1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181e3be0 con 0x7fcc18070ff0 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1814e2a0 con 0x7fcc180ba700 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1cdea640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181e4340 con 0x7fcc180ba0e0 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc18070ff0 0x7fcc1814e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc18070ff0 0x7fcc1814e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48036/0 (socket says 172.21.15.40:48036) 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.970+0000 7fcc1659c640 1 -- 172.21.15.40:0/3013233550 learned_addr learned my addr 172.21.15.40:0/3013233550 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc0ffff640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc180ba0e0 0x7fcc181e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc16d9d640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcc180ba700 0x7fcc181e1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1659c640 1 -- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc180ba0e0 msgr2=0x7fcc181e36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1659c640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc180ba0e0 0x7fcc181e36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1659c640 1 -- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcc180ba700 msgr2=0x7fcc181e1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1659c640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcc180ba700 0x7fcc181e1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1659c640 1 -- 172.21.15.40:0/3013233550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08009400 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc16d9d640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcc180ba700 0x7fcc181e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1659c640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc18070ff0 0x7fcc1814e5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009800 tx=0x7fcc080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc0effd640 1 -- 172.21.15.40:0/3013233550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0803cc00 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc0effd640 1 -- 172.21.15.40:0/3013233550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0803cd60 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc181e3dc0 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc0effd640 1 -- 172.21.15.40:0/3013233550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08004230 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.971+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc181e1870 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.972+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1804e840 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.972+0000 7fcc0effd640 1 -- 172.21.15.40:0/3013233550 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcc08004390 con 0x7fcc18070ff0 2023-12-20T04:23:38.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.973+0000 7fcc0effd640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbf806a430 0x7fcbf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:38.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.973+0000 7fcc0effd640 1 -- 172.21.15.40:0/3013233550 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc080ab520 con 0x7fcc18070ff0 2023-12-20T04:23:38.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.973+0000 7fcc0ffff640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbf806a430 0x7fcbf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:38.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.973+0000 7fcc0ffff640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbf806a430 0x7fcbf806c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc181e3390 tx=0x7fcc00009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:38.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:38.977+0000 7fcc0effd640 1 -- 172.21.15.40:0/3013233550 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcc08076b00 con 0x7fcc18070ff0 2023-12-20T04:23:39.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.189+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc1806acb0 con 0x7fcc18070ff0 2023-12-20T04:23:39.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.190+0000 7fcc0effd640 1 -- 172.21.15.40:0/3013233550 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7fcc0807a120 con 0x7fcc18070ff0 2023-12-20T04:23:39.191 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:39.191 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:39.192 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbf806a430 msgr2=0x7fcbf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbf806a430 0x7fcbf806c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcc181e3390 tx=0x7fcc00009040 comp rx=0 tx=0).stop 2023-12-20T04:23:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc18070ff0 msgr2=0x7fcc1814e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc18070ff0 0x7fcc1814e5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009800 tx=0x7fcc080046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 shutdown_connections 2023-12-20T04:23:39.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbf806a430 0x7fcbf806c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcc180ba700 0x7fcc181e1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcc180ba0e0 0x7fcc181e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 --2- 172.21.15.40:0/3013233550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc18070ff0 0x7fcc1814e5b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 >> 172.21.15.40:0/3013233550 conn(0x7fcc180be120 msgr2=0x7fcc180b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 shutdown_connections 2023-12-20T04:23:39.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.192+0000 7fcc1cdea640 1 -- 172.21.15.40:0/3013233550 wait complete. 2023-12-20T04:23:39.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:23:26.641520+0000', 'modified': '2023-12-20T04:23:29.287785+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.69:6835/2986767777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 2986767777}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 2986767777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:23:39.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:23:39.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-20T04:23:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.615+0000 7f5d5b0ee640 1 Processor -- start 2023-12-20T04:23:39.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.615+0000 7f5d5b0ee640 1 -- start start 2023-12-20T04:23:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d5b0ee640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d540b6970 0x7f5d540b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d5b0ee640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5d540b6d50 0x7f5d540b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d5b0ee640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d540b94a0 con 0x7f5d540b7e20 2023-12-20T04:23:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d5b0ee640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5406a820 con 0x7f5d540b6970 2023-12-20T04:23:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d5b0ee640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d540b96d0 con 0x7f5d540b6d50 2023-12-20T04:23:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d58e8a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5d540b6970 0x7f5d540b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d5968b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5d540b7e20 0x7f5d5406fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48112/0 (socket says 172.21.15.40:48112) 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d5968b640 1 -- 172.21.15.40:0/4044553862 learned_addr learned my addr 172.21.15.40:0/4044553862 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d53fff640 1 --2- 172.21.15.40:0/4044553862 >> v2:172.21.15.69:3300/0 conn(0x7f5d540b6d50 0x7f5d540b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d58e8a640 1 -- 172.21.15.40:0/4044553862 >> v2:172.21.15.69:3300/0 conn(0x7f5d540b6d50 msgr2=0x7f5d540b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/4044553862 >> v2:172.21.15.69:3300/0 conn(0x7f5d540b6d50 0x7f5d540b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d58e8a640 1 -- 172.21.15.40:0/4044553862 >> v1:172.21.15.40:6789/0 conn(0x7f5d540b7e20 legacy=0x7f5d5406fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d537fe640 1 -- 172.21.15.40:0/4044553862 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011425941 0 0) 0x7f5d540b94a0 con 0x7f5d540b7e20 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d58e8a640 1 -- 172.21.15.40:0/4044553862 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5406a390 con 0x7f5d540b6970 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.616+0000 7f5d53fff640 1 --2- 172.21.15.40:0/4044553862 >> v2:172.21.15.69:3300/0 conn(0x7f5d540b6d50 0x7f5d540b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.617+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/4044553862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d540b8f60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097a0 tx=0x7f5d4402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabc4867737d44dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.617+0000 7f5d537fe640 1 -- 172.21.15.40:0/4044553862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44031830 con 0x7f5d540b6970 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.617+0000 7f5d537fe640 1 -- 172.21.15.40:0/4044553862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44031990 con 0x7f5d540b6970 2023-12-20T04:23:39.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.617+0000 7f5d537fe640 1 -- 172.21.15.40:0/4044553862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44031d20 con 0x7f5d540b6970 2023-12-20T04:23:39.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/4044553862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 msgr2=0x7f5d540b8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/4044553862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d540b8f60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d440097a0 tx=0x7f5d4402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/4044553862 shutdown_connections 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/4044553862 >> v2:172.21.15.69:3300/0 conn(0x7f5d540b6d50 0x7f5d540b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/4044553862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d540b8f60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/4044553862 >> 172.21.15.40:0/4044553862 conn(0x7f5d540bcf20 msgr2=0x7f5d540bd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/4044553862 shutdown_connections 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.618+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/4044553862 wait complete. 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.619+0000 7f5d5b0ee640 1 Processor -- start 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.619+0000 7f5d5b0ee640 1 -- start start 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d5b0ee640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d54140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d5b0ee640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d540b6d50 0x7f5d5414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d5b0ee640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5d540b7e20 0x7f5d54147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d5b0ee640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5413f130 con 0x7f5d540b6970 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d5b0ee640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5414e910 con 0x7f5d540b6d50 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d5b0ee640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5413e6f0 con 0x7f5d540b7e20 2023-12-20T04:23:39.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d54140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d54140760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48064/0 (socket says 172.21.15.40:48064) 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 -- 172.21.15.40:0/2022909848 learned_addr learned my addr 172.21.15.40:0/2022909848 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 -- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5d540b7e20 msgr2=0x7f5d54147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d5968b640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5d540b7e20 0x7f5d54147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5d540b7e20 0x7f5d54147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d53fff640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d540b6d50 0x7f5d5414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 -- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d540b6d50 msgr2=0x7f5d5414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d540b6d50 0x7f5d5414e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 -- 172.21.15.40:0/2022909848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d44009400 con 0x7f5d540b6970 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d54140760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000c00 tx=0x7f5d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.620+0000 7f5d517fa640 1 -- 172.21.15.40:0/2022909848 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44004230 con 0x7f5d540b6970 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.621+0000 7f5d517fa640 1 -- 172.21.15.40:0/2022909848 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44004390 con 0x7f5d540b6970 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.621+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d54140db0 con 0x7f5d540b6970 2023-12-20T04:23:39.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.621+0000 7f5d517fa640 1 -- 172.21.15.40:0/2022909848 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4403a920 con 0x7f5d540b6970 2023-12-20T04:23:39.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.621+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5413e380 con 0x7f5d540b6970 2023-12-20T04:23:39.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.622+0000 7f5d517fa640 1 -- 172.21.15.40:0/2022909848 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d4403aa80 con 0x7f5d540b6970 2023-12-20T04:23:39.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.622+0000 7f5d517fa640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5d4006a430 0x7f5d4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.623+0000 7f5d517fa640 1 -- 172.21.15.40:0/2022909848 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d440ab330 con 0x7f5d540b6970 2023-12-20T04:23:39.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.623+0000 7f5d53fff640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5d4006a430 0x7f5d4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.623+0000 7f5d53fff640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5d4006a430 0x7f5d4006c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d541e11b0 tx=0x7f5d48008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.623+0000 7f5d5dc65740 1 Processor -- start 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.623+0000 7f5d5dc65740 1 -- start start 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594d5800 0x565259499bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56525949a100 0x5652594caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652594090b0 con 0x5652594d5800 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565259406840 con 0x56525949a100 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x565259402130 con 0x5652594cb0e0 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594d5800 0x565259499bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594d5800 0x565259499bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48078/0 (socket says 172.21.15.40:48078) 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 -- 172.21.15.40:0/1695867557 learned_addr learned my addr 172.21.15.40:0/1695867557 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d53fff640 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56525949a100 0x5652594caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d5968b640 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 -- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 msgr2=0x5652594cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 -- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56525949a100 msgr2=0x5652594caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56525949a100 0x5652594caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 -- 172.21.15.40:0/1695867557 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652593bcc40 con 0x5652594d5800 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.624+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594d5800 0x565259499bc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d440a9880 tx=0x7f5d4407a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c480cdb8b68689c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d3a7fc640 1 -- 172.21.15.40:0/1695867557 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4408f070 con 0x5652594d5800 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d3a7fc640 1 -- 172.21.15.40:0/1695867557 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d440826e0 con 0x5652594d5800 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d3a7fc640 1 -- 172.21.15.40:0/1695867557 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44078aa0 con 0x5652594d5800 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1695867557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594d5800 msgr2=0x565259499bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594d5800 0x565259499bc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d440a9880 tx=0x7f5d4407a120 comp rx=0 tx=0).stop 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1695867557 shutdown_connections 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56525949a100 0x5652594caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1695867557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594d5800 0x565259499bc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1695867557 >> 172.21.15.40:0/1695867557 conn(0x56525949b5f0 msgr2=0x5652594d4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1695867557 shutdown_connections 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.625+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1695867557 wait complete. 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.626+0000 7f5d5dc65740 1 -- start start 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.626+0000 7f5d5dc65740 1 Processor -- start 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594cb0e0 0x5652594e5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652594c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x5652594e16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652593c0840 con 0x5652594c26f0 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652593c04e0 con 0x5652594cb0e0 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x565259386230 con 0x5652594d5800 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 10 client.0 _ll_register_callbacks cb 0x5652593d76d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x5652594e16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x5652594e16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48080/0 (socket says 172.21.15.40:48080) 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 -- 172.21.15.40:0/2638429270 learned_addr learned my addr 172.21.15.40:0/2638429270 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594cb0e0 0x5652594e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d53fff640 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652594c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 -- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 msgr2=0x5652594c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652594c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 -- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594cb0e0 msgr2=0x5652594e5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594cb0e0 0x5652594e5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 -- 172.21.15.40:0/2638429270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d5413e380 con 0x5652594c26f0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5968b640 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x5652594e16f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c004f30 tx=0x7f5d4c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0433e2e3c453b78 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d337fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d337fe640 1 -- 172.21.15.40:0/2638429270 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4c019070 con 0x5652594c26f0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d337fe640 1 -- 172.21.15.40:0/2638429270 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d4c016720 con 0x5652594c26f0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56525942b970 con 0x5652594c26f0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d337fe640 1 -- 172.21.15.40:0/2638429270 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d4c0168e0 con 0x5652594c26f0 2023-12-20T04:23:39.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 10 client.4656 fetch_fsmap learned FSMap version 7 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.627+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5652594007b0 con 0x5652594c26f0 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d337fe640 1 -- 172.21.15.40:0/2638429270 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4c023020 con 0x5652594c26f0 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d337fe640 1 -- 172.21.15.40:0/2638429270 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f5d4c01c030 con 0x5652594c26f0 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d5dc65740 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d5dc65740 10 client.4656 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d5dc65740 20 client.4656 populate_metadata read hostname 'smithi040' 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x5652594e2100 0x5652594f0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d5dc65740 4 client.4656 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 --> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652593f3f00 con 0x5652594e2100 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x5652594e2100 0x5652594f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x5652594e2100 0x5652594f0340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3e8760b35b8dc1 server_cookie=de25f3c022b76b81 in_seq=0 out_seq=0 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.628+0000 7f5d337fe640 10 client.4656 ms_handle_connect on v2:172.21.15.69:6834/2986767777 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d337fe640 1 -- 172.21.15.40:0/2638429270 <== mds.0 v2:172.21.15.69:6834/2986767777 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5652593f3f00 con 0x5652594e2100 2023-12-20T04:23:39.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d337fe640 10 client.4656 handle_command_reply: tid=0 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 client.4656 shutdown 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 msgr2=0x5652594e16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x5652594e16f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c004f30 tx=0x7f5d4c0074f0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 shutdown_connections 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x5652594e16f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652594c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x5652594e2100 0x5652594f0340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d337fe640 0 client.4656 ms_handle_reset on v2:172.21.15.69:6834/2986767777 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/2638429270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594cb0e0 0x5652594e5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 >> 172.21.15.40:0/2638429270 conn(0x56525949a100 msgr2=0x5652594c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 shutdown_connections 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 1 -- 172.21.15.40:0/2638429270 wait complete. 2023-12-20T04:23:39.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.629+0000 7f5d5dc65740 20 client.4656 trim_cache size 0 max 16384 2023-12-20T04:23:39.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.644+0000 7f5d5dc65740 1 Processor -- start 2023-12-20T04:23:39.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.644+0000 7f5d5dc65740 1 -- start start 2023-12-20T04:23:39.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x565259498470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594989b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594d5800 0x5652594f4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652594dc050 con 0x5652594c26f0 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652594c1d40 con 0x5652594d5800 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652594cc750 con 0x5652594cb0e0 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x565259498470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x565259498470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48082/0 (socket says 172.21.15.40:48082) 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 -- 172.21.15.40:0/720475990 learned_addr learned my addr 172.21.15.40:0/720475990 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d53fff640 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5968b640 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594d5800 0x5652594f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 -- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 msgr2=0x5652594989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 -- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594d5800 msgr2=0x5652594f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594d5800 0x5652594f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 -- 172.21.15.40:0/720475990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54146430 con 0x5652594c26f0 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d5968b640 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594d5800 0x5652594f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x565259498470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d4402b910 tx=0x7f5d4407a190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e5e3542fcb09a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d3affd640 1 -- 172.21.15.40:0/720475990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4408f040 con 0x5652594c26f0 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d3affd640 1 -- 172.21.15.40:0/720475990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44090040 con 0x5652594c26f0 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.645+0000 7f5d3affd640 1 -- 172.21.15.40:0/720475990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4407e530 con 0x5652594c26f0 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 -- 172.21.15.40:0/720475990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 msgr2=0x565259498470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x565259498470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d4402b910 tx=0x7f5d4407a190 comp rx=0 tx=0).stop 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 -- 172.21.15.40:0/720475990 shutdown_connections 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594d5800 0x5652594f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594cb0e0 0x5652594989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/720475990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594c26f0 0x565259498470 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 -- 172.21.15.40:0/720475990 >> 172.21.15.40:0/720475990 conn(0x56525949a100 msgr2=0x565259494880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 -- 172.21.15.40:0/720475990 shutdown_connections 2023-12-20T04:23:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 -- 172.21.15.40:0/720475990 wait complete. 2023-12-20T04:23:39.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.646+0000 7f5d5dc65740 1 -- start start 2023-12-20T04:23:39.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 1 Processor -- start 2023-12-20T04:23:39.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594c26f0 0x56525953c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594cb0e0 0x5652594de860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652595326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652594df270 con 0x5652594cb0e0 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652594f4cb0 con 0x5652594c26f0 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x5652594f4b00 con 0x5652594d5800 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5dc65740 10 client.0 _ll_register_callbacks cb 0x7f5d44004500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594cb0e0 0x5652594de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d53fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594cb0e0 0x5652594de860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48088/0 (socket says 172.21.15.40:48088) 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d53fff640 1 -- 172.21.15.40:0/1578113480 learned_addr learned my addr 172.21.15.40:0/1578113480 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d5968b640 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652595326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.647+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594c26f0 0x56525953c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d53fff640 1 -- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 msgr2=0x5652595326d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d53fff640 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652595326d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d53fff640 1 -- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594c26f0 msgr2=0x56525953c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d53fff640 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594c26f0 0x56525953c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d53fff640 1 -- 172.21.15.40:0/1578113480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652593bcc40 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d53fff640 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594cb0e0 0x5652594de860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d5414f020 tx=0x7f5d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e46e2a9068f262 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d337fe640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d337fe640 1 -- 172.21.15.40:0/1578113480 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800b050 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d337fe640 1 -- 172.21.15.40:0/1578113480 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d48022e20 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d440826e0 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d337fe640 1 -- 172.21.15.40:0/1578113480 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d48012440 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 10 client.4662 fetch_fsmap learned FSMap version 7 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5652593a2be0 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d337fe640 1 -- 172.21.15.40:0/1578113480 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d440826e0 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d337fe640 1 -- 172.21.15.40:0/1578113480 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f5d4802b640 con 0x5652594cb0e0 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 10 client.4662 fetch_fsmap finished waiting for FSMap version 7 2023-12-20T04:23:39.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 20 client.4662 populate_metadata read hostname 'smithi040' 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x565259532db0 0x565259538a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 4 client.4662 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.648+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 --> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5652593fb1b0 con 0x565259532db0 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x565259532db0 0x565259538a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d337fe640 10 client.4662 ms_handle_connect on v2:172.21.15.69:6834/2986767777 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d58e8a640 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x565259532db0 0x565259538a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9be136f74e67872 server_cookie=ab8c2870cf37ff2c in_seq=0 out_seq=0 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d337fe640 1 -- 172.21.15.40:0/1578113480 <== mds.0 v2:172.21.15.69:6834/2986767777 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5652593fb1b0 con 0x565259532db0 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d337fe640 10 client.4662 handle_command_reply: tid=0 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 client.4662 shutdown 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594cb0e0 msgr2=0x5652594de860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594cb0e0 0x5652594de860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5d5414f020 tx=0x7f5d480046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 shutdown_connections 2023-12-20T04:23:39.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x5652594d5800 0x5652595326d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5652594cb0e0 0x5652594de860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:6834/2986767777,v1:172.21.15.69:6835/2986767777] conn(0x565259532db0 0x565259538a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 --2- 172.21.15.40:0/1578113480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5652594c26f0 0x56525953c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d337fe640 0 client.4662 ms_handle_reset on v2:172.21.15.69:6834/2986767777 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 >> 172.21.15.40:0/1578113480 conn(0x56525949a100 msgr2=0x5652594f4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 shutdown_connections 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.649+0000 7f5d5dc65740 1 -- 172.21.15.40:0/1578113480 wait complete. 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5dc65740 20 client.4662 trim_cache size 0 max 16384 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T04:23:39.657 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "9ed6574e-2792-4eae-92b0-945f286f0eed", 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4288, 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 13.006420479000001, 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 7, 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 20, 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 20, 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 19.342219562 2023-12-20T04:23:39.658 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T04:23:39.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5d4006a430 msgr2=0x7f5d4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5d4006a430 0x7f5d4006c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d541e11b0 tx=0x7f5d48008040 comp rx=0 tx=0).stop 2023-12-20T04:23:39.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 msgr2=0x7f5d54140760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d54140760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5d44000c00 tx=0x7f5d440046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 shutdown_connections 2023-12-20T04:23:39.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5d4006a430 0x7f5d4006c8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5d540b7e20 0x7f5d54147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d540b6d50 0x7f5d5414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 --2- 172.21.15.40:0/2022909848 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5d540b6970 0x7f5d54140760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 >> 172.21.15.40:0/2022909848 conn(0x7f5d540bcf20 msgr2=0x7f5d540bd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 shutdown_connections 2023-12-20T04:23:39.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.650+0000 7f5d5b0ee640 1 -- 172.21.15.40:0/2022909848 wait complete. 2023-12-20T04:23:39.661 INFO:teuthology.run_tasks:Running task kclient... 2023-12-20T04:23:39.691 INFO:tasks.kclient:Mounting kernel clients... 2023-12-20T04:23:39.691 INFO:tasks.kclient:config is {'client.0': {}} 2023-12-20T04:23:39.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:39.691 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-20T04:23:39.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:39.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-12-20T04:23:39.852 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-12-20T04:23:39.855 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:23:39.855 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-20T04:23:39.856 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-20T04:23:39.856 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:23:39.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:23:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.962+0000 7f0fc6f3e640 1 Processor -- start 2023-12-20T04:23:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.962+0000 7f0fc6f3e640 1 -- start start 2023-12-20T04:23:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc6f3e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00bcdd0 0x7f0fc00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc6f3e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0fc00b64c0 0x7f0fc0144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc6f3e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00bc6b0 con 0x7f0fc0144cd0 2023-12-20T04:23:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc6f3e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc00b6900 con 0x7f0fc00b64c0 2023-12-20T04:23:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc6f3e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00a59f0 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc4cda640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00bcdd0 0x7f0fc00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fbffff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0fc00b64c0 0x7f0fc0144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc4cda640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00bcdd0 0x7f0fc00b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:45584/0 (socket says 172.21.15.40:45584) 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc4cda640 1 -- 172.21.15.40:0/3466959926 learned_addr learned my addr 172.21.15.40:0/3466959926 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc54db640 1 --1- 172.21.15.40:0/3466959926 >> v1:172.21.15.69:6789/0 conn(0x7f0fc0144cd0 0x7f0fc014e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:49154/0 (socket says 172.21.15.40:49154) 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc4cda640 1 -- 172.21.15.40:0/3466959926 >> v2:172.21.15.69:3300/0 conn(0x7f0fc00b64c0 msgr2=0x7f0fc0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc4cda640 1 --2- 172.21.15.40:0/3466959926 >> v2:172.21.15.69:3300/0 conn(0x7f0fc00b64c0 0x7f0fc0144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc4cda640 1 -- 172.21.15.40:0/3466959926 >> v1:172.21.15.69:6789/0 conn(0x7f0fc0144cd0 legacy=0x7f0fc014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.963+0000 7f0fc4cda640 1 -- 172.21.15.40:0/3466959926 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00bc0a0 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.964+0000 7f0fc4cda640 1 --2- 172.21.15.40:0/3466959926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00bcdd0 0x7f0fc00b5f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009870 tx=0x7f0fb002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ad3d26d2606754 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.964+0000 7f0fbf7fe640 1 -- 172.21.15.40:0/3466959926 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb002f840 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.964+0000 7f0fbf7fe640 1 -- 172.21.15.40:0/3466959926 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb002f9a0 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.964+0000 7f0fbf7fe640 1 -- 172.21.15.40:0/3466959926 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb002fd30 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/3466959926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00bcdd0 msgr2=0x7f0fc00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/3466959926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00bcdd0 0x7f0fc00b5f80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009870 tx=0x7f0fb002ba20 comp rx=0 tx=0).stop 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/3466959926 shutdown_connections 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/3466959926 >> v2:172.21.15.69:3300/0 conn(0x7f0fc00b64c0 0x7f0fc0144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/3466959926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00bcdd0 0x7f0fc00b5f80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/3466959926 >> 172.21.15.40:0/3466959926 conn(0x7f0fc0071e60 msgr2=0x7f0fc00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/3466959926 shutdown_connections 2023-12-20T04:23:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.965+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/3466959926 wait complete. 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.966+0000 7f0fc6f3e640 1 Processor -- start 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.966+0000 7f0fc6f3e640 1 -- start start 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc6f3e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00b64c0 0x7f0fc0099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc6f3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc00bcdd0 0x7f0fc0147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc6f3e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fc0144cd0 0x7f0fc01e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc6f3e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0148470 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc6f3e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc014ac90 con 0x7f0fc0144cd0 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc6f3e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0147aa0 con 0x7f0fc00b64c0 2023-12-20T04:23:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc00bcdd0 0x7f0fc0147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc00bcdd0 0x7f0fc0147f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48094/0 (socket says 172.21.15.40:48094) 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 -- 172.21.15.40:0/1263619593 learned_addr learned my addr 172.21.15.40:0/1263619593 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc54db640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fc0144cd0 0x7f0fc01e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fc4cda640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00b64c0 0x7f0fc0099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 -- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00b64c0 msgr2=0x7f0fc0099cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00b64c0 0x7f0fc0099cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 -- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fc0144cd0 msgr2=0x7f0fc01e02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fc0144cd0 0x7f0fc01e02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 -- 172.21.15.40:0/1263619593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb00094d0 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbffff640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc00bcdd0 0x7f0fc0147f30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400e9b0 tx=0x7f0fb400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.967+0000 7f0fbd7fa640 1 -- 172.21.15.40:0/1263619593 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb4009670 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.968+0000 7f0fbd7fa640 1 -- 172.21.15.40:0/1263619593 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb400c9a0 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.968+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc009a350 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.968+0000 7f0fbd7fa640 1 -- 172.21.15.40:0/1263619593 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400cd50 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.968+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc01dfd80 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.968+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc004e840 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.969+0000 7f0fbd7fa640 1 -- 172.21.15.40:0/1263619593 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fb4013470 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.969+0000 7f0fbd7fa640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fac06a430 0x7f0fac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.969+0000 7f0fbd7fa640 1 -- 172.21.15.40:0/1263619593 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fb4088a60 con 0x7f0fc00bcdd0 2023-12-20T04:23:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.969+0000 7f0fc4cda640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fac06a430 0x7f0fac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.970+0000 7f0fc4cda640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fac06a430 0x7f0fac06c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0036000 tx=0x7f0fb0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:39.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:39.974+0000 7f0fbd7fa640 1 -- 172.21.15.40:0/1263619593 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0fb4054190 con 0x7f0fc00bcdd0 2023-12-20T04:23:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.184+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fc00b50e0 con 0x7f0fc00bcdd0 2023-12-20T04:23:40.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.184+0000 7f0fbd7fa640 1 -- 172.21.15.40:0/1263619593 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fb4017070 con 0x7f0fc00bcdd0 2023-12-20T04:23:40.185 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:23:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.186+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fac06a430 msgr2=0x7f0fac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:40.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.186+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fac06a430 0x7f0fac06c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0036000 tx=0x7f0fb0008030 comp rx=0 tx=0).stop 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.186+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc00bcdd0 msgr2=0x7f0fc0147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.186+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc00bcdd0 0x7f0fc0147f30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400e9b0 tx=0x7f0fb400ee70 comp rx=0 tx=0).stop 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 shutdown_connections 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fac06a430 0x7f0fac06c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fc0144cd0 0x7f0fc01e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fc00bcdd0 0x7f0fc0147f30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 --2- 172.21.15.40:0/1263619593 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fc00b64c0 0x7f0fc0099cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 >> 172.21.15.40:0/1263619593 conn(0x7f0fc0071e60 msgr2=0x7f0fc00b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 shutdown_connections 2023-12-20T04:23:40.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:40.187+0000 7f0fc6f3e640 1 -- 172.21.15.40:0/1263619593 wait complete. 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:23:40.198 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:23:40.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:40.199 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-12-20T04:23:40.258 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:23:40.259 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-12-20T04:23:40.260 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:23:40.261 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-20T04:23:40.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:40.261 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-20T04:23:40.261 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-20T04:23:40.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-12-20T04:23:40.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-12-20T04:23:40.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-12-20T04:23:40.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-20T04:23:40.262 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-20T04:23:40.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:40.716 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:23:40.789 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-12-20T04:23:40.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:40.792 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-12-20T04:23:40.846 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-12-20T04:23:40.846 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:23:40.846 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:23:40.846 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:23:40.846 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:23:40.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:40.847 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-20T04:23:40.847 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-20T04:23:40.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:23:40.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:23:40.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:23:40.847 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-20T04:23:41.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:41.592 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-20T04:23:41.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:41.637 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-12-20T04:23:41.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:41.730 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-20T04:23:41.731 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-20T04:23:41.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:23:41.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-20T04:23:41.731 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-20T04:23:41.855 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-20T04:23:41.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-20T04:23:41.856 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-20T04:23:42.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:42.129 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-20T04:23:42.130 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-20T04:23:42.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-12-20T04:23:42.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-12-20T04:23:42.130 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-20T04:23:42.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:23:42.273 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:23:42.319 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:23:42.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:23:42.320 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:23:42.412 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-20T04:23:42.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:42.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:23:42.562 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:23:42.563 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-20T04:23:42.563 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-20T04:23:43.034 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:23:43.034 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-20T04:23:43.034 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-20T04:23:43.034 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-20T04:23:43.034 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-20T04:23:43.062 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:23:43.062 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-20T04:23:43.062 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-20T04:23:43.062 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-20T04:23:43.063 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-20T04:23:43.063 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.69:6789,172.21.15.69:6790" 2023-12-20T04:23:43.063 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.69:6789,172.21.15.69:6790:/ 2023-12-20T04:23:43.063 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9ed6574e-2792-4eae-92b0-945f286f0eed" will pass to kernel 2023-12-20T04:23:43.065 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-20T04:23:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2023-12-20T04:23:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-20T04:23:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2023-12-20T04:23:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-20T04:23:43.069 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-20T04:23:43.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:43.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:23:43.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:43.152 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-20T04:23:43.214 INFO:teuthology.orchestra.run.smithi081.stdout:client4621 2023-12-20T04:23:43.215 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:23:43.215 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:23:43.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:43.268 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-20T04:23:43.381 INFO:teuthology.orchestra.run.smithi081.stdout:client4621 2023-12-20T04:23:43.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:43.382 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-20T04:23:43.449 INFO:teuthology.orchestra.run.smithi081.stdout:client4621 2023-12-20T04:23:43.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:43.450 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9ed6574e-2792-4eae-92b0-945f286f0eed.client4621/status') 2023-12-20T04:23:43.548 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4621 (3)172.21.15.81:0/3018726216 2023-12-20T04:23:43.549 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2023-12-20T04:23:43.549 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2023-12-20T04:23:43.549 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2023-12-20T04:23:43.549 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 6.5798e-05 s, 1.1 MB/s 2023-12-20T04:23:43.553 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-20T04:23:43.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:43.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.690+0000 7fb635c84640 1 Processor -- start 2023-12-20T04:23:43.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.690+0000 7fb635c84640 1 -- start start 2023-12-20T04:23:43.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.691+0000 7fb635c84640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb6300711c0 0x7fb63014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.691+0000 7fb635c84640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb630070d30 con 0x7fb630069f80 2023-12-20T04:23:43.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.691+0000 7fb635c84640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6300b6f60 con 0x7fb630069ba0 2023-12-20T04:23:43.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.691+0000 7fb635c84640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6300715c0 con 0x7fb6300711c0 2023-12-20T04:23:43.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.691+0000 7fb62ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb630069f80 0x7fb630155380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48116/0 (socket says 172.21.15.40:48116) 2023-12-20T04:23:43.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.691+0000 7fb62ffff640 1 -- 172.21.15.40:0/4083346465 learned_addr learned my addr 172.21.15.40:0/4083346465 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:43.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 --2- 172.21.15.40:0/4083346465 >> v2:172.21.15.69:3300/0 conn(0x7fb6300711c0 0x7fb63014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626491034 0 0) 0x7fb630070d30 con 0x7fb630069f80 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb618003520 con 0x7fb630069f80 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 190207026 0 0) 0x7fb618003520 con 0x7fb630069f80 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 >> v2:172.21.15.69:3300/0 conn(0x7fb6300711c0 msgr2=0x7fb63014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 --2- 172.21.15.40:0/4083346465 >> v2:172.21.15.69:3300/0 conn(0x7fb6300711c0 0x7fb63014aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 >> v1:172.21.15.69:6789/0 conn(0x7fb630069ba0 legacy=0x7fb6300b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630071720 con 0x7fb630069f80 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7fb6280019f0 con 0x7fb630069f80 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 --2- 172.21.15.40:0/4083346465 >> v2:172.21.15.69:3300/0 conn(0x7fb6300711c0 0x7fb63014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 >> v1:172.21.15.40:6789/0 conn(0x7fb630069f80 legacy=0x7fb630155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb618003970 0x7fb618003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb618004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb618005180 0x7fb61800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300715c0 con 0x7fb6180047c0 2023-12-20T04:23:43.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61800c030 con 0x7fb618005180 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61800c1f0 con 0x7fb618003970 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb618004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62f7fe640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb618003970 0x7fb618003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62ffff640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb618005180 0x7fb61800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 -- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb618003970 msgr2=0x7fb618003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb618003970 0x7fb618003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 -- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb618005180 msgr2=0x7fb61800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb618005180 0x7fb61800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62effd640 1 -- 172.21.15.40:0/4083346465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618003520 con 0x7fb6180047c0 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.692+0000 7fb62ffff640 1 -- 172.21.15.40:0/4083346465 reap_dead start 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.693+0000 7fb62effd640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb618004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb624009c90 tx=0x7fb6180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8d009c9e15f614 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.693+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62402c8f0 con 0x7fb6180047c0 2023-12-20T04:23:43.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.693+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62402ca50 con 0x7fb6180047c0 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.693+0000 7fb62e7fc640 1 -- 172.21.15.40:0/4083346465 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62402ce40 con 0x7fb6180047c0 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.694+0000 7fb635c84640 1 -- 172.21.15.40:0/4083346465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 msgr2=0x7fb618004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.694+0000 7fb635c84640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb618004c40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb624009c90 tx=0x7fb6180057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.694+0000 7fb635c84640 1 -- 172.21.15.40:0/4083346465 shutdown_connections 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.694+0000 7fb635c84640 1 --2- 172.21.15.40:0/4083346465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb618004c40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.694+0000 7fb635c84640 1 -- 172.21.15.40:0/4083346465 >> 172.21.15.40:0/4083346465 conn(0x7fb6300b9c30 msgr2=0x7fb6300ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.694+0000 7fb635c84640 1 -- 172.21.15.40:0/4083346465 shutdown_connections 2023-12-20T04:23:43.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.694+0000 7fb635c84640 1 -- 172.21.15.40:0/4083346465 wait complete. 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.695+0000 7fb635c84640 1 Processor -- start 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.695+0000 7fb635c84640 1 -- start start 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb635c84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb63014e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb635c84640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6300ac1b0 0x7fb6300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb635c84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb6300b5410 0x7fb63014cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb635c84640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63014eb10 con 0x7fb6180047c0 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb635c84640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6300b5890 con 0x7fb6300ac1b0 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb635c84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301e0e20 con 0x7fb6300b5410 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb63014e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb63014e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48110/0 (socket says 172.21.15.40:48110) 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 -- 172.21.15.40:0/543337218 learned_addr learned my addr 172.21.15.40:0/543337218 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:43.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62effd640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6300ac1b0 0x7fb6300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62ffff640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb6300b5410 0x7fb63014cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 -- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb6300b5410 msgr2=0x7fb63014cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb6300b5410 0x7fb63014cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 -- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6300ac1b0 msgr2=0x7fb6300b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6300ac1b0 0x7fb6300b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62f7fe640 1 -- 172.21.15.40:0/543337218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300ac690 con 0x7fb6180047c0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.696+0000 7fb62ffff640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb6300b5410 0x7fb63014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.697+0000 7fb62f7fe640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb63014e5d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb62000f620 tx=0x7fb62000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.697+0000 7fb617fff640 1 -- 172.21.15.40:0/543337218 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200052e0 con 0x7fb6180047c0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.697+0000 7fb617fff640 1 -- 172.21.15.40:0/543337218 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb620005440 con 0x7fb6180047c0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.697+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6301e0580 con 0x7fb6180047c0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.697+0000 7fb617fff640 1 -- 172.21.15.40:0/543337218 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620003810 con 0x7fb6180047c0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.697+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6301e0b40 con 0x7fb6180047c0 2023-12-20T04:23:43.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.698+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63004e840 con 0x7fb6180047c0 2023-12-20T04:23:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.698+0000 7fb617fff640 1 -- 172.21.15.40:0/543337218 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb620003970 con 0x7fb6180047c0 2023-12-20T04:23:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.699+0000 7fb617fff640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb61c06a430 0x7fb61c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.699+0000 7fb617fff640 1 -- 172.21.15.40:0/543337218 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb620088720 con 0x7fb6180047c0 2023-12-20T04:23:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.699+0000 7fb62effd640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb61c06a430 0x7fb61c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.700+0000 7fb62effd640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb61c06a430 0x7fb61c06c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb624036000 tx=0x7fb624030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:43.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.703+0000 7fb617fff640 1 -- 172.21.15.40:0/543337218 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb620053d10 con 0x7fb6180047c0 2023-12-20T04:23:43.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.878+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb63014ee90 con 0x7fb6180047c0 2023-12-20T04:23:43.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.880+0000 7fb617fff640 1 -- 172.21.15.40:0/543337218 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fb620057330 con 0x7fb6180047c0 2023-12-20T04:23:43.880 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:43.880 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:43.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb61c06a430 msgr2=0x7fb61c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:43.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb61c06a430 0x7fb61c06c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb624036000 tx=0x7fb624030000 comp rx=0 tx=0).stop 2023-12-20T04:23:43.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 msgr2=0x7fb63014e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb63014e5d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb62000f620 tx=0x7fb62000fae0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 shutdown_connections 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb61c06a430 0x7fb61c06c8f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb6300b5410 0x7fb63014cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb6300ac1b0 0x7fb6300b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 --2- 172.21.15.40:0/543337218 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6180047c0 0x7fb63014e5d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.881+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 >> 172.21.15.40:0/543337218 conn(0x7fb6300b9c30 msgr2=0x7fb6300bae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.882+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 shutdown_connections 2023-12-20T04:23:43.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:43.882+0000 7fb635c84640 1 -- 172.21.15.40:0/543337218 wait complete. 2023-12-20T04:23:43.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:43.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:44.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.002+0000 7f5c00ea0640 1 Processor -- start 2023-12-20T04:23:44.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.002+0000 7f5c00ea0640 1 -- start start 2023-12-20T04:23:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.002+0000 7f5c00ea0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.002+0000 7f5c00ea0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bfc06a950 0x7f5bfc0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.002+0000 7f5c00ea0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc0bfa50 con 0x7f5bfc0bee00 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.002+0000 7f5c00ea0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bfc0bbda0 con 0x7f5bfc06a950 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.002+0000 7f5c00ea0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc06b040 con 0x7f5bfc0bb140 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bf9d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bfc06a950 0x7f5bfc0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bf9d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5bfc06a950 0x7f5bfc0bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48112/0 (socket says 172.21.15.40:48112) 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bf9d9b640 1 -- 172.21.15.40:0/363154046 learned_addr learned my addr 172.21.15.40:0/363154046 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bfa59c640 1 --2- 172.21.15.40:0/363154046 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bf9d9b640 1 -- 172.21.15.40:0/363154046 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 msgr2=0x7f5bfc0be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bf9d9b640 1 --2- 172.21.15.40:0/363154046 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bf9d9b640 1 -- 172.21.15.40:0/363154046 >> v1:172.21.15.69:6789/0 conn(0x7f5bfc0bee00 legacy=0x7f5bfc14e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.003+0000 7f5bf9d9b640 1 -- 172.21.15.40:0/363154046 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc0bb520 con 0x7f5bfc06a950 2023-12-20T04:23:44.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5bf9d9b640 1 --2- 172.21.15.40:0/363154046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc0bfee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009870 tx=0x7f5bf002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc778c84277e5b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5bf959a640 1 -- 172.21.15.40:0/363154046 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0031640 con 0x7f5bfc06a950 2023-12-20T04:23:44.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5bf959a640 1 -- 172.21.15.40:0/363154046 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf00317a0 con 0x7f5bfc06a950 2023-12-20T04:23:44.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5bf959a640 1 -- 172.21.15.40:0/363154046 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0031b30 con 0x7f5bfc06a950 2023-12-20T04:23:44.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 -- 172.21.15.40:0/363154046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 msgr2=0x7f5bfc0bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/363154046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc0bfee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009870 tx=0x7f5bf002b8f0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 -- 172.21.15.40:0/363154046 shutdown_connections 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/363154046 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc0bfee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/363154046 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 -- 172.21.15.40:0/363154046 >> 172.21.15.40:0/363154046 conn(0x7f5bfc0bcfd0 msgr2=0x7f5bfc0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 -- 172.21.15.40:0/363154046 shutdown_connections 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.004+0000 7f5c00ea0640 1 -- 172.21.15.40:0/363154046 wait complete. 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 Processor -- start 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 -- start start 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bfc0bee00 0x7f5bfc0a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc1447e0 con 0x7f5bfc06a950 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc144ac0 con 0x7f5bfc0bee00 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5c00ea0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc144220 con 0x7f5bfc0bb140 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5bfa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5bfa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48114/0 (socket says 172.21.15.40:48114) 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5bfa59c640 1 -- 172.21.15.40:0/860342052 learned_addr learned my addr 172.21.15.40:0/860342052 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5bfad9d640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bfc0bee00 0x7f5bfc0a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.006+0000 7f5bf9d9b640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5bfa59c640 1 -- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 msgr2=0x7f5bfc0a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5bfa59c640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5bfa59c640 1 -- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bfc0bee00 msgr2=0x7f5bfc0a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5bfa59c640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bfc0bee00 0x7f5bfc0a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5bfa59c640 1 -- 172.21.15.40:0/860342052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00094d0 con 0x7f5bfc06a950 2023-12-20T04:23:44.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5bf9d9b640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5bfa59c640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc142670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00d5f0 tx=0x7f5bec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5beaffd640 1 -- 172.21.15.40:0/860342052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0125f0 con 0x7f5bfc06a950 2023-12-20T04:23:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5beaffd640 1 -- 172.21.15.40:0/860342052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec012750 con 0x7f5bfc06a950 2023-12-20T04:23:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5beaffd640 1 -- 172.21.15.40:0/860342052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec012b00 con 0x7f5bfc06a950 2023-12-20T04:23:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc143e20 con 0x7f5bfc06a950 2023-12-20T04:23:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.007+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bfc143240 con 0x7f5bfc06a950 2023-12-20T04:23:44.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.008+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc144640 con 0x7f5bfc06a950 2023-12-20T04:23:44.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.008+0000 7f5beaffd640 1 -- 172.21.15.40:0/860342052 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5bec012c60 con 0x7f5bfc06a950 2023-12-20T04:23:44.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.009+0000 7f5beaffd640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5bdc06a460 0x7f5bdc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.009+0000 7f5beaffd640 1 -- 172.21.15.40:0/860342052 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bec088d00 con 0x7f5bfc06a950 2023-12-20T04:23:44.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.009+0000 7f5bf9d9b640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5bdc06a460 0x7f5bdc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.009+0000 7f5bf9d9b640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5bdc06a460 0x7f5bdc06c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0036000 tx=0x7f5bf003c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.013+0000 7f5beaffd640 1 -- 172.21.15.40:0/860342052 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5bfc144640 con 0x7f5bfc06a950 2023-12-20T04:23:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.186+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bfc144640 con 0x7f5bfc06a950 2023-12-20T04:23:44.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.187+0000 7f5beaffd640 1 -- 172.21.15.40:0/860342052 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bfc144640 con 0x7f5bfc06a950 2023-12-20T04:23:44.188 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5bdc06a460 msgr2=0x7f5bdc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5bdc06a460 0x7f5bdc06c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0036000 tx=0x7f5bf003c040 comp rx=0 tx=0).stop 2023-12-20T04:23:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 msgr2=0x7f5bfc142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc142670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00d5f0 tx=0x7f5bec00dab0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 shutdown_connections 2023-12-20T04:23:44.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5bdc06a460 0x7f5bdc06c920 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bfc0bee00 0x7f5bfc0a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5bfc0bb140 0x7f5bfc0a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 --2- 172.21.15.40:0/860342052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5bfc06a950 0x7f5bfc142670 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 >> 172.21.15.40:0/860342052 conn(0x7f5bfc0bcfd0 msgr2=0x7f5bfc0a34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 shutdown_connections 2023-12-20T04:23:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.189+0000 7f5c00ea0640 1 -- 172.21.15.40:0/860342052 wait complete. 2023-12-20T04:23:44.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:44.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.308+0000 7fd1b8dd9640 1 Processor -- start 2023-12-20T04:23:44.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.308+0000 7fd1b8dd9640 1 -- start start 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b8dd9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069ba0 0x7fd1b414af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b8dd9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1b406d950 0x7fd1b414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b8dd9640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1b4069f80 0x7fd1b414e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b8dd9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b406fe40 con 0x7fd1b406d950 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b8dd9640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40700b0 con 0x7fd1b4069f80 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b8dd9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4070390 con 0x7fd1b4069ba0 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1b406d950 0x7fd1b414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1b406d950 0x7fd1b414b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48118/0 (socket says 172.21.15.40:48118) 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 -- 172.21.15.40:0/1933769133 learned_addr learned my addr 172.21.15.40:0/1933769133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b259c640 1 --2- 172.21.15.40:0/1933769133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069ba0 0x7fd1b414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b2d9d640 1 --2- 172.21.15.40:0/1933769133 >> v2:172.21.15.69:3300/0 conn(0x7fd1b4069f80 0x7fd1b414e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 -- 172.21.15.40:0/1933769133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069ba0 msgr2=0x7fd1b414af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 --2- 172.21.15.40:0/1933769133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069ba0 0x7fd1b414af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 -- 172.21.15.40:0/1933769133 >> v2:172.21.15.69:3300/0 conn(0x7fd1b4069f80 msgr2=0x7fd1b414e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 --2- 172.21.15.40:0/1933769133 >> v2:172.21.15.69:3300/0 conn(0x7fd1b4069f80 0x7fd1b414e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b1d9b640 1 -- 172.21.15.40:0/1933769133 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40717e0 con 0x7fd1b406d950 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.309+0000 7fd1b2d9d640 1 --2- 172.21.15.40:0/1933769133 >> v2:172.21.15.69:3300/0 conn(0x7fd1b4069f80 0x7fd1b414e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.310+0000 7fd1b1d9b640 1 --2- 172.21.15.40:0/1933769133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b414b4a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1b414f220 tx=0x7fd1a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d357d321087053d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.310+0000 7fd1b159a640 1 -- 172.21.15.40:0/1933769133 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a80317e0 con 0x7fd1b406d950 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.310+0000 7fd1b159a640 1 -- 172.21.15.40:0/1933769133 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a8031940 con 0x7fd1b406d950 2023-12-20T04:23:44.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.310+0000 7fd1b159a640 1 -- 172.21.15.40:0/1933769133 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8031cd0 con 0x7fd1b406d950 2023-12-20T04:23:44.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/1933769133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 msgr2=0x7fd1b414b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/1933769133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b414b4a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1b414f220 tx=0x7fd1a802b880 comp rx=0 tx=0).stop 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/1933769133 shutdown_connections 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/1933769133 >> v2:172.21.15.69:3300/0 conn(0x7fd1b4069f80 0x7fd1b414e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/1933769133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b414b4a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/1933769133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069ba0 0x7fd1b414af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/1933769133 >> 172.21.15.40:0/1933769133 conn(0x7fd1b40b9b50 msgr2=0x7fd1b40b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/1933769133 shutdown_connections 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.311+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/1933769133 wait complete. 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.312+0000 7fd1b8dd9640 1 Processor -- start 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.312+0000 7fd1b8dd9640 1 -- start start 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b8dd9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1b4069ba0 0x7fd1b413d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b8dd9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069f80 0x7fd1b40b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b8dd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b41e4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b8dd9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b40b3e40 con 0x7fd1b406d950 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b8dd9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b41e3ce0 con 0x7fd1b4069ba0 2023-12-20T04:23:44.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b8dd9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b409fca0 con 0x7fd1b4069f80 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b41e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b41e4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48132/0 (socket says 172.21.15.40:48132) 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 -- 172.21.15.40:0/2540546023 learned_addr learned my addr 172.21.15.40:0/2540546023 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b259c640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1b4069ba0 0x7fd1b413d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b1d9b640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069f80 0x7fd1b40b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 -- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069f80 msgr2=0x7fd1b40b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069f80 0x7fd1b40b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 -- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1b4069ba0 msgr2=0x7fd1b413d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1b4069ba0 0x7fd1b413d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 -- 172.21.15.40:0/2540546023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80094d0 con 0x7fd1b406d950 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.313+0000 7fd1b2d9d640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b41e4170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400cef0 tx=0x7fd1a400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.314+0000 7fd1a2ffd640 1 -- 172.21.15.40:0/2540546023 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400d840 con 0x7fd1b406d950 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.314+0000 7fd1a2ffd640 1 -- 172.21.15.40:0/2540546023 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a400d9c0 con 0x7fd1b406d950 2023-12-20T04:23:44.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.314+0000 7fd1a2ffd640 1 -- 172.21.15.40:0/2540546023 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a400dd70 con 0x7fd1b406d950 2023-12-20T04:23:44.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.314+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b413dab0 con 0x7fd1b406d950 2023-12-20T04:23:44.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.314+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b41e3970 con 0x7fd1b406d950 2023-12-20T04:23:44.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.315+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b41e3e50 con 0x7fd1b406d950 2023-12-20T04:23:44.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.315+0000 7fd1a2ffd640 1 -- 172.21.15.40:0/2540546023 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1a401e3b0 con 0x7fd1b406d950 2023-12-20T04:23:44.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.315+0000 7fd1a2ffd640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd19406a460 0x7fd19406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.316+0000 7fd1a2ffd640 1 -- 172.21.15.40:0/2540546023 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1a40892f0 con 0x7fd1b406d950 2023-12-20T04:23:44.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.316+0000 7fd1b259c640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd19406a460 0x7fd19406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.316+0000 7fd1b259c640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd19406a460 0x7fd19406c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00aaf0 tx=0x7fd1ac008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.320+0000 7fd1a2ffd640 1 -- 172.21.15.40:0/2540546023 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd1a4054a50 con 0x7fd1b406d950 2023-12-20T04:23:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.500+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1b40740a0 con 0x7fd1b406d950 2023-12-20T04:23:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.500+0000 7fd1a2ffd640 1 -- 172.21.15.40:0/2540546023 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd1a4058070 con 0x7fd1b406d950 2023-12-20T04:23:44.501 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd19406a460 msgr2=0x7fd19406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd19406a460 0x7fd19406c920 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00aaf0 tx=0x7fd1ac008040 comp rx=0 tx=0).stop 2023-12-20T04:23:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 msgr2=0x7fd1b41e4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b41e4170 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1a400cef0 tx=0x7fd1a400a710 comp rx=0 tx=0).stop 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 shutdown_connections 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd19406a460 0x7fd19406c920 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1b406d950 0x7fd1b41e4170 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1b4069f80 0x7fd1b40b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 --2- 172.21.15.40:0/2540546023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1b4069ba0 0x7fd1b413d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 >> 172.21.15.40:0/2540546023 conn(0x7fd1b40b9b50 msgr2=0x7fd1b40b7950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 shutdown_connections 2023-12-20T04:23:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.502+0000 7fd1b8dd9640 1 -- 172.21.15.40:0/2540546023 wait complete. 2023-12-20T04:23:44.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:44.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.621+0000 7fef4605f640 1 Processor -- start 2023-12-20T04:23:44.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.621+0000 7fef4605f640 1 -- start start 2023-12-20T04:23:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef4605f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef400b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef4605f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef40144890 0x7fef401552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef4605f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef400b85d0 con 0x7fef400bc540 2023-12-20T04:23:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef4605f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400ba780 con 0x7fef40144890 2023-12-20T04:23:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef4605f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef400b99d0 con 0x7fef400bcf40 2023-12-20T04:23:44.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef3ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fef40144890 0x7fef401552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef3effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fef400bc540 0x7fef4014a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48118/0 (socket says 172.21.15.40:48118) 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.622+0000 7fef3effd640 1 -- 172.21.15.40:0/1877083517 learned_addr learned my addr 172.21.15.40:0/1877083517 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3f7fe640 1 --2- 172.21.15.40:0/1877083517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef400b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3ffff640 1 -- 172.21.15.40:0/1877083517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 msgr2=0x7fef400b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3ffff640 1 --2- 172.21.15.40:0/1877083517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef400b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3ffff640 1 -- 172.21.15.40:0/1877083517 >> v1:172.21.15.40:6789/0 conn(0x7fef400bc540 legacy=0x7fef4014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3ffff640 1 -- 172.21.15.40:0/1877083517 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400b9b90 con 0x7fef40144890 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3e7fc640 1 -- 172.21.15.40:0/1877083517 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724263507 0 0) 0x7fef400b85d0 con 0x7fef400bc540 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3f7fe640 1 --2- 172.21.15.40:0/1877083517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef400b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3ffff640 1 --2- 172.21.15.40:0/1877083517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40144890 0x7fef401552b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef38009d90 tx=0x7fef3802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578273690cc8084 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.623+0000 7fef3e7fc640 1 -- 172.21.15.40:0/1877083517 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3802cc50 con 0x7fef40144890 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef3e7fc640 1 -- 172.21.15.40:0/1877083517 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3802cdb0 con 0x7fef40144890 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef3e7fc640 1 -- 172.21.15.40:0/1877083517 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef38034660 con 0x7fef40144890 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 -- 172.21.15.40:0/1877083517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40144890 msgr2=0x7fef401552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 --2- 172.21.15.40:0/1877083517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40144890 0x7fef401552b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef38009d90 tx=0x7fef3802bea0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 -- 172.21.15.40:0/1877083517 shutdown_connections 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 --2- 172.21.15.40:0/1877083517 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef40144890 0x7fef401552b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 --2- 172.21.15.40:0/1877083517 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef400b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 -- 172.21.15.40:0/1877083517 >> 172.21.15.40:0/1877083517 conn(0x7fef400c02f0 msgr2=0x7fef400c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 -- 172.21.15.40:0/1877083517 shutdown_connections 2023-12-20T04:23:44.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.624+0000 7fef4605f640 1 -- 172.21.15.40:0/1877083517 wait complete. 2023-12-20T04:23:44.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.625+0000 7fef4605f640 1 Processor -- start 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.625+0000 7fef4605f640 1 -- start start 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef4605f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400bc540 0x7fef4013cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef4605f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef40144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef4605f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef40144890 0x7fef40145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef4605f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4013d490 con 0x7fef400bc540 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef4605f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef401481d0 con 0x7fef40144890 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef4605f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef40146c90 con 0x7fef400bcf40 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400bc540 0x7fef4013cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400bc540 0x7fef4013cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48162/0 (socket says 172.21.15.40:48162) 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 -- 172.21.15.40:0/2178918341 learned_addr learned my addr 172.21.15.40:0/2178918341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 -- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 msgr2=0x7fef40144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef40144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 -- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef40144890 msgr2=0x7fef40145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef40144890 0x7fef40145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 -- 172.21.15.40:0/2178918341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef38009a70 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.626+0000 7fef3f7fe640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400bc540 0x7fef4013cf50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c7f0 tx=0x7fef3000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.627+0000 7fef27fff640 1 -- 172.21.15.40:0/2178918341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30007a30 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.627+0000 7fef27fff640 1 -- 172.21.15.40:0/2178918341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30007b90 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.627+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef401467f0 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.627+0000 7fef27fff640 1 -- 172.21.15.40:0/2178918341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000ce40 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.627+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef40147150 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.628+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef40146f90 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.628+0000 7fef27fff640 1 -- 172.21.15.40:0/2178918341 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fef300113f0 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.628+0000 7fef27fff640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fef2c06a430 0x7fef2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.629+0000 7fef27fff640 1 -- 172.21.15.40:0/2178918341 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef30088aa0 con 0x7fef400bc540 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.629+0000 7fef3effd640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fef2c06a430 0x7fef2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.629+0000 7fef3effd640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fef2c06a430 0x7fef2c06c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef34007fd0 tx=0x7fef34007920 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.633+0000 7fef27fff640 1 -- 172.21.15.40:0/2178918341 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fef30054080 con 0x7fef400bc540 2023-12-20T04:23:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.811+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef40147370 con 0x7fef400bc540 2023-12-20T04:23:44.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.812+0000 7fef27fff640 1 -- 172.21.15.40:0/2178918341 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef3001f0a0 con 0x7fef400bc540 2023-12-20T04:23:44.813 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fef2c06a430 msgr2=0x7fef2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fef2c06a430 0x7fef2c06c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef34007fd0 tx=0x7fef34007920 comp rx=0 tx=0).stop 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400bc540 msgr2=0x7fef4013cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400bc540 0x7fef4013cf50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c7f0 tx=0x7fef3000cbf0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 shutdown_connections 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fef2c06a430 0x7fef2c06c8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef40144890 0x7fef40145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fef400bcf40 0x7fef40144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 --2- 172.21.15.40:0/2178918341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fef400bc540 0x7fef4013cf50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 >> 172.21.15.40:0/2178918341 conn(0x7fef400c02f0 msgr2=0x7fef40142570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 shutdown_connections 2023-12-20T04:23:44.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.814+0000 7fef4605f640 1 -- 172.21.15.40:0/2178918341 wait complete. 2023-12-20T04:23:44.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:44.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.930+0000 7f0e3b273640 1 Processor -- start 2023-12-20T04:23:44.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.930+0000 7f0e3b273640 1 -- start start 2023-12-20T04:23:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e3b273640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e34070ff0 0x7f0e3414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e3b273640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0e340ba0e0 0x7f0e340b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e3b273640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3414af90 con 0x7f0e340b7d60 2023-12-20T04:23:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e3b273640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e340b8630 con 0x7f0e34070ff0 2023-12-20T04:23:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e3b273640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3406b090 con 0x7f0e340ba0e0 2023-12-20T04:23:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e3900f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e34070ff0 0x7f0e3414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e39810640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0e340b7d60 0x7f0e3414e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:48130/0 (socket says 172.21.15.40:48130) 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e39810640 1 -- 172.21.15.40:0/1502442862 learned_addr learned my addr 172.21.15.40:0/1502442862 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.931+0000 7f0e3880e640 1 --2- 172.21.15.40:0/1502442862 >> v2:172.21.15.69:3300/0 conn(0x7f0e340ba0e0 0x7f0e340b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.932+0000 7f0e3900f640 1 -- 172.21.15.40:0/1502442862 >> v2:172.21.15.69:3300/0 conn(0x7f0e340ba0e0 msgr2=0x7f0e340b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.932+0000 7f0e3900f640 1 --2- 172.21.15.40:0/1502442862 >> v2:172.21.15.69:3300/0 conn(0x7f0e340ba0e0 0x7f0e340b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.932+0000 7f0e3900f640 1 -- 172.21.15.40:0/1502442862 >> v1:172.21.15.40:6789/0 conn(0x7f0e340b7d60 legacy=0x7f0e3414e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.932+0000 7f0e2bfff640 1 -- 172.21.15.40:0/1502442862 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035066988 0 0) 0x7f0e3414af90 con 0x7f0e340b7d60 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.932+0000 7f0e3900f640 1 -- 172.21.15.40:0/1502442862 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34071d10 con 0x7f0e34070ff0 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.932+0000 7f0e3900f640 1 --2- 172.21.15.40:0/1502442862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e34070ff0 0x7f0e3414aa50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e3406c590 tx=0x7f0e2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae456a70e58b579d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.932+0000 7f0e2bfff640 1 -- 172.21.15.40:0/1502442862 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c02e070 con 0x7f0e34070ff0 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e2bfff640 1 -- 172.21.15.40:0/1502442862 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c0315a0 con 0x7f0e34070ff0 2023-12-20T04:23:44.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e2bfff640 1 -- 172.21.15.40:0/1502442862 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c031930 con 0x7f0e34070ff0 2023-12-20T04:23:44.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 -- 172.21.15.40:0/1502442862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e34070ff0 msgr2=0x7f0e3414aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 --2- 172.21.15.40:0/1502442862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e34070ff0 0x7f0e3414aa50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e3406c590 tx=0x7f0e2c02b840 comp rx=0 tx=0).stop 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 -- 172.21.15.40:0/1502442862 shutdown_connections 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 --2- 172.21.15.40:0/1502442862 >> v2:172.21.15.69:3300/0 conn(0x7f0e340ba0e0 0x7f0e340b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 --2- 172.21.15.40:0/1502442862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e34070ff0 0x7f0e3414aa50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 -- 172.21.15.40:0/1502442862 >> 172.21.15.40:0/1502442862 conn(0x7f0e340be120 msgr2=0x7f0e340be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 -- 172.21.15.40:0/1502442862 shutdown_connections 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.933+0000 7f0e3b273640 1 -- 172.21.15.40:0/1502442862 wait complete. 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.934+0000 7f0e3b273640 1 Processor -- start 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.934+0000 7f0e3b273640 1 -- start start 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3b273640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0e34070ff0 0x7f0e3414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3b273640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e340b7d60 0x7f0e341459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3b273640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e340ba0e0 0x7f0e34145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3b273640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e341481a0 con 0x7f0e340ba0e0 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3b273640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3414c450 con 0x7f0e340b7d60 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3b273640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3414c730 con 0x7f0e34070ff0 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e340ba0e0 0x7f0e34145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e340ba0e0 0x7f0e34145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48188/0 (socket says 172.21.15.40:48188) 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 -- 172.21.15.40:0/3241582126 learned_addr learned my addr 172.21.15.40:0/3241582126 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3880e640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e340b7d60 0x7f0e341459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3900f640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0e34070ff0 0x7f0e3414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 -- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0e34070ff0 msgr2=0x7f0e3414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0e34070ff0 0x7f0e3414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 -- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e340b7d60 msgr2=0x7f0e341459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e340b7d60 0x7f0e341459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:44.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 -- 172.21.15.40:0/3241582126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c009400 con 0x7f0e340ba0e0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e3900f640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0e34070ff0 0x7f0e3414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.935+0000 7f0e39810640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e340ba0e0 0x7f0e34145f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c780 tx=0x7f0e3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.936+0000 7f0e29ffb640 1 -- 172.21.15.40:0/3241582126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000ce90 con 0x7f0e340ba0e0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.936+0000 7f0e29ffb640 1 -- 172.21.15.40:0/3241582126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000a640 con 0x7f0e340ba0e0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.936+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3414ca10 con 0x7f0e340ba0e0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.936+0000 7f0e29ffb640 1 -- 172.21.15.40:0/3241582126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000aa70 con 0x7f0e340ba0e0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.936+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e341474d0 con 0x7f0e340ba0e0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.937+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e340b7290 con 0x7f0e340ba0e0 2023-12-20T04:23:44.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.937+0000 7f0e29ffb640 1 -- 172.21.15.40:0/3241582126 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e3000abd0 con 0x7f0e340ba0e0 2023-12-20T04:23:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.937+0000 7f0e29ffb640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0e1806a430 0x7f0e1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.937+0000 7f0e29ffb640 1 -- 172.21.15.40:0/3241582126 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e30088100 con 0x7f0e340ba0e0 2023-12-20T04:23:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.938+0000 7f0e3900f640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0e1806a430 0x7f0e1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:44.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.938+0000 7f0e3900f640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0e1806a430 0x7f0e1806c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c036000 tx=0x7f0e2c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:44.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:44.942+0000 7f0e29ffb640 1 -- 172.21.15.40:0/3241582126 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0e300536f0 con 0x7f0e340ba0e0 2023-12-20T04:23:45.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.118+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e34071750 con 0x7f0e340ba0e0 2023-12-20T04:23:45.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.119+0000 7f0e29ffb640 1 -- 172.21.15.40:0/3241582126 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f0e30056d10 con 0x7f0e340ba0e0 2023-12-20T04:23:45.120 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:45.120 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:45.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0e1806a430 msgr2=0x7f0e1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0e1806a430 0x7f0e1806c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c036000 tx=0x7f0e2c008030 comp rx=0 tx=0).stop 2023-12-20T04:23:45.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e340ba0e0 msgr2=0x7f0e34145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e340ba0e0 0x7f0e34145f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000c780 tx=0x7f0e3000cc40 comp rx=0 tx=0).stop 2023-12-20T04:23:45.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 shutdown_connections 2023-12-20T04:23:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0e1806a430 0x7f0e1806c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e340ba0e0 0x7f0e34145f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0e340b7d60 0x7f0e341459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 --2- 172.21.15.40:0/3241582126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0e34070ff0 0x7f0e3414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 >> 172.21.15.40:0/3241582126 conn(0x7f0e340be120 msgr2=0x7f0e340b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 shutdown_connections 2023-12-20T04:23:45.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.121+0000 7f0e3b273640 1 -- 172.21.15.40:0/3241582126 wait complete. 2023-12-20T04:23:45.132 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:45.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:45.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.241+0000 7ffa3e569640 1 Processor -- start 2023-12-20T04:23:45.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.241+0000 7ffa3e569640 1 -- start start 2023-12-20T04:23:45.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.241+0000 7ffa3e569640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa380bf510 0x7ffa380be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.241+0000 7ffa3e569640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffa3806a950 0x7ffa380bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa3e569640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380bfa50 con 0x7ffa380bb140 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa3e569640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380bbda0 con 0x7ffa380bf510 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa3e569640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3806b040 con 0x7ffa3806a950 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa380bf510 0x7ffa380be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa377fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa380bf510 0x7ffa380be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48202/0 (socket says 172.21.15.40:48202) 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa377fe640 1 -- 172.21.15.40:0/974206993 learned_addr learned my addr 172.21.15.40:0/974206993 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa3cb06640 1 --2- 172.21.15.40:0/974206993 >> v2:172.21.15.69:3300/0 conn(0x7ffa3806a950 0x7ffa380bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa377fe640 1 -- 172.21.15.40:0/974206993 >> v2:172.21.15.69:3300/0 conn(0x7ffa3806a950 msgr2=0x7ffa380bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa377fe640 1 --2- 172.21.15.40:0/974206993 >> v2:172.21.15.69:3300/0 conn(0x7ffa3806a950 0x7ffa380bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa377fe640 1 -- 172.21.15.40:0/974206993 >> v1:172.21.15.69:6789/0 conn(0x7ffa380bb140 legacy=0x7ffa380bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.242+0000 7ffa377fe640 1 -- 172.21.15.40:0/974206993 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380bb520 con 0x7ffa380bf510 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa377fe640 1 --2- 172.21.15.40:0/974206993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380be350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffa380bf9c0 tx=0x7ffa2c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bf5bad693d01e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa36ffd640 1 -- 172.21.15.40:0/974206993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0317e0 con 0x7ffa380bf510 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa36ffd640 1 -- 172.21.15.40:0/974206993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c031940 con 0x7ffa380bf510 2023-12-20T04:23:45.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa36ffd640 1 -- 172.21.15.40:0/974206993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c031cd0 con 0x7ffa380bf510 2023-12-20T04:23:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa3e569640 1 -- 172.21.15.40:0/974206993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 msgr2=0x7ffa380be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa3e569640 1 --2- 172.21.15.40:0/974206993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380be350 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffa380bf9c0 tx=0x7ffa2c02b880 comp rx=0 tx=0).stop 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa3e569640 1 -- 172.21.15.40:0/974206993 shutdown_connections 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa3e569640 1 --2- 172.21.15.40:0/974206993 >> v2:172.21.15.69:3300/0 conn(0x7ffa3806a950 0x7ffa380bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa3e569640 1 --2- 172.21.15.40:0/974206993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380be350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.243+0000 7ffa3e569640 1 -- 172.21.15.40:0/974206993 >> 172.21.15.40:0/974206993 conn(0x7ffa380bcfd0 msgr2=0x7ffa380bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.244+0000 7ffa3e569640 1 -- 172.21.15.40:0/974206993 shutdown_connections 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.244+0000 7ffa3e569640 1 -- 172.21.15.40:0/974206993 wait complete. 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 Processor -- start 2023-12-20T04:23:45.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 -- start start 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa3806a950 0x7ffa38146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffa380bb140 0x7ffa381dfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa381e3ce0 con 0x7ffa380bf510 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38146c60 con 0x7ffa3806a950 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3e569640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa381e4100 con 0x7ffa380bb140 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.245+0000 7ffa3cb06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380b2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48208/0 (socket says 172.21.15.40:48208) 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 -- 172.21.15.40:0/4014688800 learned_addr learned my addr 172.21.15.40:0/4014688800 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa37fff640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa3806a950 0x7ffa38146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa377fe640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffa380bb140 0x7ffa381dfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 -- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffa380bb140 msgr2=0x7ffa381dfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffa380bb140 0x7ffa381dfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 -- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa3806a950 msgr2=0x7ffa38146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa3806a950 0x7ffa38146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 -- 172.21.15.40:0/4014688800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c0094d0 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa377fe640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffa380bb140 0x7ffa381dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3cb06640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380b2d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa30007e40 tx=0x7ffa3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa34ff9640 1 -- 172.21.15.40:0/4014688800 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30014620 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa34ff9640 1 -- 172.21.15.40:0/4014688800 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000ee90 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa380a3fe0 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa34ff9640 1 -- 172.21.15.40:0/4014688800 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300149e0 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.246+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa381e3620 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.247+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa381e3e20 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.248+0000 7ffa34ff9640 1 -- 172.21.15.40:0/4014688800 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa30014b40 con 0x7ffa380bf510 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.248+0000 7ffa34ff9640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ffa2406a430 0x7ffa2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.248+0000 7ffa34ff9640 1 -- 172.21.15.40:0/4014688800 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa30089230 con 0x7ffa380bf510 2023-12-20T04:23:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.248+0000 7ffa37fff640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ffa2406a430 0x7ffa2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.249+0000 7ffa37fff640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ffa2406a430 0x7ffa2406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa28004f60 tx=0x7ffa28007e30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.252+0000 7ffa34ff9640 1 -- 172.21.15.40:0/4014688800 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ffa381e3e20 con 0x7ffa380bf510 2023-12-20T04:23:45.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.426+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa381e3e20 con 0x7ffa380bf510 2023-12-20T04:23:45.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.427+0000 7ffa34ff9640 1 -- 172.21.15.40:0/4014688800 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa381e3e20 con 0x7ffa380bf510 2023-12-20T04:23:45.428 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ffa2406a430 msgr2=0x7ffa2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ffa2406a430 0x7ffa2406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa28004f60 tx=0x7ffa28007e30 comp rx=0 tx=0).stop 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 msgr2=0x7ffa380b2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380b2d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffa30007e40 tx=0x7ffa3000e4b0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 shutdown_connections 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ffa2406a430 0x7ffa2406c8f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa380bf510 0x7ffa380b2d00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ffa380bb140 0x7ffa381dfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 --2- 172.21.15.40:0/4014688800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa3806a950 0x7ffa38146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 >> 172.21.15.40:0/4014688800 conn(0x7ffa380bcfd0 msgr2=0x7ffa380a3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:45.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 shutdown_connections 2023-12-20T04:23:45.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.429+0000 7ffa3e569640 1 -- 172.21.15.40:0/4014688800 wait complete. 2023-12-20T04:23:45.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:45.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.548+0000 7fcd21522640 1 Processor -- start 2023-12-20T04:23:45.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.548+0000 7fcd21522640 1 -- start start 2023-12-20T04:23:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.548+0000 7fcd21522640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcd1c0bb140 0x7fcd1c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.548+0000 7fcd21522640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcd1c06a950 0x7fcd1c0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.548+0000 7fcd21522640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c0bfa50 con 0x7fcd1c0bee00 2023-12-20T04:23:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.548+0000 7fcd21522640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c0bbda0 con 0x7fcd1c0bb140 2023-12-20T04:23:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.548+0000 7fcd21522640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c06b040 con 0x7fcd1c06a950 2023-12-20T04:23:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcd1c0bb140 0x7fcd1c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcd1c0bee00 0x7fcd1c0bf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55488/0 (socket says 172.21.15.40:55488) 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1b7fe640 1 -- 172.21.15.40:0/1703555518 learned_addr learned my addr 172.21.15.40:0/1703555518 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd127fc640 1 --2- 172.21.15.40:0/1703555518 >> v2:172.21.15.69:3300/0 conn(0x7fcd1c06a950 0x7fcd1c0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1affd640 1 -- 172.21.15.40:0/1703555518 >> v2:172.21.15.69:3300/0 conn(0x7fcd1c06a950 msgr2=0x7fcd1c0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1affd640 1 --2- 172.21.15.40:0/1703555518 >> v2:172.21.15.69:3300/0 conn(0x7fcd1c06a950 0x7fcd1c0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1affd640 1 -- 172.21.15.40:0/1703555518 >> v1:172.21.15.40:6789/0 conn(0x7fcd1c0bee00 legacy=0x7fcd1c0bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1affd640 1 -- 172.21.15.40:0/1703555518 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0bb520 con 0x7fcd1c0bb140 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.549+0000 7fcd1a7fc640 1 -- 172.21.15.40:0/1703555518 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932752164 0 0) 0x7fcd1c0bfa50 con 0x7fcd1c0bee00 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd1affd640 1 --2- 172.21.15.40:0/1703555518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bb140 0x7fcd1c0be350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c06b650 tx=0x7fcd0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22637eacdacd2fb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd1a7fc640 1 -- 172.21.15.40:0/1703555518 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c02e070 con 0x7fcd1c0bb140 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd1a7fc640 1 -- 172.21.15.40:0/1703555518 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c0315a0 con 0x7fcd1c0bb140 2023-12-20T04:23:45.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd1a7fc640 1 -- 172.21.15.40:0/1703555518 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c031930 con 0x7fcd1c0bb140 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 -- 172.21.15.40:0/1703555518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bb140 msgr2=0x7fcd1c0be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 --2- 172.21.15.40:0/1703555518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bb140 0x7fcd1c0be350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c06b650 tx=0x7fcd0c02b840 comp rx=0 tx=0).stop 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 -- 172.21.15.40:0/1703555518 shutdown_connections 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 --2- 172.21.15.40:0/1703555518 >> v2:172.21.15.69:3300/0 conn(0x7fcd1c06a950 0x7fcd1c0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 --2- 172.21.15.40:0/1703555518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bb140 0x7fcd1c0be350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 -- 172.21.15.40:0/1703555518 >> 172.21.15.40:0/1703555518 conn(0x7fcd1c0bcfd0 msgr2=0x7fcd1c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 -- 172.21.15.40:0/1703555518 shutdown_connections 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.550+0000 7fcd21522640 1 -- 172.21.15.40:0/1703555518 wait complete. 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.551+0000 7fcd21522640 1 Processor -- start 2023-12-20T04:23:45.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd21522640 1 -- start start 2023-12-20T04:23:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd21522640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcd1c06a950 0x7fcd1c0a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd21522640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd1c0bb140 0x7fcd1c146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd21522640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bee00 0x7fcd1c1e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd21522640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0a2950 con 0x7fcd1c0bee00 2023-12-20T04:23:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd21522640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0b4080 con 0x7fcd1c0bb140 2023-12-20T04:23:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd21522640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e2d00 con 0x7fcd1c06a950 2023-12-20T04:23:45.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd1b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bee00 0x7fcd1c1e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd1b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bee00 0x7fcd1c1e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42524/0 (socket says 172.21.15.40:42524) 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd1b7fe640 1 -- 172.21.15.40:0/1693721997 learned_addr learned my addr 172.21.15.40:0/1693721997 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd127fc640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd1c0bb140 0x7fcd1c146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.552+0000 7fcd1affd640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcd1c06a950 0x7fcd1c0a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd1b7fe640 1 -- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcd1c06a950 msgr2=0x7fcd1c0a2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd1b7fe640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcd1c06a950 0x7fcd1c0a2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd1b7fe640 1 -- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd1c0bb140 msgr2=0x7fcd1c146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd1b7fe640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd1c0bb140 0x7fcd1c146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd1b7fe640 1 -- 172.21.15.40:0/1693721997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c009400 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd1affd640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcd1c06a950 0x7fcd1c0a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd1b7fe640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bee00 0x7fcd1c1e3190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400c810 tx=0x7fcd1400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd13fff640 1 -- 172.21.15.40:0/1693721997 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400a640 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd13fff640 1 -- 172.21.15.40:0/1693721997 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1400a7c0 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c0a2c40 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd13fff640 1 -- 172.21.15.40:0/1693721997 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400ab70 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.553+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c0b45b0 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.554+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c1e2e70 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.554+0000 7fcd13fff640 1 -- 172.21.15.40:0/1693721997 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd1400acd0 con 0x7fcd1c0bee00 2023-12-20T04:23:45.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.555+0000 7fcd13fff640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fccfc06a430 0x7fccfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.555+0000 7fcd13fff640 1 -- 172.21.15.40:0/1693721997 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd14088070 con 0x7fcd1c0bee00 2023-12-20T04:23:45.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.555+0000 7fcd1affd640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fccfc06a430 0x7fccfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.555+0000 7fcd1affd640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fccfc06a430 0x7fccfc06c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c036000 tx=0x7fcd0c03d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.559+0000 7fcd13fff640 1 -- 172.21.15.40:0/1693721997 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcd14053710 con 0x7fcd1c0bee00 2023-12-20T04:23:45.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.732+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd1c0740a0 con 0x7fcd1c0bee00 2023-12-20T04:23:45.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.733+0000 7fcd13fff640 1 -- 172.21.15.40:0/1693721997 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd14056d30 con 0x7fcd1c0bee00 2023-12-20T04:23:45.734 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:45.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fccfc06a430 msgr2=0x7fccfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fccfc06a430 0x7fccfc06c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c036000 tx=0x7fcd0c03d040 comp rx=0 tx=0).stop 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bee00 msgr2=0x7fcd1c1e3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bee00 0x7fcd1c1e3190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400c810 tx=0x7fcd1400ccd0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 shutdown_connections 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fccfc06a430 0x7fccfc06c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd1c0bee00 0x7fcd1c1e3190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd1c0bb140 0x7fcd1c146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 --2- 172.21.15.40:0/1693721997 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcd1c06a950 0x7fcd1c0a2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.734+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 >> 172.21.15.40:0/1693721997 conn(0x7fcd1c0bcfd0 msgr2=0x7fcd1c14b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.735+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 shutdown_connections 2023-12-20T04:23:45.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.735+0000 7fcd21522640 1 -- 172.21.15.40:0/1693721997 wait complete. 2023-12-20T04:23:45.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.853+0000 7fb8d845f640 1 Processor -- start 2023-12-20T04:23:45.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.853+0000 7fb8d845f640 1 -- start start 2023-12-20T04:23:45.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d845f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8d00b8a60 0x7fb8d01562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d845f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d00b85d0 con 0x7fb8d00bcf40 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d845f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d00b9b90 con 0x7fb8d00bc540 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d845f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d00ba780 con 0x7fb8d00b8a60 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d69fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8d00b8a60 0x7fb8d01562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d69fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8d00b8a60 0x7fb8d01562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42526/0 (socket says 172.21.15.40:42526) 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d61fb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb8d00bcf40 0x7fb8d014a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55494/0 (socket says 172.21.15.40:55494) 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.854+0000 7fb8d69fc640 1 -- 172.21.15.40:0/1218038387 learned_addr learned my addr 172.21.15.40:0/1218038387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.855+0000 7fb8d69fc640 1 -- 172.21.15.40:0/1218038387 >> v1:172.21.15.69:6789/0 conn(0x7fb8d00bc540 legacy=0x7fb8d0144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.855+0000 7fb8d69fc640 1 -- 172.21.15.40:0/1218038387 >> v1:172.21.15.40:6789/0 conn(0x7fb8d00bcf40 legacy=0x7fb8d014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.855+0000 7fb8d69fc640 1 -- 172.21.15.40:0/1218038387 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d00ba220 con 0x7fb8d00b8a60 2023-12-20T04:23:45.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.855+0000 7fb8d51f9640 1 -- 172.21.15.40:0/1218038387 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591200512 0 0) 0x7fb8d00b85d0 con 0x7fb8d00bcf40 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.855+0000 7fb8d69fc640 1 --2- 172.21.15.40:0/1218038387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00b8a60 0x7fb8d01562c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009e50 tx=0x7fb8c802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6108c392089de9fb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d51f9640 1 -- 172.21.15.40:0/1218038387 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c802cbb0 con 0x7fb8d00b8a60 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d51f9640 1 -- 172.21.15.40:0/1218038387 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c802cd10 con 0x7fb8d00b8a60 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d51f9640 1 -- 172.21.15.40:0/1218038387 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8034610 con 0x7fb8d00b8a60 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d845f640 1 -- 172.21.15.40:0/1218038387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00b8a60 msgr2=0x7fb8d01562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d845f640 1 --2- 172.21.15.40:0/1218038387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00b8a60 0x7fb8d01562c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8009e50 tx=0x7fb8c802c010 comp rx=0 tx=0).stop 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d845f640 1 -- 172.21.15.40:0/1218038387 shutdown_connections 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d845f640 1 --2- 172.21.15.40:0/1218038387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00b8a60 0x7fb8d01562c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d845f640 1 -- 172.21.15.40:0/1218038387 >> 172.21.15.40:0/1218038387 conn(0x7fb8d00c02f0 msgr2=0x7fb8d00c0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d845f640 1 -- 172.21.15.40:0/1218038387 shutdown_connections 2023-12-20T04:23:45.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.856+0000 7fb8d845f640 1 -- 172.21.15.40:0/1218038387 wait complete. 2023-12-20T04:23:45.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.857+0000 7fb8d845f640 1 Processor -- start 2023-12-20T04:23:45.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.857+0000 7fb8d845f640 1 -- start start 2023-12-20T04:23:45.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d845f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8d00b8a60 0x7fb8d0145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d845f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00bc540 0x7fb8d0145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d845f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8d00bcf40 0x7fb8d0146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d845f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d0145880 con 0x7fb8d00bc540 2023-12-20T04:23:45.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d845f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d0149740 con 0x7fb8d00b8a60 2023-12-20T04:23:45.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d845f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d0149d00 con 0x7fb8d00bcf40 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00bc540 0x7fb8d0145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00bc540 0x7fb8d0145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42542/0 (socket says 172.21.15.40:42542) 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 -- 172.21.15.40:0/2789582022 learned_addr learned my addr 172.21.15.40:0/2789582022 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 -- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8d00bcf40 msgr2=0x7fb8d0146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8d00bcf40 0x7fb8d0146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 -- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8d00b8a60 msgr2=0x7fb8d0145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8d00b8a60 0x7fb8d0145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 -- 172.21.15.40:0/2789582022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c8009b30 con 0x7fb8d00bc540 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.858+0000 7fb8d59fa640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00bc540 0x7fb8d0145f60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c480 tx=0x7fb8c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.859+0000 7fb8c6ffd640 1 -- 172.21.15.40:0/2789582022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00052d0 con 0x7fb8d00bc540 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.859+0000 7fb8c6ffd640 1 -- 172.21.15.40:0/2789582022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0005430 con 0x7fb8d00bc540 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.859+0000 7fb8c6ffd640 1 -- 172.21.15.40:0/2789582022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0012870 con 0x7fb8d00bc540 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.859+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d014a7c0 con 0x7fb8d00bc540 2023-12-20T04:23:45.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.859+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d013d8c0 con 0x7fb8d00bc540 2023-12-20T04:23:45.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.860+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d0149fe0 con 0x7fb8d00bc540 2023-12-20T04:23:45.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.860+0000 7fb8c6ffd640 1 -- 172.21.15.40:0/2789582022 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb8c00129d0 con 0x7fb8d00bc540 2023-12-20T04:23:45.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.860+0000 7fb8c6ffd640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb8b406a430 0x7fb8b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:45.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.861+0000 7fb8c6ffd640 1 -- 172.21.15.40:0/2789582022 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8c00883d0 con 0x7fb8d00bc540 2023-12-20T04:23:45.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.861+0000 7fb8d61fb640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb8b406a430 0x7fb8b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:45.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.861+0000 7fb8d61fb640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb8b406a430 0x7fb8b406c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc000c00 tx=0x7fb8cc0079c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:45.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:45.865+0000 7fb8c6ffd640 1 -- 172.21.15.40:0/2789582022 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb8d0149fe0 con 0x7fb8d00bc540 2023-12-20T04:23:46.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.041+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8d00740a0 con 0x7fb8d00bc540 2023-12-20T04:23:46.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.041+0000 7fb8c6ffd640 1 -- 172.21.15.40:0/2789582022 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8c0053a50 con 0x7fb8d00bc540 2023-12-20T04:23:46.042 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:46.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb8b406a430 msgr2=0x7fb8b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb8b406a430 0x7fb8b406c8f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc000c00 tx=0x7fb8cc0079c0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00bc540 msgr2=0x7fb8d0145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00bc540 0x7fb8d0145f60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000c480 tx=0x7fb8c000c940 comp rx=0 tx=0).stop 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 shutdown_connections 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb8b406a430 0x7fb8b406c8f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb8d00bcf40 0x7fb8d0146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8d00bc540 0x7fb8d0145f60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 --2- 172.21.15.40:0/2789582022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8d00b8a60 0x7fb8d0145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 >> 172.21.15.40:0/2789582022 conn(0x7fb8d00c02f0 msgr2=0x7fb8d00bf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 shutdown_connections 2023-12-20T04:23:46.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.043+0000 7fb8d845f640 1 -- 172.21.15.40:0/2789582022 wait complete. 2023-12-20T04:23:46.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:46.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.160+0000 7f02830b9640 1 Processor -- start 2023-12-20T04:23:46.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.160+0000 7f02830b9640 1 -- start start 2023-12-20T04:23:46.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f02830b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f027c070ff0 0x7f027c14aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f02830b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f02830b9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027c14af90 con 0x7f027c0ba0e0 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f02830b9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f027c0b8630 con 0x7f027c070ff0 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f02830b9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c06b090 con 0x7f027c0ba700 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f0280e55640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f027c070ff0 0x7f027c14aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f0280e55640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f027c070ff0 0x7f027c14aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42558/0 (socket says 172.21.15.40:42558) 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f0280e55640 1 -- 172.21.15.40:0/3892371625 learned_addr learned my addr 172.21.15.40:0/3892371625 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.161+0000 7f027bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f027c0ba0e0 0x7f027c0b7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55496/0 (socket says 172.21.15.40:55496) 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.162+0000 7f0281656640 1 --2- 172.21.15.40:0/3892371625 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.162+0000 7f0280e55640 1 -- 172.21.15.40:0/3892371625 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 msgr2=0x7f027c155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.162+0000 7f0280e55640 1 --2- 172.21.15.40:0/3892371625 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.162+0000 7f0280e55640 1 -- 172.21.15.40:0/3892371625 >> v1:172.21.15.40:6789/0 conn(0x7f027c0ba0e0 legacy=0x7f027c0b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.162+0000 7f0280e55640 1 -- 172.21.15.40:0/3892371625 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c071d10 con 0x7f027c070ff0 2023-12-20T04:23:46.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.162+0000 7f0280e55640 1 --2- 172.21.15.40:0/3892371625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c14aa50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0274009e50 tx=0x7f027402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c589efc8b381b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.162+0000 7f027b7fe640 1 -- 172.21.15.40:0/3892371625 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027402cb00 con 0x7f027c070ff0 2023-12-20T04:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f027b7fe640 1 -- 172.21.15.40:0/3892371625 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027402cc60 con 0x7f027c070ff0 2023-12-20T04:23:46.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f027b7fe640 1 -- 172.21.15.40:0/3892371625 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740343f0 con 0x7f027c070ff0 2023-12-20T04:23:46.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 -- 172.21.15.40:0/3892371625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 msgr2=0x7f027c14aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 --2- 172.21.15.40:0/3892371625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c14aa50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0274009e50 tx=0x7f027402bf60 comp rx=0 tx=0).stop 2023-12-20T04:23:46.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 -- 172.21.15.40:0/3892371625 shutdown_connections 2023-12-20T04:23:46.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 --2- 172.21.15.40:0/3892371625 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 --2- 172.21.15.40:0/3892371625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c14aa50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 -- 172.21.15.40:0/3892371625 >> 172.21.15.40:0/3892371625 conn(0x7f027c0be120 msgr2=0x7f027c0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:46.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 -- 172.21.15.40:0/3892371625 shutdown_connections 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.163+0000 7f02830b9640 1 -- 172.21.15.40:0/3892371625 wait complete. 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.164+0000 7f02830b9640 1 Processor -- start 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.164+0000 7f02830b9640 1 -- start start 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f02830b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c0ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f02830b9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f027c0ba0e0 0x7f027c14bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f02830b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f02830b9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0ad4a0 con 0x7f027c070ff0 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f02830b9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0ac870 con 0x7f027c0ba0e0 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f02830b9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027c0acb00 con 0x7f027c0ba700 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c0ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c0ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42562/0 (socket says 172.21.15.40:42562) 2023-12-20T04:23:46.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 -- 172.21.15.40:0/2694827481 learned_addr learned my addr 172.21.15.40:0/2694827481 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f027bfff640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f027c0ba0e0 0x7f027c14bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0281656640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 -- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 msgr2=0x7f027c14c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c14c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 -- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f027c0ba0e0 msgr2=0x7f027c14bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f027c0ba0e0 0x7f027c14bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0280e55640 1 -- 172.21.15.40:0/2694827481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274009b30 con 0x7f027c070ff0 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f0281656640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.165+0000 7f027bfff640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f027c0ba0e0 0x7f027c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.166+0000 7f0280e55640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c0ac330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0274000f80 tx=0x7f0274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.166+0000 7f02797fa640 1 -- 172.21.15.40:0/2694827481 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0274009510 con 0x7f027c070ff0 2023-12-20T04:23:46.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.166+0000 7f02797fa640 1 -- 172.21.15.40:0/2694827481 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027403e450 con 0x7f027c070ff0 2023-12-20T04:23:46.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.166+0000 7f02797fa640 1 -- 172.21.15.40:0/2694827481 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027403e800 con 0x7f027c070ff0 2023-12-20T04:23:46.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.166+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027c0acde0 con 0x7f027c070ff0 2023-12-20T04:23:46.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.166+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c0ab8c0 con 0x7f027c070ff0 2023-12-20T04:23:46.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.167+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027c14bac0 con 0x7f027c070ff0 2023-12-20T04:23:46.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.167+0000 7f02797fa640 1 -- 172.21.15.40:0/2694827481 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f027403e960 con 0x7f027c070ff0 2023-12-20T04:23:46.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.168+0000 7f02797fa640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f025c06a460 0x7f025c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.168+0000 7f02797fa640 1 -- 172.21.15.40:0/2694827481 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02740ab670 con 0x7f027c070ff0 2023-12-20T04:23:46.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.168+0000 7f027bfff640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f025c06a460 0x7f025c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.168+0000 7f027bfff640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f025c06a460 0x7f025c06c920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f027c0bca50 tx=0x7f026c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.172+0000 7f02797fa640 1 -- 172.21.15.40:0/2694827481 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0274076cf0 con 0x7f027c070ff0 2023-12-20T04:23:46.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.351+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f027c04e840 con 0x7f027c070ff0 2023-12-20T04:23:46.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.352+0000 7f02797fa640 1 -- 172.21.15.40:0/2694827481 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f027407a310 con 0x7f027c070ff0 2023-12-20T04:23:46.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:46.353 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:46.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f025c06a460 msgr2=0x7f025c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f025c06a460 0x7f025c06c920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f027c0bca50 tx=0x7f026c009040 comp rx=0 tx=0).stop 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 msgr2=0x7f027c0ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c0ac330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0274000f80 tx=0x7f0274004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 shutdown_connections 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f025c06a460 0x7f025c06c920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f027c0ba700 0x7f027c14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f027c0ba0e0 0x7f027c14bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 --2- 172.21.15.40:0/2694827481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f027c070ff0 0x7f027c0ac330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 >> 172.21.15.40:0/2694827481 conn(0x7f027c0be120 msgr2=0x7f027c0bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 shutdown_connections 2023-12-20T04:23:46.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.354+0000 7f02830b9640 1 -- 172.21.15.40:0/2694827481 wait complete. 2023-12-20T04:23:46.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:46.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:46.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.475+0000 7f3c3d038640 1 Processor -- start 2023-12-20T04:23:46.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.475+0000 7f3c3d038640 1 -- start start 2023-12-20T04:23:46.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3d038640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3c380bf510 0x7f3c380be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3d038640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c3806a950 0x7f3c380bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3d038640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c380bfa50 con 0x7f3c380bb140 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3d038640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c380bbda0 con 0x7f3c3806a950 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3d038640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3806b040 con 0x7f3c380bf510 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c3806a950 0x7f3c380bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3759e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c3806a950 0x7f3c380bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42570/0 (socket says 172.21.15.40:42570) 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3759e640 1 -- 172.21.15.40:0/1484588437 learned_addr learned my addr 172.21.15.40:0/1484588437 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c2ffff640 1 --2- 172.21.15.40:0/1484588437 >> v2:172.21.15.69:3300/0 conn(0x7f3c380bf510 0x7f3c380be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3759e640 1 -- 172.21.15.40:0/1484588437 >> v2:172.21.15.69:3300/0 conn(0x7f3c380bf510 msgr2=0x7f3c380be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3759e640 1 --2- 172.21.15.40:0/1484588437 >> v2:172.21.15.69:3300/0 conn(0x7f3c380bf510 0x7f3c380be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3759e640 1 -- 172.21.15.40:0/1484588437 >> v1:172.21.15.69:6789/0 conn(0x7f3c380bb140 legacy=0x7f3c380bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.476+0000 7f3c3759e640 1 -- 172.21.15.40:0/1484588437 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c380bb520 con 0x7f3c3806a950 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3759e640 1 --2- 172.21.15.40:0/1484588437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c380bfee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c3806b650 tx=0x7f3c3002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23048ab172735fc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3659c640 1 -- 172.21.15.40:0/1484588437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3002ca80 con 0x7f3c3806a950 2023-12-20T04:23:46.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3659c640 1 -- 172.21.15.40:0/1484588437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3002cbe0 con 0x7f3c3806a950 2023-12-20T04:23:46.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3659c640 1 -- 172.21.15.40:0/1484588437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300343f0 con 0x7f3c3806a950 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 -- 172.21.15.40:0/1484588437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 msgr2=0x7f3c380bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1484588437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c380bfee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3c3806b650 tx=0x7f3c3002bee0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 -- 172.21.15.40:0/1484588437 shutdown_connections 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1484588437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c380bfee0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1484588437 >> v2:172.21.15.69:3300/0 conn(0x7f3c380bf510 0x7f3c380be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 -- 172.21.15.40:0/1484588437 >> 172.21.15.40:0/1484588437 conn(0x7f3c380bcfd0 msgr2=0x7f3c380bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 -- 172.21.15.40:0/1484588437 shutdown_connections 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.477+0000 7f3c3d038640 1 -- 172.21.15.40:0/1484588437 wait complete. 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 Processor -- start 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 -- start start 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c38143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c380bb140 0x7f3c38144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c380bf510 0x7f3c380b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38144fc0 con 0x7f3c3806a950 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c38143900 con 0x7f3c380bb140 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c3d038640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c380b38f0 con 0x7f3c380bf510 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c36d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c38143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c36d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c38143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42572/0 (socket says 172.21.15.40:42572) 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c36d9d640 1 -- 172.21.15.40:0/1477321183 learned_addr learned my addr 172.21.15.40:0/1477321183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.479+0000 7f3c2ffff640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c380bb140 0x7f3c38144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c3759e640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c380bf510 0x7f3c380b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c36d9d640 1 -- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c380bf510 msgr2=0x7f3c380b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c36d9d640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c380bf510 0x7f3c380b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c36d9d640 1 -- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c380bb140 msgr2=0x7f3c38144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c36d9d640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c380bb140 0x7f3c38144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c36d9d640 1 -- 172.21.15.40:0/1477321183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30009b30 con 0x7f3c3806a950 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c3759e640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c380bf510 0x7f3c380b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c36d9d640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c38143c10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c400 tx=0x7f3c2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c2f7fe640 1 -- 172.21.15.40:0/1477321183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280052d0 con 0x7f3c3806a950 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c2f7fe640 1 -- 172.21.15.40:0/1477321183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28005430 con 0x7f3c3806a950 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c381442f0 con 0x7f3c3806a950 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c2f7fe640 1 -- 172.21.15.40:0/1477321183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28003830 con 0x7f3c3806a950 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.480+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c381e3de0 con 0x7f3c3806a950 2023-12-20T04:23:46.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.481+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c380740a0 con 0x7f3c3806a950 2023-12-20T04:23:46.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.481+0000 7f3c2f7fe640 1 -- 172.21.15.40:0/1477321183 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3c28003990 con 0x7f3c3806a950 2023-12-20T04:23:46.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.482+0000 7f3c2f7fe640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c1806a430 0x7f3c1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.482+0000 7f3c2f7fe640 1 -- 172.21.15.40:0/1477321183 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c28087e30 con 0x7f3c3806a950 2023-12-20T04:23:46.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.482+0000 7f3c2ffff640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c1806a430 0x7f3c1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.482+0000 7f3c2ffff640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c1806a430 0x7f3c1806c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c3814b6d0 tx=0x7f3c20008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.487+0000 7f3c2f7fe640 1 -- 172.21.15.40:0/1477321183 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3c280534b0 con 0x7f3c3806a950 2023-12-20T04:23:46.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.661+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c380b3b80 con 0x7f3c3806a950 2023-12-20T04:23:46.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.662+0000 7f3c2f7fe640 1 -- 172.21.15.40:0/1477321183 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c28017020 con 0x7f3c3806a950 2023-12-20T04:23:46.663 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c1806a430 msgr2=0x7f3c1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c1806a430 0x7f3c1806c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c3814b6d0 tx=0x7f3c20008040 comp rx=0 tx=0).stop 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 msgr2=0x7f3c38143c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c38143c10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c400 tx=0x7f3c2800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 shutdown_connections 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c1806a430 0x7f3c1806c8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c380bf510 0x7f3c380b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c380bb140 0x7f3c38144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 --2- 172.21.15.40:0/1477321183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c3806a950 0x7f3c38143c10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 >> 172.21.15.40:0/1477321183 conn(0x7f3c380bcfd0 msgr2=0x7f3c380a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:46.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 shutdown_connections 2023-12-20T04:23:46.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.664+0000 7f3c3d038640 1 -- 172.21.15.40:0/1477321183 wait complete. 2023-12-20T04:23:46.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdcd399640 1 Processor -- start 2023-12-20T04:23:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdcd399640 1 -- start start 2023-12-20T04:23:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdcd399640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdc8144f30 0x7fcdc814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdcd399640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc806acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdcd399640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc814e540 con 0x7fcdc806b1f0 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdcd399640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc806c400 con 0x7fcdc8144f30 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdcd399640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8145310 con 0x7fcdc8070e40 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdc6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdc8144f30 0x7fcdc814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdc6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcdc8144f30 0x7fcdc814e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42584/0 (socket says 172.21.15.40:42584) 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.784+0000 7fcdc6ffd640 1 -- 172.21.15.40:0/3190242019 learned_addr learned my addr 172.21.15.40:0/3190242019 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.785+0000 7fcdbe7fc640 1 --2- 172.21.15.40:0/3190242019 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc806acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.785+0000 7fcdc6ffd640 1 -- 172.21.15.40:0/3190242019 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 msgr2=0x7fcdc806acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.785+0000 7fcdc6ffd640 1 --2- 172.21.15.40:0/3190242019 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc806acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.785+0000 7fcdc6ffd640 1 -- 172.21.15.40:0/3190242019 >> v1:172.21.15.69:6789/0 conn(0x7fcdc806b1f0 legacy=0x7fcdc814abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.785+0000 7fcdc6ffd640 1 -- 172.21.15.40:0/3190242019 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc806b680 con 0x7fcdc8144f30 2023-12-20T04:23:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.785+0000 7fcdc6ffd640 1 --2- 172.21.15.40:0/3190242019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc8144f30 0x7fcdc814e9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009850 tx=0x7fcdb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7d9a75f859c86e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.785+0000 7fcdc67fc640 1 -- 172.21.15.40:0/3190242019 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb802e070 con 0x7fcdc8144f30 2023-12-20T04:23:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdc67fc640 1 -- 172.21.15.40:0/3190242019 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb8004030 con 0x7fcdc8144f30 2023-12-20T04:23:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdc67fc640 1 -- 172.21.15.40:0/3190242019 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8004420 con 0x7fcdc8144f30 2023-12-20T04:23:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 -- 172.21.15.40:0/3190242019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc8144f30 msgr2=0x7fcdc814e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 --2- 172.21.15.40:0/3190242019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc8144f30 0x7fcdc814e9d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009850 tx=0x7fcdb802b840 comp rx=0 tx=0).stop 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 -- 172.21.15.40:0/3190242019 shutdown_connections 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 --2- 172.21.15.40:0/3190242019 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc806acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 --2- 172.21.15.40:0/3190242019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc8144f30 0x7fcdc814e9d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 -- 172.21.15.40:0/3190242019 >> 172.21.15.40:0/3190242019 conn(0x7fcdc80be100 msgr2=0x7fcdc80be4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 -- 172.21.15.40:0/3190242019 shutdown_connections 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.786+0000 7fcdcd399640 1 -- 172.21.15.40:0/3190242019 wait complete. 2023-12-20T04:23:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.787+0000 7fcdcd399640 1 Processor -- start 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.787+0000 7fcdcd399640 1 -- start start 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdcd399640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc81d3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdcd399640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc8144f30 0x7fcdc81d4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdcd399640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc81d4b80 0x7fcdc81e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdcd399640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc81d43e0 con 0x7fcdc81d4b80 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdcd399640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc81d6260 con 0x7fcdc8144f30 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdcd399640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc81d6490 con 0x7fcdc8070e40 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc81d4b80 0x7fcdc81e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc81d4b80 0x7fcdc81e30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42592/0 (socket says 172.21.15.40:42592) 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 -- 172.21.15.40:0/316415640 learned_addr learned my addr 172.21.15.40:0/316415640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc6ffd640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc81d3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdbe7fc640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc8144f30 0x7fcdc81d4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 -- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 msgr2=0x7fcdc81d3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc81d3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 -- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc8144f30 msgr2=0x7fcdc81d4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc8144f30 0x7fcdc81d4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.788+0000 7fcdc77fe640 1 -- 172.21.15.40:0/316415640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8009460 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.789+0000 7fcdc77fe640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc81d4b80 0x7fcdc81e30c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000be60 tx=0x7fcdc000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.789+0000 7fcdbffff640 1 -- 172.21.15.40:0/316415640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc000cb50 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.789+0000 7fcdbffff640 1 -- 172.21.15.40:0/316415640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc000ccb0 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.789+0000 7fcdbffff640 1 -- 172.21.15.40:0/316415640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0014680 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.789+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc8140200 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.789+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc81d5b60 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.790+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc81409b0 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.790+0000 7fcdbffff640 1 -- 172.21.15.40:0/316415640 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcdc001d3b0 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.791+0000 7fcdbffff640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcda806a430 0x7fcda806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.791+0000 7fcdbffff640 1 -- 172.21.15.40:0/316415640 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdc00884b0 con 0x7fcdc81d4b80 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.791+0000 7fcdc6ffd640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcda806a430 0x7fcda806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.791+0000 7fcdc6ffd640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcda806a430 0x7fcda806c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8034000 tx=0x7fcdb8008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:46.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.795+0000 7fcdbffff640 1 -- 172.21.15.40:0/316415640 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcdc0053be0 con 0x7fcdc81d4b80 2023-12-20T04:23:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.969+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdc80740a0 con 0x7fcdc81d4b80 2023-12-20T04:23:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.969+0000 7fcdbffff640 1 -- 172.21.15.40:0/316415640 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdc0057200 con 0x7fcdc81d4b80 2023-12-20T04:23:46.970 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.971+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcda806a430 msgr2=0x7fcda806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcda806a430 0x7fcda806c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8034000 tx=0x7fcdb8008030 comp rx=0 tx=0).stop 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc81d4b80 msgr2=0x7fcdc81e30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc81d4b80 0x7fcdc81e30c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000be60 tx=0x7fcdc000bf50 comp rx=0 tx=0).stop 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 shutdown_connections 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcda806a430 0x7fcda806c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcdc81d4b80 0x7fcdc81e30c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc8144f30 0x7fcdc81d4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 --2- 172.21.15.40:0/316415640 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcdc8070e40 0x7fcdc81d3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 >> 172.21.15.40:0/316415640 conn(0x7fcdc80be100 msgr2=0x7fcdc80be4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 shutdown_connections 2023-12-20T04:23:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:46.972+0000 7fcdcd399640 1 -- 172.21.15.40:0/316415640 wait complete. 2023-12-20T04:23:46.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.091+0000 7fb034388640 1 Processor -- start 2023-12-20T04:23:47.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.091+0000 7fb034388640 1 -- start start 2023-12-20T04:23:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb034388640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb02c0b5040 0x7fb02c0b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb034388640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0b8f80 con 0x7fb02c06ae20 2023-12-20T04:23:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb034388640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c1463a0 con 0x7fb02c0b3bc0 2023-12-20T04:23:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb034388640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02c0b8d70 con 0x7fb02c0b5040 2023-12-20T04:23:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb031923640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb02c0b5040 0x7fb02c0b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb032124640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb02c06ae20 0x7fb02c145c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55508/0 (socket says 172.21.15.40:55508) 2023-12-20T04:23:47.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb032124640 1 -- 172.21.15.40:0/3079064563 learned_addr learned my addr 172.21.15.40:0/3079064563 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb031923640 1 -- 172.21.15.40:0/3079064563 >> v1:172.21.15.69:6789/0 conn(0x7fb02c0b3bc0 legacy=0x7fb02c153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb031923640 1 -- 172.21.15.40:0/3079064563 >> v1:172.21.15.40:6789/0 conn(0x7fb02c06ae20 legacy=0x7fb02c145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.092+0000 7fb031923640 1 -- 172.21.15.40:0/3079064563 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0b5990 con 0x7fb02c0b5040 2023-12-20T04:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.093+0000 7fb031923640 1 --2- 172.21.15.40:0/3079064563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c0b5040 0x7fb02c0b8830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0200097a0 tx=0x7fb02002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bcd59267e374b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.093+0000 7fb031122640 1 -- 172.21.15.40:0/3079064563 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020030610 con 0x7fb02c0b5040 2023-12-20T04:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.093+0000 7fb031122640 1 -- 172.21.15.40:0/3079064563 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020030770 con 0x7fb02c0b5040 2023-12-20T04:23:47.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.093+0000 7fb031122640 1 -- 172.21.15.40:0/3079064563 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb020030b00 con 0x7fb02c0b5040 2023-12-20T04:23:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.094+0000 7fb034388640 1 -- 172.21.15.40:0/3079064563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c0b5040 msgr2=0x7fb02c0b8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.094+0000 7fb034388640 1 --2- 172.21.15.40:0/3079064563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c0b5040 0x7fb02c0b8830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0200097a0 tx=0x7fb02002b960 comp rx=0 tx=0).stop 2023-12-20T04:23:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.094+0000 7fb034388640 1 -- 172.21.15.40:0/3079064563 shutdown_connections 2023-12-20T04:23:47.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.094+0000 7fb034388640 1 --2- 172.21.15.40:0/3079064563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c0b5040 0x7fb02c0b8830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.094+0000 7fb034388640 1 -- 172.21.15.40:0/3079064563 >> 172.21.15.40:0/3079064563 conn(0x7fb02c0b91b0 msgr2=0x7fb02c0b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.094+0000 7fb034388640 1 -- 172.21.15.40:0/3079064563 shutdown_connections 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.094+0000 7fb034388640 1 -- 172.21.15.40:0/3079064563 wait complete. 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.095+0000 7fb034388640 1 Processor -- start 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.095+0000 7fb034388640 1 -- start start 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb034388640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c06ae20 0x7fb02c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb034388640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb02c0b3bc0 0x7fb02c14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb034388640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02c0b5040 0x7fb02c14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb034388640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c148cb0 con 0x7fb02c06ae20 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb034388640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0b2fd0 con 0x7fb02c0b5040 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb034388640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1489d0 con 0x7fb02c0b3bc0 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c06ae20 0x7fb02c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c06ae20 0x7fb02c0b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42600/0 (socket says 172.21.15.40:42600) 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 -- 172.21.15.40:0/1875323693 learned_addr learned my addr 172.21.15.40:0/1875323693 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb031923640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb02c0b3bc0 0x7fb02c14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032925640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02c0b5040 0x7fb02c14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 -- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb02c0b3bc0 msgr2=0x7fb02c14b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb02c0b3bc0 0x7fb02c14b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 -- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02c0b5040 msgr2=0x7fb02c14b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02c0b5040 0x7fb02c14b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 -- 172.21.15.40:0/1875323693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020009400 con 0x7fb02c06ae20 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032925640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02c0b5040 0x7fb02c14b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb031923640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb02c0b3bc0 0x7fb02c14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb032124640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c06ae20 0x7fb02c0b2a90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00cbd0 tx=0x7fb01c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb02affd640 1 -- 172.21.15.40:0/1875323693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00ad40 con 0x7fb02c06ae20 2023-12-20T04:23:47.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb02affd640 1 -- 172.21.15.40:0/1875323693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c012400 con 0x7fb02c06ae20 2023-12-20T04:23:47.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.096+0000 7fb02affd640 1 -- 172.21.15.40:0/1875323693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00aea0 con 0x7fb02c06ae20 2023-12-20T04:23:47.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.097+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c147970 con 0x7fb02c06ae20 2023-12-20T04:23:47.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.097+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c147f30 con 0x7fb02c06ae20 2023-12-20T04:23:47.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.098+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c1477d0 con 0x7fb02c06ae20 2023-12-20T04:23:47.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.098+0000 7fb02affd640 1 -- 172.21.15.40:0/1875323693 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb01c007070 con 0x7fb02c06ae20 2023-12-20T04:23:47.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.098+0000 7fb02affd640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb01806a430 0x7fb01806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.099+0000 7fb02affd640 1 -- 172.21.15.40:0/1875323693 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01c088a20 con 0x7fb02c06ae20 2023-12-20T04:23:47.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.099+0000 7fb031923640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb01806a430 0x7fb01806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.099+0000 7fb031923640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb01806a430 0x7fb01806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb020036000 tx=0x7fb02003b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.103+0000 7fb02affd640 1 -- 172.21.15.40:0/1875323693 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb02c1477d0 con 0x7fb02c06ae20 2023-12-20T04:23:47.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.277+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb02c1477d0 con 0x7fb02c06ae20 2023-12-20T04:23:47.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.277+0000 7fb02affd640 1 -- 172.21.15.40:0/1875323693 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb02c1477d0 con 0x7fb02c06ae20 2023-12-20T04:23:47.278 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:47.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb01806a430 msgr2=0x7fb01806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb01806a430 0x7fb01806c8f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb020036000 tx=0x7fb02003b040 comp rx=0 tx=0).stop 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c06ae20 msgr2=0x7fb02c0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c06ae20 0x7fb02c0b2a90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00cbd0 tx=0x7fb01c00a430 comp rx=0 tx=0).stop 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 shutdown_connections 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb01806a430 0x7fb01806c8f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02c0b5040 0x7fb02c14b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb02c0b3bc0 0x7fb02c14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 --2- 172.21.15.40:0/1875323693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb02c06ae20 0x7fb02c0b2a90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 >> 172.21.15.40:0/1875323693 conn(0x7fb02c0b91b0 msgr2=0x7fb02c0b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 shutdown_connections 2023-12-20T04:23:47.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.279+0000 7fb034388640 1 -- 172.21.15.40:0/1875323693 wait complete. 2023-12-20T04:23:47.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:47.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.397+0000 7fca78173640 1 Processor -- start 2023-12-20T04:23:47.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.397+0000 7fca78173640 1 -- start start 2023-12-20T04:23:47.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca78173640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 0x7fca7006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca78173640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca700711c0 con 0x7fca700b3a30 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca78173640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca70070370 con 0x7fca7006af20 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca78173640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700b4110 con 0x7fca70141c60 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca7570e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fca700b3a30 0x7fca70141550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55518/0 (socket says 172.21.15.40:55518) 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca7570e640 1 -- 172.21.15.40:0/2602942497 learned_addr learned my addr 172.21.15.40:0/2602942497 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca76710640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 0x7fca7006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044371615 0 0) 0x7fca700711c0 con 0x7fca700b3a30 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.398+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca5c003520 con 0x7fca700b3a30 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2505602089 0 0) 0x7fca5c003520 con 0x7fca700b3a30 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 msgr2=0x7fca7006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 0x7fca7006fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 >> v1:172.21.15.69:6789/0 conn(0x7fca7006af20 legacy=0x7fca701477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70070b70 con 0x7fca700b3a30 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7fca60001670 con 0x7fca700b3a30 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 >> v1:172.21.15.40:6789/0 conn(0x7fca700b3a30 legacy=0x7fca70141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 0x7fca5c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca5c003ee0 0x7fca5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c004d00 0x7fca5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c00b9b0 con 0x7fca5c003ee0 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c00bb20 con 0x7fca5c004d00 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c00bce0 con 0x7fca70141c60 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca7570e640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca5c003ee0 0x7fca5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca75f0f640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 0x7fca5c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca76710640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c004d00 0x7fca5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca7570e640 1 -- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 msgr2=0x7fca5c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca7570e640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70141c60 0x7fca5c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca7570e640 1 -- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c004d00 msgr2=0x7fca5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca7570e640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c004d00 0x7fca5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.399+0000 7fca7570e640 1 -- 172.21.15.40:0/2602942497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c003520 con 0x7fca5c003ee0 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.400+0000 7fca7570e640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca5c003ee0 0x7fca5c0047c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c240 tx=0x7fca5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656579d83cb342e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.400+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60005ad0 con 0x7fca5c003ee0 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.400+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca60005c30 con 0x7fca5c003ee0 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.400+0000 7fca74f0d640 1 -- 172.21.15.40:0/2602942497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6002c7e0 con 0x7fca5c003ee0 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.401+0000 7fca78173640 1 -- 172.21.15.40:0/2602942497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca5c003ee0 msgr2=0x7fca5c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.401+0000 7fca78173640 1 --2- 172.21.15.40:0/2602942497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca5c003ee0 0x7fca5c0047c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c240 tx=0x7fca5c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.401+0000 7fca76710640 1 -- 172.21.15.40:0/2602942497 reap_dead start 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.401+0000 7fca78173640 1 -- 172.21.15.40:0/2602942497 shutdown_connections 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.401+0000 7fca78173640 1 -- 172.21.15.40:0/2602942497 >> 172.21.15.40:0/2602942497 conn(0x7fca700bcf60 msgr2=0x7fca700bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.401+0000 7fca78173640 1 -- 172.21.15.40:0/2602942497 shutdown_connections 2023-12-20T04:23:47.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.401+0000 7fca78173640 1 -- 172.21.15.40:0/2602942497 wait complete. 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 Processor -- start 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 -- start start 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c003ee0 0x7fca701cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70145b10 0x7fca700b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca700b5960 0x7fca7013d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca701cf470 con 0x7fca700b5960 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700b5de0 con 0x7fca5c003ee0 2023-12-20T04:23:47.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.402+0000 7fca78173640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7006a770 con 0x7fca70145b10 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca700b5960 0x7fca7013d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca75f0f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c003ee0 0x7fca701cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca700b5960 0x7fca7013d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42632/0 (socket says 172.21.15.40:42632) 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 -- 172.21.15.40:0/1694731323 learned_addr learned my addr 172.21.15.40:0/1694731323 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca7570e640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70145b10 0x7fca700b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 -- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70145b10 msgr2=0x7fca700b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70145b10 0x7fca700b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 -- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c003ee0 msgr2=0x7fca701cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c003ee0 0x7fca701cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 -- 172.21.15.40:0/1694731323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70147100 con 0x7fca700b5960 2023-12-20T04:23:47.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca76710640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca700b5960 0x7fca7013d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca7006be50 tx=0x7fca68011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca667fc640 1 -- 172.21.15.40:0/1694731323 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68004240 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca667fc640 1 -- 172.21.15.40:0/1694731323 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca680043a0 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca667fc640 1 -- 172.21.15.40:0/1694731323 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800f940 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca70069e10 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.403+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca70146d90 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.404+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7004e840 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.405+0000 7fca667fc640 1 -- 172.21.15.40:0/1694731323 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca6800faa0 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.405+0000 7fca667fc640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5406a430 0x7fca5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.405+0000 7fca667fc640 1 -- 172.21.15.40:0/1694731323 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca680889e0 con 0x7fca700b5960 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.405+0000 7fca75f0f640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5406a430 0x7fca5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.406+0000 7fca75f0f640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5406a430 0x7fca5406c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca6c002010 tx=0x7fca6c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.409+0000 7fca667fc640 1 -- 172.21.15.40:0/1694731323 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fca68054080 con 0x7fca700b5960 2023-12-20T04:23:47.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.586+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca70146340 con 0x7fca700b5960 2023-12-20T04:23:47.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.587+0000 7fca667fc640 1 -- 172.21.15.40:0/1694731323 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fca68000e60 con 0x7fca700b5960 2023-12-20T04:23:47.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:47.588 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5406a430 msgr2=0x7fca5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5406a430 0x7fca5406c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca6c002010 tx=0x7fca6c009040 comp rx=0 tx=0).stop 2023-12-20T04:23:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca700b5960 msgr2=0x7fca7013d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca700b5960 0x7fca7013d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca7006be50 tx=0x7fca68011cf0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 shutdown_connections 2023-12-20T04:23:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5406a430 0x7fca5406c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca700b5960 0x7fca7013d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca70145b10 0x7fca700b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 --2- 172.21.15.40:0/1694731323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca5c003ee0 0x7fca701cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 >> 172.21.15.40:0/1694731323 conn(0x7fca700bcf60 msgr2=0x7fca700bc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 shutdown_connections 2023-12-20T04:23:47.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.590+0000 7fca78173640 1 -- 172.21.15.40:0/1694731323 wait complete. 2023-12-20T04:23:47.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:47.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:47.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.710+0000 7f703e751640 1 Processor -- start 2023-12-20T04:23:47.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.710+0000 7f703e751640 1 -- start start 2023-12-20T04:23:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f703e751640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70380bb140 0x7f70380be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f703e751640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f703806a950 0x7f70380bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f703e751640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380bfa50 con 0x7f70380bee00 2023-12-20T04:23:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f703e751640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70380bbda0 con 0x7f70380bb140 2023-12-20T04:23:47.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f703e751640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703806b040 con 0x7f703806a950 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f7037fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70380bb140 0x7f70380be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f7037fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70380bb140 0x7f70380be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42634/0 (socket says 172.21.15.40:42634) 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f7037fff640 1 -- 172.21.15.40:0/3224605546 learned_addr learned my addr 172.21.15.40:0/3224605546 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f70377fe640 1 --2- 172.21.15.40:0/3224605546 >> v2:172.21.15.69:3300/0 conn(0x7f703806a950 0x7f70380bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f7037fff640 1 -- 172.21.15.40:0/3224605546 >> v2:172.21.15.69:3300/0 conn(0x7f703806a950 msgr2=0x7f70380bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f7037fff640 1 --2- 172.21.15.40:0/3224605546 >> v2:172.21.15.69:3300/0 conn(0x7f703806a950 0x7f70380bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f7037fff640 1 -- 172.21.15.40:0/3224605546 >> v1:172.21.15.69:6789/0 conn(0x7f70380bee00 legacy=0x7f70380bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.711+0000 7f7037fff640 1 -- 172.21.15.40:0/3224605546 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380bb520 con 0x7f70380bb140 2023-12-20T04:23:47.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.712+0000 7f7037fff640 1 --2- 172.21.15.40:0/3224605546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bb140 0x7f70380be350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f703806b650 tx=0x7f702c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6dcc0c7d2ac245 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.712+0000 7f7036ffd640 1 -- 172.21.15.40:0/3224605546 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c031870 con 0x7f70380bb140 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.712+0000 7f7036ffd640 1 -- 172.21.15.40:0/3224605546 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c0319d0 con 0x7f70380bb140 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.712+0000 7f7036ffd640 1 -- 172.21.15.40:0/3224605546 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c031d60 con 0x7f70380bb140 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 -- 172.21.15.40:0/3224605546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bb140 msgr2=0x7f70380be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 --2- 172.21.15.40:0/3224605546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bb140 0x7f70380be350 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f703806b650 tx=0x7f702c02b910 comp rx=0 tx=0).stop 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 -- 172.21.15.40:0/3224605546 shutdown_connections 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 --2- 172.21.15.40:0/3224605546 >> v2:172.21.15.69:3300/0 conn(0x7f703806a950 0x7f70380bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 --2- 172.21.15.40:0/3224605546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bb140 0x7f70380be350 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 -- 172.21.15.40:0/3224605546 >> 172.21.15.40:0/3224605546 conn(0x7f70380bcfd0 msgr2=0x7f70380bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 -- 172.21.15.40:0/3224605546 shutdown_connections 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.713+0000 7f703e751640 1 -- 172.21.15.40:0/3224605546 wait complete. 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.714+0000 7f703e751640 1 Processor -- start 2023-12-20T04:23:47.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.714+0000 7f703e751640 1 -- start start 2023-12-20T04:23:47.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703e751640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703806a950 0x7f70381e0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703e751640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70380bb140 0x7f703814db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703e751640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bee00 0x7f70381e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703e751640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703814e0c0 con 0x7f70380bee00 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703e751640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70381e3e50 con 0x7f703806a950 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703e751640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70381dfb30 con 0x7f70380bb140 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bee00 0x7f70381e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bee00 0x7f70381e3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42648/0 (socket says 172.21.15.40:42648) 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 -- 172.21.15.40:0/2107041842 learned_addr learned my addr 172.21.15.40:0/2107041842 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f7037fff640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703806a950 0x7f70381e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f70377fe640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70380bb140 0x7f703814db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 -- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70380bb140 msgr2=0x7f703814db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70380bb140 0x7f703814db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 -- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703806a950 msgr2=0x7f70381e0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703806a950 0x7f70381e0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 -- 172.21.15.40:0/2107041842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0094d0 con 0x7f70380bee00 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703ccee640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bee00 0x7f70381e3470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f703000c7a0 tx=0x7f703000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f7034ff9640 1 -- 172.21.15.40:0/2107041842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030003b70 con 0x7f70380bee00 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f7034ff9640 1 -- 172.21.15.40:0/2107041842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030003cf0 con 0x7f70380bee00 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70381dfe10 con 0x7f70380bee00 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.715+0000 7f7034ff9640 1 -- 172.21.15.40:0/2107041842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030003ea0 con 0x7f70380bee00 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.716+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70381e39b0 con 0x7f70380bee00 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.717+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70380740a0 con 0x7f70380bee00 2023-12-20T04:23:47.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.717+0000 7f7034ff9640 1 -- 172.21.15.40:0/2107041842 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f703000aa90 con 0x7f70380bee00 2023-12-20T04:23:47.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.717+0000 7f7034ff9640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f702406a430 0x7f702406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:47.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.717+0000 7f7034ff9640 1 -- 172.21.15.40:0/2107041842 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7030088610 con 0x7f70380bee00 2023-12-20T04:23:47.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.717+0000 7f7037fff640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f702406a430 0x7f702406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:47.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.718+0000 7f7037fff640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f702406a430 0x7f702406c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f702c036000 tx=0x7f702c03c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:47.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.721+0000 7f7034ff9640 1 -- 172.21.15.40:0/2107041842 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7030053cb0 con 0x7f70380bee00 2023-12-20T04:23:47.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.897+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70380ba4a0 con 0x7f70380bee00 2023-12-20T04:23:47.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.897+0000 7f7034ff9640 1 -- 172.21.15.40:0/2107041842 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70300572d0 con 0x7f70380bee00 2023-12-20T04:23:47.897 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f702406a430 msgr2=0x7f702406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f702406a430 0x7f702406c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f702c036000 tx=0x7f702c03c040 comp rx=0 tx=0).stop 2023-12-20T04:23:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bee00 msgr2=0x7f70381e3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bee00 0x7f70381e3470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f703000c7a0 tx=0x7f703000cc60 comp rx=0 tx=0).stop 2023-12-20T04:23:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 shutdown_connections 2023-12-20T04:23:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f702406a430 0x7f702406c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70380bee00 0x7f70381e3470 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f70380bb140 0x7f703814db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 --2- 172.21.15.40:0/2107041842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703806a950 0x7f70381e0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 >> 172.21.15.40:0/2107041842 conn(0x7f70380bcfd0 msgr2=0x7f70380a44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 shutdown_connections 2023-12-20T04:23:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:47.899+0000 7f703e751640 1 -- 172.21.15.40:0/2107041842 wait complete. 2023-12-20T04:23:47.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.018+0000 7fca2b188640 1 Processor -- start 2023-12-20T04:23:48.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.018+0000 7fca2b188640 1 -- start start 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca2b188640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca240bb140 0x7fca240be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca2b188640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca2406a950 0x7fca240bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca2b188640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca240bfa50 con 0x7fca240bee00 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca2b188640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca240bbda0 con 0x7fca240bb140 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca2b188640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2406b040 con 0x7fca2406a950 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca28f24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca240bb140 0x7fca240be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca29725640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fca240bee00 0x7fca2414e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55522/0 (socket says 172.21.15.40:55522) 2023-12-20T04:23:48.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca29725640 1 -- 172.21.15.40:0/3472333864 learned_addr learned my addr 172.21.15.40:0/3472333864 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca28f24640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca240bb140 0x7fca240be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42662/0 (socket says 172.21.15.40:42662) 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.019+0000 7fca23fff640 1 --2- 172.21.15.40:0/3472333864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca2406a950 0x7fca240bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca28f24640 1 -- 172.21.15.40:0/3472333864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca2406a950 msgr2=0x7fca240bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca28f24640 1 --2- 172.21.15.40:0/3472333864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca2406a950 0x7fca240bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca28f24640 1 -- 172.21.15.40:0/3472333864 >> v1:172.21.15.40:6789/0 conn(0x7fca240bee00 legacy=0x7fca2414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca237fe640 1 -- 172.21.15.40:0/3472333864 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301267971 0 0) 0x7fca240bfa50 con 0x7fca240bee00 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca28f24640 1 -- 172.21.15.40:0/3472333864 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca240bb520 con 0x7fca240bb140 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca23fff640 1 --2- 172.21.15.40:0/3472333864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca2406a950 0x7fca240bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca28f24640 1 --2- 172.21.15.40:0/3472333864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca240bb140 0x7fca240be350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009d90 tx=0x7fca1c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af20825b421d0021 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca237fe640 1 -- 172.21.15.40:0/3472333864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c02cbc0 con 0x7fca240bb140 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca237fe640 1 -- 172.21.15.40:0/3472333864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c02cd20 con 0x7fca240bb140 2023-12-20T04:23:48.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.020+0000 7fca237fe640 1 -- 172.21.15.40:0/3472333864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c034660 con 0x7fca240bb140 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 -- 172.21.15.40:0/3472333864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca240bb140 msgr2=0x7fca240be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 --2- 172.21.15.40:0/3472333864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca240bb140 0x7fca240be350 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009d90 tx=0x7fca1c02be10 comp rx=0 tx=0).stop 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 -- 172.21.15.40:0/3472333864 shutdown_connections 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 --2- 172.21.15.40:0/3472333864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca2406a950 0x7fca240bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 --2- 172.21.15.40:0/3472333864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca240bb140 0x7fca240be350 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 -- 172.21.15.40:0/3472333864 >> 172.21.15.40:0/3472333864 conn(0x7fca240bcfd0 msgr2=0x7fca240bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 -- 172.21.15.40:0/3472333864 shutdown_connections 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.021+0000 7fca2b188640 1 -- 172.21.15.40:0/3472333864 wait complete. 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.022+0000 7fca2b188640 1 Processor -- start 2023-12-20T04:23:48.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.022+0000 7fca2b188640 1 -- start start 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca2b188640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2406a950 0x7fca240a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca2b188640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca240bb140 0x7fca240a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca2b188640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca240bee00 0x7fca240a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca2b188640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240a4410 con 0x7fca2406a950 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca2b188640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240a2660 con 0x7fca240bee00 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca2b188640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240a1fc0 con 0x7fca240bb140 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2406a950 0x7fca240a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2406a950 0x7fca240a3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42664/0 (socket says 172.21.15.40:42664) 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 -- 172.21.15.40:0/3789849395 learned_addr learned my addr 172.21.15.40:0/3789849395 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 -- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca240bb140 msgr2=0x7fca240a1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca240bb140 0x7fca240a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 -- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca240bee00 msgr2=0x7fca240a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca240bee00 0x7fca240a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 -- 172.21.15.40:0/3789849395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c009a70 con 0x7fca2406a950 2023-12-20T04:23:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca28f24640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2406a950 0x7fca240a3ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009d90 tx=0x7fca1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca217fa640 1 -- 172.21.15.40:0/3789849395 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c040650 con 0x7fca2406a950 2023-12-20T04:23:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca217fa640 1 -- 172.21.15.40:0/3789849395 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c02ce90 con 0x7fca2406a950 2023-12-20T04:23:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.023+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2414ecc0 con 0x7fca2406a950 2023-12-20T04:23:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.024+0000 7fca217fa640 1 -- 172.21.15.40:0/3789849395 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0409f0 con 0x7fca2406a950 2023-12-20T04:23:48.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.024+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca24146fa0 con 0x7fca2406a950 2023-12-20T04:23:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.025+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca240a5eb0 con 0x7fca2406a950 2023-12-20T04:23:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.025+0000 7fca217fa640 1 -- 172.21.15.40:0/3789849395 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca1c040b50 con 0x7fca2406a950 2023-12-20T04:23:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.025+0000 7fca217fa640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca0406a430 0x7fca0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.026+0000 7fca217fa640 1 -- 172.21.15.40:0/3789849395 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca1c0ab760 con 0x7fca2406a950 2023-12-20T04:23:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.026+0000 7fca23fff640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca0406a430 0x7fca0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.026+0000 7fca23fff640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca0406a430 0x7fca0406c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca14006fd0 tx=0x7fca14008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.030+0000 7fca217fa640 1 -- 172.21.15.40:0/3789849395 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fca1c076d50 con 0x7fca2406a950 2023-12-20T04:23:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.203+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca2414eeb0 con 0x7fca2406a950 2023-12-20T04:23:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.204+0000 7fca217fa640 1 -- 172.21.15.40:0/3789849395 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca1c07a370 con 0x7fca2406a950 2023-12-20T04:23:48.204 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca0406a430 msgr2=0x7fca0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca0406a430 0x7fca0406c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fca14006fd0 tx=0x7fca14008040 comp rx=0 tx=0).stop 2023-12-20T04:23:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2406a950 msgr2=0x7fca240a3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2406a950 0x7fca240a3ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009d90 tx=0x7fca1c004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 shutdown_connections 2023-12-20T04:23:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca0406a430 0x7fca0406c8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca240bee00 0x7fca240a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca240bb140 0x7fca240a1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 --2- 172.21.15.40:0/3789849395 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca2406a950 0x7fca240a3ed0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 >> 172.21.15.40:0/3789849395 conn(0x7fca240bcfd0 msgr2=0x7fca240a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 shutdown_connections 2023-12-20T04:23:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.206+0000 7fca2b188640 1 -- 172.21.15.40:0/3789849395 wait complete. 2023-12-20T04:23:48.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:48.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.326+0000 7fa15b2e0640 1 Processor -- start 2023-12-20T04:23:48.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.326+0000 7fa15b2e0640 1 -- start start 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15b2e0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1540bb140 0x7fa1540be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15b2e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1540bfa50 con 0x7fa15406a950 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15b2e0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15406b040 con 0x7fa1540bf510 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15b2e0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1540bbda0 con 0x7fa1540bb140 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15907c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1540bb140 0x7fa1540be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15887b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa15406a950 0x7fa1540bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55524/0 (socket says 172.21.15.40:55524) 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15887b640 1 -- 172.21.15.40:0/2233575771 learned_addr learned my addr 172.21.15.40:0/2233575771 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15907c640 1 -- 172.21.15.40:0/2233575771 >> v1:172.21.15.69:6789/0 conn(0x7fa1540bf510 legacy=0x7fa154155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:48.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15907c640 1 -- 172.21.15.40:0/2233575771 >> v1:172.21.15.40:6789/0 conn(0x7fa15406a950 legacy=0x7fa1540bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa14bfff640 1 -- 172.21.15.40:0/2233575771 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187848633 0 0) 0x7fa1540bfa50 con 0x7fa15406a950 2023-12-20T04:23:48.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.327+0000 7fa15907c640 1 -- 172.21.15.40:0/2233575771 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1540bb520 con 0x7fa1540bb140 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa15907c640 1 --2- 172.21.15.40:0/2233575771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1540be350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1500097a0 tx=0x7fa15002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09c5bbd1026fdfb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa14bfff640 1 -- 172.21.15.40:0/2233575771 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150031830 con 0x7fa1540bb140 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa14bfff640 1 -- 172.21.15.40:0/2233575771 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150031990 con 0x7fa1540bb140 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa14bfff640 1 -- 172.21.15.40:0/2233575771 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150031d20 con 0x7fa1540bb140 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa15b2e0640 1 -- 172.21.15.40:0/2233575771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 msgr2=0x7fa1540be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/2233575771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1540be350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1500097a0 tx=0x7fa15002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa15b2e0640 1 -- 172.21.15.40:0/2233575771 shutdown_connections 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/2233575771 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1540be350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.328+0000 7fa15b2e0640 1 -- 172.21.15.40:0/2233575771 >> 172.21.15.40:0/2233575771 conn(0x7fa1540bcfd0 msgr2=0x7fa1540bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:48.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.329+0000 7fa15b2e0640 1 -- 172.21.15.40:0/2233575771 shutdown_connections 2023-12-20T04:23:48.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.329+0000 7fa15b2e0640 1 -- 172.21.15.40:0/2233575771 wait complete. 2023-12-20T04:23:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 Processor -- start 2023-12-20T04:23:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 -- start start 2023-12-20T04:23:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa15406a950 0x7fa15414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1541e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1540bf510 0x7fa1541e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa154144d50 con 0x7fa1540bb140 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15414abd0 con 0x7fa15406a950 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15b2e0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15414ed40 con 0x7fa1540bf510 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15887b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1541e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15887b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1541e3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42670/0 (socket says 172.21.15.40:42670) 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.330+0000 7fa15887b640 1 -- 172.21.15.40:0/3826421186 learned_addr learned my addr 172.21.15.40:0/3826421186 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15907c640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa15406a950 0x7fa15414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15987d640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1540bf510 0x7fa1541e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15887b640 1 -- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1540bf510 msgr2=0x7fa1541e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15887b640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1540bf510 0x7fa1541e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15887b640 1 -- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa15406a950 msgr2=0x7fa15414a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15887b640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa15406a950 0x7fa15414a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15887b640 1 -- 172.21.15.40:0/3826421186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa150009400 con 0x7fa1540bb140 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15907c640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa15406a950 0x7fa15414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15887b640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1541e3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa14400c430 tx=0x7fa14400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa149ffb640 1 -- 172.21.15.40:0/3826421186 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440074e0 con 0x7fa1540bb140 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa149ffb640 1 -- 172.21.15.40:0/3826421186 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144007660 con 0x7fa1540bb140 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15414f020 con 0x7fa1540bb140 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa149ffb640 1 -- 172.21.15.40:0/3826421186 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144004a20 con 0x7fa1540bb140 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.331+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15414e9f0 con 0x7fa1540bb140 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.332+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1541e3770 con 0x7fa1540bb140 2023-12-20T04:23:48.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.333+0000 7fa149ffb640 1 -- 172.21.15.40:0/3826421186 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa144004b80 con 0x7fa1540bb140 2023-12-20T04:23:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.333+0000 7fa149ffb640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa13806a430 0x7fa13806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.333+0000 7fa149ffb640 1 -- 172.21.15.40:0/3826421186 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1440886c0 con 0x7fa1540bb140 2023-12-20T04:23:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.333+0000 7fa15907c640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa13806a430 0x7fa13806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.334+0000 7fa15907c640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa13806a430 0x7fa13806c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa150036000 tx=0x7fa15003c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.337+0000 7fa149ffb640 1 -- 172.21.15.40:0/3826421186 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa1541e3770 con 0x7fa1540bb140 2023-12-20T04:23:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.512+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1541e3770 con 0x7fa1540bb140 2023-12-20T04:23:48.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.513+0000 7fa149ffb640 1 -- 172.21.15.40:0/3826421186 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa1541e3770 con 0x7fa1540bb140 2023-12-20T04:23:48.513 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.514+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa13806a430 msgr2=0x7fa13806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.514+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa13806a430 0x7fa13806c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa150036000 tx=0x7fa15003c040 comp rx=0 tx=0).stop 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.514+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 msgr2=0x7fa1541e3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.514+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1541e3a50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa14400c430 tx=0x7fa14400c8f0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 shutdown_connections 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa13806a430 0x7fa13806c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa1540bf510 0x7fa1541e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1540bb140 0x7fa1541e3a50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 --2- 172.21.15.40:0/3826421186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa15406a950 0x7fa15414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 >> 172.21.15.40:0/3826421186 conn(0x7fa1540bcfd0 msgr2=0x7fa1540a3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 shutdown_connections 2023-12-20T04:23:48.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.515+0000 7fa15b2e0640 1 -- 172.21.15.40:0/3826421186 wait complete. 2023-12-20T04:23:48.565 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-20T04:23:48.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-20T04:23:48.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.671+0000 7f5142677640 1 Processor -- start 2023-12-20T04:23:48.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.671+0000 7f5142677640 1 -- start start 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f5142677640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f513c0bcdd0 0x7f513c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f5142677640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f513c0b64c0 0x7f513c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f5142677640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c0bc6b0 con 0x7f513c144cd0 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f5142677640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c0b6900 con 0x7f513c0b64c0 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f5142677640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c0a59f0 con 0x7f513c0bcdd0 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f513b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f513c0b64c0 0x7f513c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f513b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f513c0b64c0 0x7f513c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42678/0 (socket says 172.21.15.40:42678) 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.672+0000 7f513b7fe640 1 -- 172.21.15.40:0/328723855 learned_addr learned my addr 172.21.15.40:0/328723855 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:48.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.673+0000 7f513bfff640 1 --2- 172.21.15.40:0/328723855 >> v2:172.21.15.69:3300/0 conn(0x7f513c0bcdd0 0x7f513c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.673+0000 7f513b7fe640 1 -- 172.21.15.40:0/328723855 >> v2:172.21.15.69:3300/0 conn(0x7f513c0bcdd0 msgr2=0x7f513c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.673+0000 7f513b7fe640 1 --2- 172.21.15.40:0/328723855 >> v2:172.21.15.69:3300/0 conn(0x7f513c0bcdd0 0x7f513c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.673+0000 7f513b7fe640 1 -- 172.21.15.40:0/328723855 >> v1:172.21.15.69:6789/0 conn(0x7f513c144cd0 legacy=0x7f513c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.673+0000 7f513b7fe640 1 -- 172.21.15.40:0/328723855 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c0bc0a0 con 0x7f513c0b64c0 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.673+0000 7f513b7fe640 1 --2- 172.21.15.40:0/328723855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c144790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f513c0c10f0 tx=0x7f512402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14401618a61144c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.673+0000 7f513affd640 1 -- 172.21.15.40:0/328723855 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124030860 con 0x7f513c0b64c0 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f513affd640 1 -- 172.21.15.40:0/328723855 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51240309c0 con 0x7f513c0b64c0 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f513affd640 1 -- 172.21.15.40:0/328723855 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124030d50 con 0x7f513c0b64c0 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 -- 172.21.15.40:0/328723855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 msgr2=0x7f513c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 --2- 172.21.15.40:0/328723855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c144790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f513c0c10f0 tx=0x7f512402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 -- 172.21.15.40:0/328723855 shutdown_connections 2023-12-20T04:23:48.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 --2- 172.21.15.40:0/328723855 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c144790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 --2- 172.21.15.40:0/328723855 >> v2:172.21.15.69:3300/0 conn(0x7f513c0bcdd0 0x7f513c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 -- 172.21.15.40:0/328723855 >> 172.21.15.40:0/328723855 conn(0x7f513c071e60 msgr2=0x7f513c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:48.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 -- 172.21.15.40:0/328723855 shutdown_connections 2023-12-20T04:23:48.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.674+0000 7f5142677640 1 -- 172.21.15.40:0/328723855 wait complete. 2023-12-20T04:23:48.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.675+0000 7f5142677640 1 Processor -- start 2023-12-20T04:23:48.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.675+0000 7f5142677640 1 -- start start 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f5142677640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f5142677640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f513c0bcdd0 0x7f513c1e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f5142677640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f513c144cd0 0x7f513c1e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f5142677640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c06e450 con 0x7f513c0b64c0 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f5142677640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c06d660 con 0x7f513c0bcdd0 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f5142677640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0a4950 con 0x7f513c144cd0 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c06df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42688/0 (socket says 172.21.15.40:42688) 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 -- 172.21.15.40:0/3419742682 learned_addr learned my addr 172.21.15.40:0/3419742682 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 -- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f513c144cd0 msgr2=0x7f513c1e7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f513c144cd0 0x7f513c1e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 -- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f513c0bcdd0 msgr2=0x7f513c1e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f513c0bcdd0 0x7f513c1e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 -- 172.21.15.40:0/3419742682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240094d0 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.676+0000 7f513bfff640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c06df10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f512c00d800 tx=0x7f512c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.677+0000 7f5138ff9640 1 -- 172.21.15.40:0/3419742682 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00b6c0 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.677+0000 7f5138ff9640 1 -- 172.21.15.40:0/3419742682 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00b820 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.677+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c06d8b0 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.677+0000 7f5138ff9640 1 -- 172.21.15.40:0/3419742682 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00bbb0 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.677+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c0a4e80 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.678+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c0a5010 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.678+0000 7f5138ff9640 1 -- 172.21.15.40:0/3419742682 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f512c00bd10 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.678+0000 7f5138ff9640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f511c06a430 0x7f511c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.678+0000 7f5138ff9640 1 -- 172.21.15.40:0/3419742682 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f512c088dd0 con 0x7f513c0b64c0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.679+0000 7f513b7fe640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f511c06a430 0x7f511c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:48.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.679+0000 7f513b7fe640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f511c06a430 0x7f511c06c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5124036000 tx=0x7f512403b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:48.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.682+0000 7f5138ff9640 1 -- 172.21.15.40:0/3419742682 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f512c054450 con 0x7f513c0b64c0 2023-12-20T04:23:48.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:48.926+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f513c04e840 con 0x7f513c0b64c0 2023-12-20T04:23:49.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.347+0000 7f5138ff9640 1 -- 172.21.15.40:0/3419742682 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v42) v1 ==== 166+0+0 (secure 0 0 0) 0x7f512c057a70 con 0x7f513c0b64c0 2023-12-20T04:23:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f511c06a430 msgr2=0x7f511c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f511c06a430 0x7f511c06c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5124036000 tx=0x7f512403b040 comp rx=0 tx=0).stop 2023-12-20T04:23:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 msgr2=0x7f513c06df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c06df10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f512c00d800 tx=0x7f512c00dcc0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 shutdown_connections 2023-12-20T04:23:49.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f511c06a430 0x7f511c06c8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f513c144cd0 0x7f513c1e7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f513c0bcdd0 0x7f513c1e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 --2- 172.21.15.40:0/3419742682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f513c0b64c0 0x7f513c06df10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 >> 172.21.15.40:0/3419742682 conn(0x7f513c071e60 msgr2=0x7f513c141d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 shutdown_connections 2023-12-20T04:23:49.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.349+0000 7f5142677640 1 -- 172.21.15.40:0/3419742682 wait complete. 2023-12-20T04:23:49.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:23:49.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.477+0000 7f09a3373640 1 Processor -- start 2023-12-20T04:23:49.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.478+0000 7f09a3373640 1 -- start start 2023-12-20T04:23:49.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.478+0000 7f09a3373640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f099c14eee0 0x7f099c0b9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:49.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.478+0000 7f09a3373640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c06a030 0x7f099c155560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.478+0000 7f09a3373640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099c14e1d0 con 0x7f099c069ba0 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.478+0000 7f09a3373640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099c0b9230 con 0x7f099c14eee0 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.478+0000 7f09a3373640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0b98d0 con 0x7f099c06a030 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a1910640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c06a030 0x7f099c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a110f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f099c14eee0 0x7f099c0b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a090e640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f099c069ba0 0x7f099c070210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:48320/0 (socket says 172.21.15.40:48320) 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a1910640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c06a030 0x7f099c155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:55448/0 (socket says 172.21.15.40:55448) 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a090e640 1 -- 172.21.15.40:0/279158973 learned_addr learned my addr 172.21.15.40:0/279158973 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a110f640 1 -- 172.21.15.40:0/279158973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c06a030 msgr2=0x7f099c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a110f640 1 --2- 172.21.15.40:0/279158973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c06a030 0x7f099c155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a110f640 1 -- 172.21.15.40:0/279158973 >> v1:172.21.15.69:6789/0 conn(0x7f099c069ba0 legacy=0x7f099c070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.479+0000 7f09a110f640 1 -- 172.21.15.40:0/279158973 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099c0b8990 con 0x7f099c14eee0 2023-12-20T04:23:49.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f09a110f640 1 --2- 172.21.15.40:0/279158973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 0x7f099c0b9390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f098c009d90 tx=0x7f098c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb92241e80d15dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f099bfff640 1 -- 172.21.15.40:0/279158973 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c02cc50 con 0x7f099c14eee0 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f099bfff640 1 -- 172.21.15.40:0/279158973 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c02cdb0 con 0x7f099c14eee0 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f099bfff640 1 -- 172.21.15.40:0/279158973 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c034660 con 0x7f099c14eee0 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f09a3373640 1 -- 172.21.15.40:0/279158973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 msgr2=0x7f099c0b9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f09a3373640 1 --2- 172.21.15.40:0/279158973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 0x7f099c0b9390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f098c009d90 tx=0x7f098c02bea0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f09a3373640 1 -- 172.21.15.40:0/279158973 shutdown_connections 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f09a3373640 1 --2- 172.21.15.40:0/279158973 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c06a030 0x7f099c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f09a3373640 1 --2- 172.21.15.40:0/279158973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 0x7f099c0b9390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.480+0000 7f09a3373640 1 -- 172.21.15.40:0/279158973 >> 172.21.15.40:0/279158973 conn(0x7f099c06ae90 msgr2=0x7f099c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.481+0000 7f09a3373640 1 -- 172.21.15.40:0/279158973 shutdown_connections 2023-12-20T04:23:49.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.481+0000 7f09a3373640 1 -- 172.21.15.40:0/279158973 wait complete. 2023-12-20T04:23:49.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 Processor -- start 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 -- start start 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c069ba0 0x7f099c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f099c06a030 0x7f099c148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 0x7f099c140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c149080 con 0x7f099c06a030 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c0b5de0 con 0x7f099c14eee0 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a3373640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f099c148110 con 0x7f099c069ba0 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a090e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f099c06a030 0x7f099c148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a090e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f099c06a030 0x7f099c148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42702/0 (socket says 172.21.15.40:42702) 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a090e640 1 -- 172.21.15.40:0/2633005956 learned_addr learned my addr 172.21.15.40:0/2633005956 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a110f640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c069ba0 0x7f099c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.482+0000 7f09a1910640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 0x7f099c140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a090e640 1 -- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c069ba0 msgr2=0x7f099c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a090e640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c069ba0 0x7f099c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a090e640 1 -- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 msgr2=0x7f099c140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a090e640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 0x7f099c140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a090e640 1 -- 172.21.15.40:0/2633005956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009a70 con 0x7f099c06a030 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a110f640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c069ba0 0x7f099c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a090e640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f099c06a030 0x7f099c148610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f099000c4a0 tx=0x7f099000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f0999ffb640 1 -- 172.21.15.40:0/2633005956 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990005ce0 con 0x7f099c06a030 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f0999ffb640 1 -- 172.21.15.40:0/2633005956 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0990005e40 con 0x7f099c06a030 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c14a4d0 con 0x7f099c06a030 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f0999ffb640 1 -- 172.21.15.40:0/2633005956 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990007270 con 0x7f099c06a030 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.483+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c14aa90 con 0x7f099c06a030 2023-12-20T04:23:49.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.484+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c0740a0 con 0x7f099c06a030 2023-12-20T04:23:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.484+0000 7f0999ffb640 1 -- 172.21.15.40:0/2633005956 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0990007490 con 0x7f099c06a030 2023-12-20T04:23:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.485+0000 7f0999ffb640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f098806a430 0x7f098806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.485+0000 7f0999ffb640 1 -- 172.21.15.40:0/2633005956 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0990087d20 con 0x7f099c06a030 2023-12-20T04:23:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.485+0000 7f09a110f640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f098806a430 0x7f098806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:49.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.486+0000 7f09a110f640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f098806a430 0x7f098806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f098c036000 tx=0x7f098c030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:49.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.489+0000 7f0999ffb640 1 -- 172.21.15.40:0/2633005956 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0990053450 con 0x7f099c06a030 2023-12-20T04:23:49.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.664+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f099c145100 con 0x7f099c06a030 2023-12-20T04:23:49.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.670+0000 7f0999ffb640 1 -- 172.21.15.40:0/2633005956 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f099c145100 con 0x7f099c06a030 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f098806a430 msgr2=0x7f098806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f098806a430 0x7f098806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f098c036000 tx=0x7f098c030000 comp rx=0 tx=0).stop 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f099c06a030 msgr2=0x7f099c148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f099c06a030 0x7f099c148610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f099000c4a0 tx=0x7f099000c960 comp rx=0 tx=0).stop 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 shutdown_connections 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f098806a430 0x7f098806c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f099c14eee0 0x7f099c140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f099c06a030 0x7f099c148610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 --2- 172.21.15.40:0/2633005956 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f099c069ba0 0x7f099c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 >> 172.21.15.40:0/2633005956 conn(0x7f099c06ae90 msgr2=0x7f099c06b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 shutdown_connections 2023-12-20T04:23:49.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:49.672+0000 7f09a3373640 1 -- 172.21.15.40:0/2633005956 wait complete. 2023-12-20T04:23:49.682 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:23:49.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:23:49.772 DEBUG:teuthology.orchestra.run.smithi069:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:23:49.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:23:50.056 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:23:50.056 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:23:50.056 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:23:50.111 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:23:50.111 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:23:50.163 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:23:50.163 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:23:50.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.327+0000 7f3394e2c640 1 Processor -- start 2023-12-20T04:23:50.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.327+0000 7f3394e2c640 1 -- start start 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.328+0000 7f3394e2c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f33900b4f90 0x7f33900b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.328+0000 7f3394e2c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.328+0000 7f3394e2c640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900b8270 con 0x7f3390070ff0 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.328+0000 7f3394e2c640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33900b6d70 con 0x7f33900b4f90 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.328+0000 7f3394e2c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900b56e0 con 0x7f33900b7e00 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.328+0000 7f338dd9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f33900b4f90 0x7f33900b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.328+0000 7f338ed9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338dd9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f33900b4f90 0x7f33900b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:51602/0 (socket says 172.21.15.40:51602) 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338ed9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:55472/0 (socket says 172.21.15.40:55472) 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338dd9b640 1 -- 172.21.15.40:0/2867642004 learned_addr learned my addr 172.21.15.40:0/2867642004 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:50.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338ed9d640 1 -- 172.21.15.40:0/2867642004 >> v2:172.21.15.69:3300/0 conn(0x7f33900b4f90 msgr2=0x7f33900b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338ed9d640 1 --2- 172.21.15.40:0/2867642004 >> v2:172.21.15.69:3300/0 conn(0x7f33900b4f90 0x7f33900b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338ed9d640 1 -- 172.21.15.40:0/2867642004 >> v1:172.21.15.69:6789/0 conn(0x7f3390070ff0 legacy=0x7f3390142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338ed9d640 1 -- 172.21.15.40:0/2867642004 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900b59c0 con 0x7f33900b7e00 2023-12-20T04:23:50.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.329+0000 7f338dd9b640 1 --2- 172.21.15.40:0/2867642004 >> v2:172.21.15.69:3300/0 conn(0x7f33900b4f90 0x7f33900b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:50.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f338ed9d640 1 --2- 172.21.15.40:0/2867642004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901531a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3388009d90 tx=0x7f338802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcd6479ebc9ae672 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f338d59a640 1 -- 172.21.15.40:0/2867642004 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338802cce0 con 0x7f33900b7e00 2023-12-20T04:23:50.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f338d59a640 1 -- 172.21.15.40:0/2867642004 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338802ce40 con 0x7f33900b7e00 2023-12-20T04:23:50.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f338d59a640 1 -- 172.21.15.40:0/2867642004 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388034660 con 0x7f33900b7e00 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f3394e2c640 1 -- 172.21.15.40:0/2867642004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 msgr2=0x7f33901531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f3394e2c640 1 --2- 172.21.15.40:0/2867642004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901531a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3388009d90 tx=0x7f338802bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f3394e2c640 1 -- 172.21.15.40:0/2867642004 shutdown_connections 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f3394e2c640 1 --2- 172.21.15.40:0/2867642004 >> v2:172.21.15.69:3300/0 conn(0x7f33900b4f90 0x7f33900b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f3394e2c640 1 --2- 172.21.15.40:0/2867642004 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901531a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.330+0000 7f3394e2c640 1 -- 172.21.15.40:0/2867642004 >> 172.21.15.40:0/2867642004 conn(0x7f33900be120 msgr2=0x7f33900be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.331+0000 7f3394e2c640 1 -- 172.21.15.40:0/2867642004 shutdown_connections 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.331+0000 7f3394e2c640 1 -- 172.21.15.40:0/2867642004 wait complete. 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 Processor -- start 2023-12-20T04:23:50.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 -- start start 2023-12-20T04:23:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3390070ff0 0x7f339006c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33900b4f90 0x7f33901e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33901e3820 con 0x7f33900b4f90 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33901e3fa0 con 0x7f3390070ff0 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f3394e2c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33901e0b90 con 0x7f33900b7e00 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.332+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33900b4f90 0x7f33901e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33900b4f90 0x7f33901e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42710/0 (socket says 172.21.15.40:42710) 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 -- 172.21.15.40:0/178656698 learned_addr learned my addr 172.21.15.40:0/178656698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338ed9d640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338e59c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3390070ff0 0x7f339006c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 -- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 msgr2=0x7f33901467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 -- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3390070ff0 msgr2=0x7f339006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3390070ff0 0x7f339006c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 -- 172.21.15.40:0/178656698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33840094d0 con 0x7f33900b4f90 2023-12-20T04:23:50.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f338dd9b640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33900b4f90 0x7f33901e32e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f338400e9a0 tx=0x7f338400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f337effd640 1 -- 172.21.15.40:0/178656698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400ca00 con 0x7f33900b4f90 2023-12-20T04:23:50.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f337effd640 1 -- 172.21.15.40:0/178656698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338400cb60 con 0x7f33900b4f90 2023-12-20T04:23:50.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f337effd640 1 -- 172.21.15.40:0/178656698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384013470 con 0x7f33900b4f90 2023-12-20T04:23:50.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3388009a70 con 0x7f33900b4f90 2023-12-20T04:23:50.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.333+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3390148910 con 0x7f33900b4f90 2023-12-20T04:23:50.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.334+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339004e840 con 0x7f33900b4f90 2023-12-20T04:23:50.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.335+0000 7f337effd640 1 -- 172.21.15.40:0/178656698 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33840135d0 con 0x7f33900b4f90 2023-12-20T04:23:50.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.335+0000 7f337effd640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.335+0000 7f337effd640 1 -- 172.21.15.40:0/178656698 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3384088b70 con 0x7f33900b4f90 2023-12-20T04:23:50.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.335+0000 7f338e59c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.336+0000 7f338e59c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3380001780 tx=0x7f3380009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.339+0000 7f337effd640 1 -- 172.21.15.40:0/178656698 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3384054200 con 0x7f33900b4f90 2023-12-20T04:23:50.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.517+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33900716d0 con 0x7f33900b4f90 2023-12-20T04:23:50.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.518+0000 7f337effd640 1 -- 172.21.15.40:0/178656698 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f3384021090 con 0x7f33900b4f90 2023-12-20T04:23:50.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:50.519 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 msgr2=0x7f337006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3380001780 tx=0x7f3380009040 comp rx=0 tx=0).stop 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33900b4f90 msgr2=0x7f33901e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33900b4f90 0x7f33901e32e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f338400e9a0 tx=0x7f338400ee60 comp rx=0 tx=0).stop 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 shutdown_connections 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33900b7e00 0x7f33901467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33900b4f90 0x7f33901e32e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 --2- 172.21.15.40:0/178656698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3390070ff0 0x7f339006c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 >> 172.21.15.40:0/178656698 conn(0x7f33900be120 msgr2=0x7f33900be500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 shutdown_connections 2023-12-20T04:23:50.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.521+0000 7f3394e2c640 1 -- 172.21.15.40:0/178656698 wait complete. 2023-12-20T04:23:50.531 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:50.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:50.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.640+0000 7f2a93516640 1 Processor -- start 2023-12-20T04:23:50.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.640+0000 7f2a93516640 1 -- start start 2023-12-20T04:23:50.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a93516640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a8c0bf510 0x7f2a8c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a93516640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c0bfa50 con 0x7f2a8c0bb140 2023-12-20T04:23:50.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a93516640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c06b040 con 0x7f2a8c06a950 2023-12-20T04:23:50.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a93516640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c0bbda0 con 0x7f2a8c0bf510 2023-12-20T04:23:50.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a90ab1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a8c0bf510 0x7f2a8c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a912b2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2a8c0bb140 0x7f2a8c0bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55540/0 (socket says 172.21.15.40:55540) 2023-12-20T04:23:50.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a912b2640 1 -- 172.21.15.40:0/2366758945 learned_addr learned my addr 172.21.15.40:0/2366758945 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:50.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a90ab1640 1 -- 172.21.15.40:0/2366758945 >> v1:172.21.15.69:6789/0 conn(0x7f2a8c06a950 legacy=0x7f2a8c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:50.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a90ab1640 1 -- 172.21.15.40:0/2366758945 >> v1:172.21.15.40:6789/0 conn(0x7f2a8c0bb140 legacy=0x7f2a8c0bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a90ab1640 1 -- 172.21.15.40:0/2366758945 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c0bb520 con 0x7f2a8c0bf510 2023-12-20T04:23:50.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.641+0000 7f2a8bfff640 1 -- 172.21.15.40:0/2366758945 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771720943 0 0) 0x7f2a8c0bfa50 con 0x7f2a8c0bb140 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.642+0000 7f2a90ab1640 1 --2- 172.21.15.40:0/2366758945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c0be350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a800097a0 tx=0x7f2a8002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b112e71bdbd3760 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.642+0000 7f2a8bfff640 1 -- 172.21.15.40:0/2366758945 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80031830 con 0x7f2a8c0bf510 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.642+0000 7f2a8bfff640 1 -- 172.21.15.40:0/2366758945 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80031990 con 0x7f2a8c0bf510 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.642+0000 7f2a8bfff640 1 -- 172.21.15.40:0/2366758945 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80031d20 con 0x7f2a8c0bf510 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.643+0000 7f2a93516640 1 -- 172.21.15.40:0/2366758945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 msgr2=0x7f2a8c0be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.643+0000 7f2a93516640 1 --2- 172.21.15.40:0/2366758945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c0be350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a800097a0 tx=0x7f2a8002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.643+0000 7f2a93516640 1 -- 172.21.15.40:0/2366758945 shutdown_connections 2023-12-20T04:23:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.643+0000 7f2a93516640 1 --2- 172.21.15.40:0/2366758945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c0be350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.643+0000 7f2a93516640 1 -- 172.21.15.40:0/2366758945 >> 172.21.15.40:0/2366758945 conn(0x7f2a8c0bcfd0 msgr2=0x7f2a8c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.643+0000 7f2a93516640 1 -- 172.21.15.40:0/2366758945 shutdown_connections 2023-12-20T04:23:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.643+0000 7f2a93516640 1 -- 172.21.15.40:0/2366758945 wait complete. 2023-12-20T04:23:50.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 Processor -- start 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 -- start start 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2a8c06a950 0x7f2a8c146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a8c0bb140 0x7f2a8c14d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c146ad0 con 0x7f2a8c0bf510 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0a2120 con 0x7f2a8c0bb140 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.644+0000 7f2a93516640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0a1320 con 0x7f2a8c06a950 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c14d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42724/0 (socket says 172.21.15.40:42724) 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 -- 172.21.15.40:0/903055060 learned_addr learned my addr 172.21.15.40:0/903055060 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a90ab1640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a8c0bb140 0x7f2a8c14d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a912b2640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2a8c06a950 0x7f2a8c146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 -- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2a8c06a950 msgr2=0x7f2a8c146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2a8c06a950 0x7f2a8c146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 -- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a8c0bb140 msgr2=0x7f2a8c14d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a8c0bb140 0x7f2a8c14d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 -- 172.21.15.40:0/903055060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a80009400 con 0x7f2a8c0bf510 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a91ab3640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c14d560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b410 tx=0x7f2a8400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a89ffb640 1 -- 172.21.15.40:0/903055060 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84004020 con 0x7f2a8c0bf510 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a89ffb640 1 -- 172.21.15.40:0/903055060 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a84004180 con 0x7f2a8c0bf510 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c0a05a0 con 0x7f2a8c0bf510 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.645+0000 7f2a89ffb640 1 -- 172.21.15.40:0/903055060 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a84011630 con 0x7f2a8c0bf510 2023-12-20T04:23:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.646+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c0a49f0 con 0x7f2a8c0bf510 2023-12-20T04:23:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.646+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c09fa00 con 0x7f2a8c0bf510 2023-12-20T04:23:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.647+0000 7f2a89ffb640 1 -- 172.21.15.40:0/903055060 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a84011790 con 0x7f2a8c0bf510 2023-12-20T04:23:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.647+0000 7f2a89ffb640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2a7806a460 0x7f2a7806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.647+0000 7f2a89ffb640 1 -- 172.21.15.40:0/903055060 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a84088530 con 0x7f2a8c0bf510 2023-12-20T04:23:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.647+0000 7f2a912b2640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2a7806a460 0x7f2a7806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.648+0000 7f2a912b2640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2a7806a460 0x7f2a7806c920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0012e0 tx=0x7f2a7c001700 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.651+0000 7f2a89ffb640 1 -- 172.21.15.40:0/903055060 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2a84053aa0 con 0x7f2a8c0bf510 2023-12-20T04:23:50.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.830+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a8c0740a0 con 0x7f2a8c0bf510 2023-12-20T04:23:50.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.831+0000 7f2a89ffb640 1 -- 172.21.15.40:0/903055060 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a840150a0 con 0x7f2a8c0bf510 2023-12-20T04:23:50.831 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2a7806a460 msgr2=0x7f2a7806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2a7806a460 0x7f2a7806c920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0012e0 tx=0x7f2a7c001700 comp rx=0 tx=0).stop 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 msgr2=0x7f2a8c14d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c14d560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400b410 tx=0x7f2a8400b8d0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 shutdown_connections 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2a7806a460 0x7f2a7806c920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0bf510 0x7f2a8c14d560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a8c0bb140 0x7f2a8c14d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 --2- 172.21.15.40:0/903055060 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2a8c06a950 0x7f2a8c146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 >> 172.21.15.40:0/903055060 conn(0x7f2a8c0bcfd0 msgr2=0x7f2a8c0a36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 shutdown_connections 2023-12-20T04:23:50.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.833+0000 7f2a93516640 1 -- 172.21.15.40:0/903055060 wait complete. 2023-12-20T04:23:50.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:50.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.952+0000 7fa06baab640 1 Processor -- start 2023-12-20T04:23:50.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.952+0000 7fa06baab640 1 -- start start 2023-12-20T04:23:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa06baab640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa0640bb140 0x7fa0640be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa06baab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa06406a950 0x7fa0640bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa06baab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0640bfa50 con 0x7fa0640bee00 2023-12-20T04:23:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa06baab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0640bbda0 con 0x7fa06406a950 2023-12-20T04:23:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa06baab640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06406b040 con 0x7fa0640bb140 2023-12-20T04:23:50.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa069046640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa06406a950 0x7fa0640bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa06a048640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa0640bee00 0x7fa0640bf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55550/0 (socket says 172.21.15.40:55550) 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa06a048640 1 -- 172.21.15.40:0/3784992167 learned_addr learned my addr 172.21.15.40:0/3784992167 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa069046640 1 -- 172.21.15.40:0/3784992167 >> v2:172.21.15.69:3300/0 conn(0x7fa0640bb140 msgr2=0x7fa0640be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa069847640 1 --2- 172.21.15.40:0/3784992167 >> v2:172.21.15.69:3300/0 conn(0x7fa0640bb140 0x7fa0640be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa069046640 1 --2- 172.21.15.40:0/3784992167 >> v2:172.21.15.69:3300/0 conn(0x7fa0640bb140 0x7fa0640be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa069046640 1 -- 172.21.15.40:0/3784992167 >> v1:172.21.15.40:6789/0 conn(0x7fa0640bee00 legacy=0x7fa0640bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa069046640 1 -- 172.21.15.40:0/3784992167 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640bb520 con 0x7fa06406a950 2023-12-20T04:23:50.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.953+0000 7fa068845640 1 -- 172.21.15.40:0/3784992167 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723537408 0 0) 0x7fa0640bfa50 con 0x7fa0640bee00 2023-12-20T04:23:50.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.954+0000 7fa069046640 1 --2- 172.21.15.40:0/3784992167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa06406a950 0x7fa0640bfee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa064067620 tx=0x7fa05402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0f360c5b104ef server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.954+0000 7fa068845640 1 -- 172.21.15.40:0/3784992167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05402e070 con 0x7fa06406a950 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.954+0000 7fa068845640 1 -- 172.21.15.40:0/3784992167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540315a0 con 0x7fa06406a950 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.954+0000 7fa068845640 1 -- 172.21.15.40:0/3784992167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054031930 con 0x7fa06406a950 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 -- 172.21.15.40:0/3784992167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa06406a950 msgr2=0x7fa0640bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 --2- 172.21.15.40:0/3784992167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa06406a950 0x7fa0640bfee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa064067620 tx=0x7fa05402b840 comp rx=0 tx=0).stop 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 -- 172.21.15.40:0/3784992167 shutdown_connections 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 --2- 172.21.15.40:0/3784992167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa06406a950 0x7fa0640bfee0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 --2- 172.21.15.40:0/3784992167 >> v2:172.21.15.69:3300/0 conn(0x7fa0640bb140 0x7fa0640be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 -- 172.21.15.40:0/3784992167 >> 172.21.15.40:0/3784992167 conn(0x7fa0640bcfd0 msgr2=0x7fa0640bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:50.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 -- 172.21.15.40:0/3784992167 shutdown_connections 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.955+0000 7fa06baab640 1 -- 172.21.15.40:0/3784992167 wait complete. 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.956+0000 7fa06baab640 1 Processor -- start 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.956+0000 7fa06baab640 1 -- start start 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.956+0000 7fa06baab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa06406a950 0x7fa0640a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.956+0000 7fa06baab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0640bb140 0x7fa0640b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.956+0000 7fa06baab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0640bee00 0x7fa064147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa06baab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0640a2ef0 con 0x7fa0640bb140 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa06baab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06414dec0 con 0x7fa0640bee00 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa06baab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06414e1a0 con 0x7fa06406a950 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0640bb140 0x7fa0640b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0640bb140 0x7fa0640b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42748/0 (socket says 172.21.15.40:42748) 2023-12-20T04:23:50.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 -- 172.21.15.40:0/683071779 learned_addr learned my addr 172.21.15.40:0/683071779 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa06a048640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0640bee00 0x7fa064147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069847640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa06406a950 0x7fa0640a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 -- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa06406a950 msgr2=0x7fa0640a29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa06406a950 0x7fa0640a29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 -- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0640bee00 msgr2=0x7fa064147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0640bee00 0x7fa064147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 -- 172.21.15.40:0/683071779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054009400 con 0x7fa0640bb140 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa069046640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0640bb140 0x7fa0640b6a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa054009890 tx=0x7fa0540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa05a7fc640 1 -- 172.21.15.40:0/683071779 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054032900 con 0x7fa0640bb140 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa05a7fc640 1 -- 172.21.15.40:0/683071779 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054032a60 con 0x7fa0640bb140 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa05a7fc640 1 -- 172.21.15.40:0/683071779 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054032e10 con 0x7fa0640bb140 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0641e2f90 con 0x7fa0640bb140 2023-12-20T04:23:50.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.957+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0640b6f50 con 0x7fa0640bb140 2023-12-20T04:23:50.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.958+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06414dd20 con 0x7fa0640bb140 2023-12-20T04:23:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.959+0000 7fa05a7fc640 1 -- 172.21.15.40:0/683071779 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa0540453f0 con 0x7fa0640bb140 2023-12-20T04:23:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.959+0000 7fa05a7fc640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa04806a430 0x7fa04806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.959+0000 7fa05a7fc640 1 -- 172.21.15.40:0/683071779 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0540aa920 con 0x7fa0640bb140 2023-12-20T04:23:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.959+0000 7fa069847640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa04806a430 0x7fa04806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:50.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.960+0000 7fa069847640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa04806a430 0x7fa04806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00aa20 tx=0x7fa05c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:50.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:50.963+0000 7fa05a7fc640 1 -- 172.21.15.40:0/683071779 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa06414dd20 con 0x7fa0640bb140 2023-12-20T04:23:51.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.140+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa06414dd20 con 0x7fa0640bb140 2023-12-20T04:23:51.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.140+0000 7fa05a7fc640 1 -- 172.21.15.40:0/683071779 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa06414dd20 con 0x7fa0640bb140 2023-12-20T04:23:51.140 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa04806a430 msgr2=0x7fa04806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa04806a430 0x7fa04806c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa05c00aa20 tx=0x7fa05c008040 comp rx=0 tx=0).stop 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0640bb140 msgr2=0x7fa0640b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0640bb140 0x7fa0640b6a10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa054009890 tx=0x7fa0540046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 shutdown_connections 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa04806a430 0x7fa04806c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0640bee00 0x7fa064147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0640bb140 0x7fa0640b6a10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 --2- 172.21.15.40:0/683071779 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa06406a950 0x7fa0640a29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 >> 172.21.15.40:0/683071779 conn(0x7fa0640bcfd0 msgr2=0x7fa0640a55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 shutdown_connections 2023-12-20T04:23:51.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.143+0000 7fa06baab640 1 -- 172.21.15.40:0/683071779 wait complete. 2023-12-20T04:23:51.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:51.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.262+0000 7f77147e0640 1 Processor -- start 2023-12-20T04:23:51.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.262+0000 7f77147e0640 1 -- start start 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f77147e0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f770c0bb140 0x7f770c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f77147e0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f770c06a950 0x7f770c0bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f77147e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0bfa50 con 0x7f770c0bee00 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f77147e0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0bbda0 con 0x7f770c0bb140 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f77147e0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c06b040 con 0x7f770c06a950 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f771257c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f770c0bb140 0x7f770c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f7712d7d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f770c0bee00 0x7f770c0bf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55552/0 (socket says 172.21.15.40:55552) 2023-12-20T04:23:51.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f7712d7d640 1 -- 172.21.15.40:0/221690890 learned_addr learned my addr 172.21.15.40:0/221690890 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f7711d7b640 1 --2- 172.21.15.40:0/221690890 >> v2:172.21.15.69:3300/0 conn(0x7f770c06a950 0x7f770c0bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f771257c640 1 -- 172.21.15.40:0/221690890 >> v2:172.21.15.69:3300/0 conn(0x7f770c06a950 msgr2=0x7f770c0bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f771257c640 1 --2- 172.21.15.40:0/221690890 >> v2:172.21.15.69:3300/0 conn(0x7f770c06a950 0x7f770c0bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f771257c640 1 -- 172.21.15.40:0/221690890 >> v1:172.21.15.40:6789/0 conn(0x7f770c0bee00 legacy=0x7f770c0bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.263+0000 7f771257c640 1 -- 172.21.15.40:0/221690890 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0bb520 con 0x7f770c0bb140 2023-12-20T04:23:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.264+0000 7f771257c640 1 --2- 172.21.15.40:0/221690890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0bb140 0x7f770c0be350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f770c06b650 tx=0x7f770402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2a2a614de23d54 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.264+0000 7f771157a640 1 -- 172.21.15.40:0/221690890 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770402cbf0 con 0x7f770c0bb140 2023-12-20T04:23:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.264+0000 7f771157a640 1 -- 172.21.15.40:0/221690890 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770402cd50 con 0x7f770c0bb140 2023-12-20T04:23:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.264+0000 7f771157a640 1 -- 172.21.15.40:0/221690890 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7704034660 con 0x7f770c0bb140 2023-12-20T04:23:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 -- 172.21.15.40:0/221690890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0bb140 msgr2=0x7f770c0be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 --2- 172.21.15.40:0/221690890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0bb140 0x7f770c0be350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f770c06b650 tx=0x7f770402be40 comp rx=0 tx=0).stop 2023-12-20T04:23:51.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 -- 172.21.15.40:0/221690890 shutdown_connections 2023-12-20T04:23:51.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 --2- 172.21.15.40:0/221690890 >> v2:172.21.15.69:3300/0 conn(0x7f770c06a950 0x7f770c0bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 --2- 172.21.15.40:0/221690890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0bb140 0x7f770c0be350 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 -- 172.21.15.40:0/221690890 >> 172.21.15.40:0/221690890 conn(0x7f770c0bcfd0 msgr2=0x7f770c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:51.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 -- 172.21.15.40:0/221690890 shutdown_connections 2023-12-20T04:23:51.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.265+0000 7f77147e0640 1 -- 172.21.15.40:0/221690890 wait complete. 2023-12-20T04:23:51.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.266+0000 7f77147e0640 1 Processor -- start 2023-12-20T04:23:51.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.266+0000 7f77147e0640 1 -- start start 2023-12-20T04:23:51.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c06a950 0x7f770c0a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f770c0bb140 0x7f770c14dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f770c0bee00 0x7f770c0a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0a2d10 con 0x7f770c06a950 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1dfc30 con 0x7f770c0bee00 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c14e130 con 0x7f770c0bb140 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c06a950 0x7f770c0a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c06a950 0x7f770c0a27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42768/0 (socket says 172.21.15.40:42768) 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 -- 172.21.15.40:0/117027392 learned_addr learned my addr 172.21.15.40:0/117027392 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f7711d7b640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f770c0bb140 0x7f770c14dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f7712d7d640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f770c0bee00 0x7f770c0a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 -- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f770c0bb140 msgr2=0x7f770c14dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f770c0bb140 0x7f770c14dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 -- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f770c0bee00 msgr2=0x7f770c0a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f770c0bee00 0x7f770c0a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 -- 172.21.15.40:0/117027392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7704009a70 con 0x7f770c06a950 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f7712d7d640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f770c0bee00 0x7f770c0a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f771257c640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c06a950 0x7f770c0a27d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f770402c450 tx=0x7f7704004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f7702ffd640 1 -- 172.21.15.40:0/117027392 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770403e610 con 0x7f770c06a950 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f7702ffd640 1 -- 172.21.15.40:0/117027392 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770403e790 con 0x7f770c06a950 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c1dfe20 con 0x7f770c06a950 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f7702ffd640 1 -- 172.21.15.40:0/117027392 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770403eb40 con 0x7f770c06a950 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.267+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c1e03e0 con 0x7f770c06a950 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.268+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0740a0 con 0x7f770c06a950 2023-12-20T04:23:51.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.269+0000 7f7702ffd640 1 -- 172.21.15.40:0/117027392 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f770403b050 con 0x7f770c06a950 2023-12-20T04:23:51.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.269+0000 7f7702ffd640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f76f006a460 0x7f76f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.269+0000 7f7702ffd640 1 -- 172.21.15.40:0/117027392 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77040ab300 con 0x7f770c06a950 2023-12-20T04:23:51.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.269+0000 7f7711d7b640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f76f006a460 0x7f76f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.270+0000 7f7711d7b640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f76f006a460 0x7f76f006c920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76fc006fd0 tx=0x7f76fc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:51.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.273+0000 7f7702ffd640 1 -- 172.21.15.40:0/117027392 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7704076a10 con 0x7f770c06a950 2023-12-20T04:23:51.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.450+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f770c0b9f30 con 0x7f770c06a950 2023-12-20T04:23:51.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.450+0000 7f7702ffd640 1 -- 172.21.15.40:0/117027392 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7704039020 con 0x7f770c06a950 2023-12-20T04:23:51.450 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f76f006a460 msgr2=0x7f76f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f76f006a460 0x7f76f006c920 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f76fc006fd0 tx=0x7f76fc008040 comp rx=0 tx=0).stop 2023-12-20T04:23:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c06a950 msgr2=0x7f770c0a27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c06a950 0x7f770c0a27d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f770402c450 tx=0x7f7704004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 shutdown_connections 2023-12-20T04:23:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f76f006a460 0x7f76f006c920 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f770c0bee00 0x7f770c0a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f770c0bb140 0x7f770c14dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 --2- 172.21.15.40:0/117027392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c06a950 0x7f770c0a27d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 >> 172.21.15.40:0/117027392 conn(0x7f770c0bcfd0 msgr2=0x7f770c14aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:51.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 shutdown_connections 2023-12-20T04:23:51.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.452+0000 7f77147e0640 1 -- 172.21.15.40:0/117027392 wait complete. 2023-12-20T04:23:51.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:23:51.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.570+0000 7f3ca8251640 1 Processor -- start 2023-12-20T04:23:51.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.570+0000 7f3ca8251640 1 -- start start 2023-12-20T04:23:51.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca8251640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 0x7f3ca014b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca8251640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3ca00b8b40 0x7f3ca0155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca8251640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca00b6da0 con 0x7f3ca0144e30 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca8251640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca00b8090 con 0x7f3ca00b8b40 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca8251640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca014afe0 con 0x7f3ca00bab80 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca5fed640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3ca0144e30 0x7f3ca00b7600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55560/0 (socket says 172.21.15.40:55560) 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca5fed640 1 -- 172.21.15.40:0/2188710310 learned_addr learned my addr 172.21.15.40:0/2188710310 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801873657 0 0) 0x7f3c90001490 con 0x7f3ca0144e30 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 0x7f3ca014b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca67ee640 1 --2- 172.21.15.40:0/2188710310 >> v2:172.21.15.69:3300/0 conn(0x7f3ca00b8b40 0x7f3ca0155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c88003520 con 0x7f3ca0144e30 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.571+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790054455 0 0) 0x7f3c88003520 con 0x7f3ca0144e30 2023-12-20T04:23:51.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 msgr2=0x7f3ca014b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 0x7f3ca014b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 >> v2:172.21.15.69:3300/0 conn(0x7f3ca00b8b40 msgr2=0x7f3ca0155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 --2- 172.21.15.40:0/2188710310 >> v2:172.21.15.69:3300/0 conn(0x7f3ca00b8b40 0x7f3ca0155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca0145210 con 0x7f3ca0144e30 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f3c90001b80 con 0x7f3ca0144e30 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 >> v1:172.21.15.40:6789/0 conn(0x7f3ca0144e30 legacy=0x7f3ca00b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 0x7f3c88003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3c880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c88004d00 0x7f3c88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca00b8090 con 0x7f3c88003ef0 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca014afe0 con 0x7f3c88004d00 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8800b9b0 con 0x7f3ca00bab80 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3c880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca5fed640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 0x7f3c88003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca67ee640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c88004d00 0x7f3c88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca57ec640 1 -- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 msgr2=0x7f3c88003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca00bab80 0x7f3c88003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca57ec640 1 -- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c88004d00 msgr2=0x7f3c88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c88004d00 0x7f3c88005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.572+0000 7f3ca57ec640 1 -- 172.21.15.40:0/2188710310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88003520 con 0x7f3c88003ef0 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.573+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3c880047c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009a80 tx=0x7f3c880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4a60dc27114559 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.573+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94005990 con 0x7f3c88003ef0 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.573+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94005af0 con 0x7f3c88003ef0 2023-12-20T04:23:51.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.573+0000 7f3ca4feb640 1 -- 172.21.15.40:0/2188710310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94005ea0 con 0x7f3c88003ef0 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.573+0000 7f3ca8251640 1 -- 172.21.15.40:0/2188710310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 msgr2=0x7f3c880047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.573+0000 7f3ca8251640 1 --2- 172.21.15.40:0/2188710310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3c880047c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009a80 tx=0x7f3c880057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.573+0000 7f3ca67ee640 1 -- 172.21.15.40:0/2188710310 reap_dead start 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.574+0000 7f3ca8251640 1 -- 172.21.15.40:0/2188710310 shutdown_connections 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.574+0000 7f3ca8251640 1 -- 172.21.15.40:0/2188710310 >> 172.21.15.40:0/2188710310 conn(0x7f3ca00c0200 msgr2=0x7f3ca00c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.574+0000 7f3ca8251640 1 -- 172.21.15.40:0/2188710310 shutdown_connections 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.574+0000 7f3ca8251640 1 -- 172.21.15.40:0/2188710310 wait complete. 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 Processor -- start 2023-12-20T04:23:51.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 -- start start 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3ca01d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca01d1b70 0x7f3ca01e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca01e3840 0x7f3ca0148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca0146420 con 0x7f3c88003ef0 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca0148110 con 0x7f3ca01d1b70 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca8251640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca0148320 con 0x7f3ca01e3840 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca5fed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3ca01d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca5fed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3ca01d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42784/0 (socket says 172.21.15.40:42784) 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.575+0000 7f3ca5fed640 1 -- 172.21.15.40:0/3056057852 learned_addr learned my addr 172.21.15.40:0/3056057852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca01d1b70 0x7f3ca01e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca67ee640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca01e3840 0x7f3ca0148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca5fed640 1 -- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca01e3840 msgr2=0x7f3ca0148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca5fed640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca01e3840 0x7f3ca0148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca5fed640 1 -- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca01d1b70 msgr2=0x7f3ca01e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca5fed640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca01d1b70 0x7f3ca01e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca5fed640 1 -- 172.21.15.40:0/3056057852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca01d74d0 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca5fed640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3ca01d1630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c90001f40 tx=0x7f3c9000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3c9e7fc640 1 -- 172.21.15.40:0/3056057852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c90007a00 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3c9e7fc640 1 -- 172.21.15.40:0/3056057852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c900133f0 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca01d7960 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3c9e7fc640 1 -- 172.21.15.40:0/3056057852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c900137a0 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.576+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca01d0f60 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.577+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca01d0ae0 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.577+0000 7f3c9e7fc640 1 -- 172.21.15.40:0/3056057852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3c90013900 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.578+0000 7f3c9e7fc640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c8c06a460 0x7f3c8c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.578+0000 7f3c9e7fc640 1 -- 172.21.15.40:0/3056057852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c90089370 con 0x7f3c88003ef0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.578+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c8c06a460 0x7f3c8c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:51.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.578+0000 7f3ca57ec640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c8c06a460 0x7f3c8c06c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c94035000 tx=0x7f3c94030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:51.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.582+0000 7f3c9e7fc640 1 -- 172.21.15.40:0/3056057852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3ca01d0ae0 con 0x7f3c88003ef0 2023-12-20T04:23:51.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.769+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3ca00b6da0 con 0x7f3c88003ef0 2023-12-20T04:23:51.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.770+0000 7f3c9e7fc640 1 -- 172.21.15.40:0/3056057852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3ca00b6da0 con 0x7f3c88003ef0 2023-12-20T04:23:51.769 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c8c06a460 msgr2=0x7f3c8c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c8c06a460 0x7f3c8c06c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c94035000 tx=0x7f3c94030000 comp rx=0 tx=0).stop 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 msgr2=0x7f3ca01d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3ca01d1630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c90001f40 tx=0x7f3c9000af90 comp rx=0 tx=0).stop 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 shutdown_connections 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3c8c06a460 0x7f3c8c06c920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3ca01e3840 0x7f3ca0148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ca01d1b70 0x7f3ca01e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 --2- 172.21.15.40:0/3056057852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c88003ef0 0x7f3ca01d1630 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.771+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 >> 172.21.15.40:0/3056057852 conn(0x7f3ca00c0200 msgr2=0x7f3ca00bf640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.772+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 shutdown_connections 2023-12-20T04:23:51.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:51.772+0000 7f3ca8251640 1 -- 172.21.15.40:0/3056057852 wait complete. 2023-12-20T04:23:51.782 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-20T04:23:51.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:51.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-20T04:23:51.892 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-12-20T04:23:51.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:23:51.892 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:23:51.959 INFO:tasks.cephfs.cephfs_test_case:[] 2023-12-20T04:23:51.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:52.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.065+0000 7f338be21640 1 Processor -- start 2023-12-20T04:23:52.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.065+0000 7f338be21640 1 -- start start 2023-12-20T04:23:52.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338be21640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f338406af20 0x7f338406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338be21640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f33840b3a30 0x7f33841477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338be21640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3384141550 0x7f33841419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338be21640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840b4110 con 0x7f3384141550 2023-12-20T04:23:52.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338be21640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33840711c0 con 0x7f33840b3a30 2023-12-20T04:23:52.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338be21640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3384141f20 con 0x7f338406af20 2023-12-20T04:23:52.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338a3be640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3384141550 0x7f33841419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338a3be640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3384141550 0x7f33841419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42800/0 (socket says 172.21.15.40:42800) 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f338a3be640 1 -- 172.21.15.40:0/507514195 learned_addr learned my addr 172.21.15.40:0/507514195 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f3389bbd640 1 --2- 172.21.15.40:0/507514195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f338406af20 0x7f338406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.066+0000 7f33893bc640 1 --2- 172.21.15.40:0/507514195 >> v2:172.21.15.69:3300/0 conn(0x7f33840b3a30 0x7f33841477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f338a3be640 1 -- 172.21.15.40:0/507514195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f338406af20 msgr2=0x7f338406fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f338a3be640 1 --2- 172.21.15.40:0/507514195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f338406af20 0x7f338406fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f338a3be640 1 -- 172.21.15.40:0/507514195 >> v2:172.21.15.69:3300/0 conn(0x7f33840b3a30 msgr2=0x7f33841477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f338a3be640 1 --2- 172.21.15.40:0/507514195 >> v2:172.21.15.69:3300/0 conn(0x7f33840b3a30 0x7f33841477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f338a3be640 1 -- 172.21.15.40:0/507514195 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384070370 con 0x7f3384141550 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f3389bbd640 1 --2- 172.21.15.40:0/507514195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f338406af20 0x7f338406fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f338a3be640 1 --2- 172.21.15.40:0/507514195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3384141550 0x7f33841419e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f338406b6e0 tx=0x7f337c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbeacbf47840e6b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f3388bbb640 1 -- 172.21.15.40:0/507514195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c030860 con 0x7f3384141550 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f3388bbb640 1 -- 172.21.15.40:0/507514195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c0309c0 con 0x7f3384141550 2023-12-20T04:23:52.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.067+0000 7f3388bbb640 1 -- 172.21.15.40:0/507514195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337c030d50 con 0x7f3384141550 2023-12-20T04:23:52.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 -- 172.21.15.40:0/507514195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3384141550 msgr2=0x7f33841419e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 --2- 172.21.15.40:0/507514195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3384141550 0x7f33841419e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f338406b6e0 tx=0x7f337c02b9a0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 -- 172.21.15.40:0/507514195 shutdown_connections 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 --2- 172.21.15.40:0/507514195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3384141550 0x7f33841419e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 --2- 172.21.15.40:0/507514195 >> v2:172.21.15.69:3300/0 conn(0x7f33840b3a30 0x7f33841477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 --2- 172.21.15.40:0/507514195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f338406af20 0x7f338406fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 -- 172.21.15.40:0/507514195 >> 172.21.15.40:0/507514195 conn(0x7f33840bcf60 msgr2=0x7f33840bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 -- 172.21.15.40:0/507514195 shutdown_connections 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.068+0000 7f338be21640 1 -- 172.21.15.40:0/507514195 wait complete. 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.069+0000 7f338be21640 1 Processor -- start 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.069+0000 7f338be21640 1 -- start start 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f338be21640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f338406af20 0x7f33841d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f338be21640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33840b3a30 0x7f33841e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f338be21640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3384141550 0x7f33841e1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f338be21640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33841d28e0 con 0x7f338406af20 2023-12-20T04:23:52.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f338be21640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338413b0a0 con 0x7f3384141550 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f338be21640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33841447f0 con 0x7f33840b3a30 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f338406af20 0x7f33841d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f338406af20 0x7f33841d23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42802/0 (socket says 172.21.15.40:42802) 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 -- 172.21.15.40:0/2214227491 learned_addr learned my addr 172.21.15.40:0/2214227491 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f33893bc640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33840b3a30 0x7f33841e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f338a3be640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3384141550 0x7f33841e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 -- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33840b3a30 msgr2=0x7f33841e0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33840b3a30 0x7f33841e0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 -- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3384141550 msgr2=0x7f33841e1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3384141550 0x7f33841e1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 -- 172.21.15.40:0/2214227491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0094d0 con 0x7f338406af20 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f3389bbd640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f338406af20 0x7f33841d23a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3374009fa0 tx=0x7f337400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.070+0000 7f33827fc640 1 -- 172.21.15.40:0/2214227491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374003b90 con 0x7f338406af20 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.071+0000 7f33827fc640 1 -- 172.21.15.40:0/2214227491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337400f040 con 0x7f338406af20 2023-12-20T04:23:52.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.071+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3384144ad0 con 0x7f338406af20 2023-12-20T04:23:52.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.071+0000 7f33827fc640 1 -- 172.21.15.40:0/2214227491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374004030 con 0x7f338406af20 2023-12-20T04:23:52.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.071+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33841421b0 con 0x7f338406af20 2023-12-20T04:23:52.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.072+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338404e840 con 0x7f338406af20 2023-12-20T04:23:52.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.072+0000 7f33827fc640 1 -- 172.21.15.40:0/2214227491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3374004190 con 0x7f338406af20 2023-12-20T04:23:52.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.072+0000 7f33827fc640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.073+0000 7f33827fc640 1 -- 172.21.15.40:0/2214227491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3374088b40 con 0x7f338406af20 2023-12-20T04:23:52.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.073+0000 7f33893bc640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.073+0000 7f33893bc640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33841d0d10 tx=0x7f3378008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.077+0000 7f33827fc640 1 -- 172.21.15.40:0/2214227491 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3374054270 con 0x7f338406af20 2023-12-20T04:23:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.287+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3384145e40 con 0x7f338406af20 2023-12-20T04:23:52.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.287+0000 7f33827fc640 1 -- 172.21.15.40:0/2214227491 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7f337401a020 con 0x7f338406af20 2023-12-20T04:23:52.287 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:52.288 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:52.288 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:52.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 msgr2=0x7f337006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33841d0d10 tx=0x7f3378008040 comp rx=0 tx=0).stop 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f338406af20 msgr2=0x7f33841d23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f338406af20 0x7f33841d23a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3374009fa0 tx=0x7f337400d560 comp rx=0 tx=0).stop 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 shutdown_connections 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f337006a430 0x7f337006c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3384141550 0x7f33841e1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f33840b3a30 0x7f33841e0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 --2- 172.21.15.40:0/2214227491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f338406af20 0x7f33841d23a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 >> 172.21.15.40:0/2214227491 conn(0x7f33840bcf60 msgr2=0x7f33841cfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 shutdown_connections 2023-12-20T04:23:52.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.289+0000 7f338be21640 1 -- 172.21.15.40:0/2214227491 wait complete. 2023-12-20T04:23:52.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.406+0000 7f1cc5a4a640 1 Processor -- start 2023-12-20T04:23:52.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.406+0000 7f1cc5a4a640 1 -- start start 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cc5a4a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc014aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cc5a4a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1cc00710b0 0x7f1cc006a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbe7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1cc00b6b10 0x7f1cc0069ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55572/0 (socket says 172.21.15.40:55572) 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cc5a4a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc00b4110 con 0x7f1cc00b6b10 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbe7fc640 1 -- 172.21.15.40:0/3528286702 learned_addr learned my addr 172.21.15.40:0/3528286702 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/3528286702 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc014b010 con 0x7f1cc00710b0 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/3528286702 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc006b800 con 0x7f1cc00b6730 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbeffd640 1 --2- 172.21.15.40:0/3528286702 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc014aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbf7fe640 1 --2- 172.21.15.40:0/3528286702 >> v2:172.21.15.40:3300/0 conn(0x7f1cc00710b0 0x7f1cc006a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbdffb640 1 -- 172.21.15.40:0/3528286702 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503991564 0 0) 0x7f1cc00b4110 con 0x7f1cc00b6b10 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbdffb640 1 -- 172.21.15.40:0/3528286702 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca8003520 con 0x7f1cc00b6b10 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbf7fe640 1 -- 172.21.15.40:0/3528286702 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 msgr2=0x7f1cc014aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbf7fe640 1 --2- 172.21.15.40:0/3528286702 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc014aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.407+0000 7f1cbf7fe640 1 -- 172.21.15.40:0/3528286702 >> v1:172.21.15.40:6789/0 conn(0x7f1cc00b6b10 legacy=0x7f1cc0069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.408+0000 7f1cbf7fe640 1 -- 172.21.15.40:0/3528286702 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00b3b50 con 0x7f1cc00710b0 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.408+0000 7f1cbf7fe640 1 --2- 172.21.15.40:0/3528286702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00710b0 0x7f1cc006a2b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009dc0 tx=0x7f1cb802bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb95bb4e784f018 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.408+0000 7f1cbdffb640 1 -- 172.21.15.40:0/3528286702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb802ccd0 con 0x7f1cc00710b0 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.408+0000 7f1cbdffb640 1 -- 172.21.15.40:0/3528286702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb802ce30 con 0x7f1cc00710b0 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.408+0000 7f1cbdffb640 1 -- 172.21.15.40:0/3528286702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8034640 con 0x7f1cc00710b0 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/3528286702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00710b0 msgr2=0x7f1cc006a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/3528286702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00710b0 0x7f1cc006a2b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009dc0 tx=0x7f1cb802bf20 comp rx=0 tx=0).stop 2023-12-20T04:23:52.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/3528286702 shutdown_connections 2023-12-20T04:23:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/3528286702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00710b0 0x7f1cc006a2b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/3528286702 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc014aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/3528286702 >> 172.21.15.40:0/3528286702 conn(0x7f1cc00bcf60 msgr2=0x7f1cc00bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/3528286702 shutdown_connections 2023-12-20T04:23:52.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.409+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/3528286702 wait complete. 2023-12-20T04:23:52.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.410+0000 7f1cc5a4a640 1 Processor -- start 2023-12-20T04:23:52.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.410+0000 7f1cc5a4a640 1 -- start start 2023-12-20T04:23:52.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cc5a4a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cc00710b0 0x7f1cc014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cc5a4a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc01dfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cc5a4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00b6b10 0x7f1cc0140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cc5a4a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc014e800 con 0x7f1cc00b6b10 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cc5a4a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00b7a60 con 0x7f1cc00710b0 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cc5a4a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00b7d40 con 0x7f1cc00b6730 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00b6b10 0x7f1cc0140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00b6b10 0x7f1cc0140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42826/0 (socket says 172.21.15.40:42826) 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 -- 172.21.15.40:0/2135340108 learned_addr learned my addr 172.21.15.40:0/2135340108 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbe7fc640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc01dfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbeffd640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cc00710b0 0x7f1cc014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 -- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 msgr2=0x7f1cc01dfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc01dfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 -- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cc00710b0 msgr2=0x7f1cc014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cc00710b0 0x7f1cc014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 -- 172.21.15.40:0/2135340108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009a70 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbe7fc640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc01dfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbeffd640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cc00710b0 0x7f1cc014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.411+0000 7f1cbf7fe640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00b6b10 0x7f1cc0140180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1cb802dfd0 tx=0x7f1cb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.412+0000 7f1ca7fff640 1 -- 172.21.15.40:0/2135340108 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8007000 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.412+0000 7f1ca7fff640 1 -- 172.21.15.40:0/2135340108 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb803e630 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.412+0000 7f1ca7fff640 1 -- 172.21.15.40:0/2135340108 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb803e9e0 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.412+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc00b9720 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.412+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc0147dd0 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.413+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00b9960 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.413+0000 7f1ca7fff640 1 -- 172.21.15.40:0/2135340108 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1cb803b050 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.414+0000 7f1ca7fff640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1cac06a430 0x7f1cac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.414+0000 7f1ca7fff640 1 -- 172.21.15.40:0/2135340108 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cb80ab0e0 con 0x7f1cc00b6b10 2023-12-20T04:23:52.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.414+0000 7f1cbeffd640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1cac06a430 0x7f1cac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.414+0000 7f1cbeffd640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1cac06a430 0x7f1cac06c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009ac0 tx=0x7f1cb0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.418+0000 7f1ca7fff640 1 -- 172.21.15.40:0/2135340108 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1cc00b9960 con 0x7f1cc00b6b10 2023-12-20T04:23:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.596+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cc00b9960 con 0x7f1cc00b6b10 2023-12-20T04:23:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.597+0000 7f1ca7fff640 1 -- 172.21.15.40:0/2135340108 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f1cc00b9960 con 0x7f1cc00b6b10 2023-12-20T04:23:52.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:52.597 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1cac06a430 msgr2=0x7f1cac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1cac06a430 0x7f1cac06c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009ac0 tx=0x7f1cb0008040 comp rx=0 tx=0).stop 2023-12-20T04:23:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00b6b10 msgr2=0x7f1cc0140180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00b6b10 0x7f1cc0140180 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1cb802dfd0 tx=0x7f1cb8004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 shutdown_connections 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1cac06a430 0x7f1cac06c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1cc00b6b10 0x7f1cc0140180 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1cc00b6730 0x7f1cc01dfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 --2- 172.21.15.40:0/2135340108 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1cc00710b0 0x7f1cc014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 >> 172.21.15.40:0/2135340108 conn(0x7f1cc00bcf60 msgr2=0x7f1cc01443d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 shutdown_connections 2023-12-20T04:23:52.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.599+0000 7f1cc5a4a640 1 -- 172.21.15.40:0/2135340108 wait complete. 2023-12-20T04:23:52.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:23:24.802902+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:23:25.623791+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:23:52.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:23:52.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005ec0b640 1 Processor -- start 2023-12-20T04:23:52.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005ec0b640 1 -- start start 2023-12-20T04:23:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005ec0b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00580bb140 0x7f00580be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005ec0b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f005806a950 0x7f00580bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005ec0b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00580bfa50 con 0x7f00580bee00 2023-12-20T04:23:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005ec0b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580bbda0 con 0x7f00580bb140 2023-12-20T04:23:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005ec0b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005806b040 con 0x7f005806a950 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005c9a7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00580bb140 0x7f00580be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005c9a7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f00580bb140 0x7f00580be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42842/0 (socket says 172.21.15.40:42842) 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.720+0000 7f005c9a7640 1 -- 172.21.15.40:0/1288937678 learned_addr learned my addr 172.21.15.40:0/1288937678 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.721+0000 7f0057fff640 1 --2- 172.21.15.40:0/1288937678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f005806a950 0x7f00580bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.721+0000 7f005c9a7640 1 -- 172.21.15.40:0/1288937678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f005806a950 msgr2=0x7f00580bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.721+0000 7f005c9a7640 1 --2- 172.21.15.40:0/1288937678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f005806a950 0x7f00580bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.721+0000 7f005c9a7640 1 -- 172.21.15.40:0/1288937678 >> v1:172.21.15.69:6789/0 conn(0x7f00580bee00 legacy=0x7f005814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.721+0000 7f005c9a7640 1 -- 172.21.15.40:0/1288937678 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580bb520 con 0x7f00580bb140 2023-12-20T04:23:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005c9a7640 1 --2- 172.21.15.40:0/1288937678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00580bb140 0x7f00580be350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e50 tx=0x7f005002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1053ccd21a08fd1a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f00577fe640 1 -- 172.21.15.40:0/1288937678 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005002c9e0 con 0x7f00580bb140 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f00577fe640 1 -- 172.21.15.40:0/1288937678 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005002cb40 con 0x7f00580bb140 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f00577fe640 1 -- 172.21.15.40:0/1288937678 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00500343f0 con 0x7f00580bb140 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 -- 172.21.15.40:0/1288937678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00580bb140 msgr2=0x7f00580be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 --2- 172.21.15.40:0/1288937678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00580bb140 0x7f00580be350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0050009e50 tx=0x7f005002be40 comp rx=0 tx=0).stop 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 -- 172.21.15.40:0/1288937678 shutdown_connections 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 --2- 172.21.15.40:0/1288937678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f005806a950 0x7f00580bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 --2- 172.21.15.40:0/1288937678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f00580bb140 0x7f00580be350 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 -- 172.21.15.40:0/1288937678 >> 172.21.15.40:0/1288937678 conn(0x7f00580bcfd0 msgr2=0x7f00580bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 -- 172.21.15.40:0/1288937678 shutdown_connections 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.722+0000 7f005ec0b640 1 -- 172.21.15.40:0/1288937678 wait complete. 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.723+0000 7f005ec0b640 1 Processor -- start 2023-12-20T04:23:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.723+0000 7f005ec0b640 1 -- start start 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005ec0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f005806a950 0x7f00581e0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005ec0b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f00580bb140 0x7f0058144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005ec0b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00580bee00 0x7f00580b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005ec0b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580a1ca0 con 0x7f005806a950 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005ec0b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00581e0670 con 0x7f00580bee00 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005ec0b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00581e0950 con 0x7f00580bb140 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005c9a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f005806a950 0x7f00581e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005c9a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f005806a950 0x7f00581e0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42850/0 (socket says 172.21.15.40:42850) 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005c9a7640 1 -- 172.21.15.40:0/4071700909 learned_addr learned my addr 172.21.15.40:0/4071700909 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.724+0000 7f005c9a7640 1 -- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f00580bb140 msgr2=0x7f0058144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f005c9a7640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f00580bb140 0x7f0058144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f005c9a7640 1 -- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00580bee00 msgr2=0x7f00580b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f005c9a7640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00580bee00 0x7f00580b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f005c9a7640 1 -- 172.21.15.40:0/4071700909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050009b30 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f005c9a7640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f005806a950 0x7f00581e0020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0050000f80 tx=0x7f0050004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f00557fa640 1 -- 172.21.15.40:0/4071700909 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050009510 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f00557fa640 1 -- 172.21.15.40:0/4071700909 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005003e450 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0058141db0 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f00557fa640 1 -- 172.21.15.40:0/4071700909 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005003e800 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.725+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005814a770 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.726+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00580740a0 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.726+0000 7f00557fa640 1 -- 172.21.15.40:0/4071700909 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f005003e960 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.727+0000 7f00557fa640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f004406a430 0x7f004406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.727+0000 7f00557fa640 1 -- 172.21.15.40:0/4071700909 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00500ab700 con 0x7f005806a950 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.727+0000 7f0057fff640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f004406a430 0x7f004406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.727+0000 7f0057fff640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f004406a430 0x7f004406c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f004c006fd0 tx=0x7f004c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.731+0000 7f00557fa640 1 -- 172.21.15.40:0/4071700909 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0050076cf0 con 0x7f005806a950 2023-12-20T04:23:52.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.906+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00580ba4a0 con 0x7f005806a950 2023-12-20T04:23:52.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.907+0000 7f00557fa640 1 -- 172.21.15.40:0/4071700909 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f005007a310 con 0x7f005806a950 2023-12-20T04:23:52.907 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:23:52.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f004406a430 msgr2=0x7f004406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f004406a430 0x7f004406c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f004c006fd0 tx=0x7f004c008040 comp rx=0 tx=0).stop 2023-12-20T04:23:52.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f005806a950 msgr2=0x7f00581e0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:52.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f005806a950 0x7f00581e0020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0050000f80 tx=0x7f0050004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:52.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 shutdown_connections 2023-12-20T04:23:52.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f004406a430 0x7f004406c8f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00580bee00 0x7f00580b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f00580bb140 0x7f0058144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 --2- 172.21.15.40:0/4071700909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f005806a950 0x7f00581e0020 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:52.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 >> 172.21.15.40:0/4071700909 conn(0x7f00580bcfd0 msgr2=0x7f005814a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:52.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 shutdown_connections 2023-12-20T04:23:52.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:52.909+0000 7f005ec0b640 1 -- 172.21.15.40:0/4071700909 wait complete. 2023-12-20T04:23:52.920 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:23:53.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.028+0000 7f5496e84640 1 Processor -- start 2023-12-20T04:23:53.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.028+0000 7f5496e84640 1 -- start start 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5496e84640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5490071f20 0x7f549006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5496e84640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54900706f0 0x7f54901449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5496e84640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54900b6a20 con 0x7f549006ae20 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5496e84640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5490071190 con 0x7f54900706f0 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5496e84640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900b8170 con 0x7f5490071f20 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5495421640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54900706f0 0x7f54901449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5495421640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54900706f0 0x7f54901449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42856/0 (socket says 172.21.15.40:42856) 2023-12-20T04:23:53.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f5495421640 1 -- 172.21.15.40:0/2619279075 learned_addr learned my addr 172.21.15.40:0/2619279075 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.029+0000 7f548ffff640 1 --2- 172.21.15.40:0/2619279075 >> v2:172.21.15.69:3300/0 conn(0x7f5490071f20 0x7f549006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f5495421640 1 -- 172.21.15.40:0/2619279075 >> v2:172.21.15.69:3300/0 conn(0x7f5490071f20 msgr2=0x7f549006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f5495421640 1 --2- 172.21.15.40:0/2619279075 >> v2:172.21.15.69:3300/0 conn(0x7f5490071f20 0x7f549006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f5495421640 1 -- 172.21.15.40:0/2619279075 >> v1:172.21.15.69:6789/0 conn(0x7f549006ae20 legacy=0x7f549006ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f5495421640 1 -- 172.21.15.40:0/2619279075 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900b8450 con 0x7f54900706f0 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f548ffff640 1 --2- 172.21.15.40:0/2619279075 >> v2:172.21.15.69:3300/0 conn(0x7f5490071f20 0x7f549006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f5495421640 1 --2- 172.21.15.40:0/2619279075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54900706f0 0x7f54901449c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f549006b590 tx=0x7f548802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71db7685b718501f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f548f7fe640 1 -- 172.21.15.40:0/2619279075 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488030860 con 0x7f54900706f0 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f548f7fe640 1 -- 172.21.15.40:0/2619279075 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54880309c0 con 0x7f54900706f0 2023-12-20T04:23:53.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.030+0000 7f548f7fe640 1 -- 172.21.15.40:0/2619279075 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488030d50 con 0x7f54900706f0 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 -- 172.21.15.40:0/2619279075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54900706f0 msgr2=0x7f54901449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 --2- 172.21.15.40:0/2619279075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54900706f0 0x7f54901449c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f549006b590 tx=0x7f548802b9a0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 -- 172.21.15.40:0/2619279075 shutdown_connections 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 --2- 172.21.15.40:0/2619279075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54900706f0 0x7f54901449c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 --2- 172.21.15.40:0/2619279075 >> v2:172.21.15.69:3300/0 conn(0x7f5490071f20 0x7f549006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 -- 172.21.15.40:0/2619279075 >> 172.21.15.40:0/2619279075 conn(0x7f54900b91b0 msgr2=0x7f54900b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 -- 172.21.15.40:0/2619279075 shutdown_connections 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.031+0000 7f5496e84640 1 -- 172.21.15.40:0/2619279075 wait complete. 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.032+0000 7f5496e84640 1 Processor -- start 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.032+0000 7f5496e84640 1 -- start start 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5496e84640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549006ae20 0x7f54900af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5496e84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54900706f0 0x7f54901460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5496e84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5490071f20 0x7f5490145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5496e84640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900af770 con 0x7f5490071f20 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5496e84640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5490144fa0 con 0x7f549006ae20 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5496e84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5490146a60 con 0x7f54900706f0 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5490071f20 0x7f5490145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5490071f20 0x7f5490145430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42868/0 (socket says 172.21.15.40:42868) 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 -- 172.21.15.40:0/2779699509 learned_addr learned my addr 172.21.15.40:0/2779699509 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5494c20640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549006ae20 0x7f54900af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f548ffff640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54900706f0 0x7f54901460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 -- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54900706f0 msgr2=0x7f54901460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54900706f0 0x7f54901460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 -- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549006ae20 msgr2=0x7f54900af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549006ae20 0x7f54900af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 -- 172.21.15.40:0/2779699509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54880094d0 con 0x7f5490071f20 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5494c20640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549006ae20 0x7f54900af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.033+0000 7f5495421640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5490071f20 0x7f5490145430 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5488009960 tx=0x7f5488004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.034+0000 7f548d7fa640 1 -- 172.21.15.40:0/2779699509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488043400 con 0x7f5490071f20 2023-12-20T04:23:53.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.034+0000 7f548d7fa640 1 -- 172.21.15.40:0/2779699509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488043580 con 0x7f5490071f20 2023-12-20T04:23:53.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.034+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5490144950 con 0x7f5490071f20 2023-12-20T04:23:53.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.034+0000 7f548d7fa640 1 -- 172.21.15.40:0/2779699509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488043930 con 0x7f5490071f20 2023-12-20T04:23:53.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.034+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900b1110 con 0x7f5490071f20 2023-12-20T04:23:53.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.035+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54900740a0 con 0x7f5490071f20 2023-12-20T04:23:53.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.035+0000 7f548d7fa640 1 -- 172.21.15.40:0/2779699509 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5488043a90 con 0x7f5490071f20 2023-12-20T04:23:53.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.036+0000 7f548d7fa640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f547006a430 0x7f547006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.036+0000 7f548d7fa640 1 -- 172.21.15.40:0/2779699509 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f548803e070 con 0x7f5490071f20 2023-12-20T04:23:53.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.036+0000 7f5494c20640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f547006a430 0x7f547006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.036+0000 7f5494c20640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f547006a430 0x7f547006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f547800a830 tx=0x7f5478008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.040+0000 7f548d7fa640 1 -- 172.21.15.40:0/2779699509 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5488077410 con 0x7f5490071f20 2023-12-20T04:23:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.214+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54901450e0 con 0x7f5490071f20 2023-12-20T04:23:53.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.214+0000 7f548d7fa640 1 -- 172.21.15.40:0/2779699509 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5488043d40 con 0x7f5490071f20 2023-12-20T04:23:53.214 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f547006a430 msgr2=0x7f547006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f547006a430 0x7f547006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f547800a830 tx=0x7f5478008040 comp rx=0 tx=0).stop 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5490071f20 msgr2=0x7f5490145430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5490071f20 0x7f5490145430 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5488009960 tx=0x7f5488004730 comp rx=0 tx=0).stop 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 shutdown_connections 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f547006a430 0x7f547006c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5490071f20 0x7f5490145430 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f54900706f0 0x7f54901460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 --2- 172.21.15.40:0/2779699509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549006ae20 0x7f54900af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 >> 172.21.15.40:0/2779699509 conn(0x7f54900b91b0 msgr2=0x7f54900b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:53.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 shutdown_connections 2023-12-20T04:23:53.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.216+0000 7f5496e84640 1 -- 172.21.15.40:0/2779699509 wait complete. 2023-12-20T04:23:53.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:23:53.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.335+0000 7f2b9d6ce640 1 Processor -- start 2023-12-20T04:23:53.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.335+0000 7f2b9d6ce640 1 -- start start 2023-12-20T04:23:53.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b9d6ce640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2b980bb140 0x7f2b980be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b9d6ce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b980bfa50 con 0x7f2b980bf510 2023-12-20T04:23:53.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b9d6ce640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9806b040 con 0x7f2b9806a950 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b9d6ce640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b980bbda0 con 0x7f2b980bb140 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b977fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b980bf510 0x7f2b98155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55574/0 (socket says 172.21.15.40:55574) 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b977fe640 1 -- 172.21.15.40:0/1375499696 learned_addr learned my addr 172.21.15.40:0/1375499696 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b96ffd640 1 --2- 172.21.15.40:0/1375499696 >> v2:172.21.15.69:3300/0 conn(0x7f2b980bb140 0x7f2b980be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b95ffb640 1 -- 172.21.15.40:0/1375499696 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300169428 0 0) 0x7f2b980bfa50 con 0x7f2b980bf510 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.336+0000 7f2b95ffb640 1 -- 172.21.15.40:0/1375499696 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b80003520 con 0x7f2b980bf510 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.337+0000 7f2b96ffd640 1 -- 172.21.15.40:0/1375499696 >> v1:172.21.15.69:6789/0 conn(0x7f2b9806a950 legacy=0x7f2b980bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.337+0000 7f2b95ffb640 1 -- 172.21.15.40:0/1375499696 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4016002910 0 0) 0x7f2b9806b040 con 0x7f2b9806a950 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.337+0000 7f2b96ffd640 1 -- 172.21.15.40:0/1375499696 >> v1:172.21.15.40:6789/0 conn(0x7f2b980bf510 legacy=0x7f2b98155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.337+0000 7f2b96ffd640 1 -- 172.21.15.40:0/1375499696 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980bb520 con 0x7f2b980bb140 2023-12-20T04:23:53.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.337+0000 7f2b96ffd640 1 --2- 172.21.15.40:0/1375499696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bb140 0x7f2b980be350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2b880097a0 tx=0x7f2b8802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8188e92e80e8835b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b95ffb640 1 -- 172.21.15.40:0/1375499696 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88030610 con 0x7f2b980bb140 2023-12-20T04:23:53.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b95ffb640 1 -- 172.21.15.40:0/1375499696 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88030770 con 0x7f2b980bb140 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b95ffb640 1 -- 172.21.15.40:0/1375499696 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b88030b00 con 0x7f2b980bb140 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/1375499696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bb140 msgr2=0x7f2b980be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/1375499696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bb140 0x7f2b980be350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2b880097a0 tx=0x7f2b8802b960 comp rx=0 tx=0).stop 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/1375499696 shutdown_connections 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/1375499696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bb140 0x7f2b980be350 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/1375499696 >> 172.21.15.40:0/1375499696 conn(0x7f2b980bcfd0 msgr2=0x7f2b980bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/1375499696 shutdown_connections 2023-12-20T04:23:53.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.338+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/1375499696 wait complete. 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.339+0000 7f2b9d6ce640 1 Processor -- start 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.339+0000 7f2b9d6ce640 1 -- start start 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b9d6ce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2b9806a950 0x7f2b980b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b9d6ce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980bb140 0x7f2b980b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b9d6ce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bf510 0x7f2b9814df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b9d6ce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980b4f00 con 0x7f2b980bb140 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b9d6ce640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980b64a0 con 0x7f2b980bf510 2023-12-20T04:23:53.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b9d6ce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980b6d20 con 0x7f2b9806a950 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980bb140 0x7f2b980b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980bb140 0x7f2b980b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42878/0 (socket says 172.21.15.40:42878) 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 -- 172.21.15.40:0/3095851782 learned_addr learned my addr 172.21.15.40:0/3095851782 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b977fe640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bf510 0x7f2b9814df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b96ffd640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2b9806a950 0x7f2b980b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 -- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2b9806a950 msgr2=0x7f2b980b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2b9806a950 0x7f2b980b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 -- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bf510 msgr2=0x7f2b9814df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bf510 0x7f2b9814df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.340+0000 7f2b967fc640 1 -- 172.21.15.40:0/3095851782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b88009400 con 0x7f2b980bb140 2023-12-20T04:23:53.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.341+0000 7f2b967fc640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980bb140 0x7f2b980b5850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c410 tx=0x7f2b8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.341+0000 7f2b7f7fe640 1 -- 172.21.15.40:0/3095851782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0035f0 con 0x7f2b980bb140 2023-12-20T04:23:53.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.341+0000 7f2b7f7fe640 1 -- 172.21.15.40:0/3095851782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8c003770 con 0x7f2b980bb140 2023-12-20T04:23:53.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.341+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b980b4550 con 0x7f2b980bb140 2023-12-20T04:23:53.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.341+0000 7f2b7f7fe640 1 -- 172.21.15.40:0/3095851782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c003b20 con 0x7f2b980bb140 2023-12-20T04:23:53.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.341+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b980b69b0 con 0x7f2b980bb140 2023-12-20T04:23:53.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.342+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b980b6ed0 con 0x7f2b980bb140 2023-12-20T04:23:53.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.342+0000 7f2b7f7fe640 1 -- 172.21.15.40:0/3095851782 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b8c003c80 con 0x7f2b980bb140 2023-12-20T04:23:53.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.342+0000 7f2b7f7fe640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b8406a460 0x7f2b8406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.343+0000 7f2b7f7fe640 1 -- 172.21.15.40:0/3095851782 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b8c087f30 con 0x7f2b980bb140 2023-12-20T04:23:53.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.343+0000 7f2b96ffd640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b8406a460 0x7f2b8406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.343+0000 7f2b96ffd640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b8406a460 0x7f2b8406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b88036000 tx=0x7f2b8803b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.347+0000 7f2b7f7fe640 1 -- 172.21.15.40:0/3095851782 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2b980b6ed0 con 0x7f2b980bb140 2023-12-20T04:23:53.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.524+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b980b6ed0 con 0x7f2b980bb140 2023-12-20T04:23:53.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.524+0000 7f2b7f7fe640 1 -- 172.21.15.40:0/3095851782 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b980b6ed0 con 0x7f2b980bb140 2023-12-20T04:23:53.524 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b8406a460 msgr2=0x7f2b8406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b8406a460 0x7f2b8406c920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2b88036000 tx=0x7f2b8803b040 comp rx=0 tx=0).stop 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980bb140 msgr2=0x7f2b980b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980bb140 0x7f2b980b5850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c410 tx=0x7f2b8c00c8d0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 shutdown_connections 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b8406a460 0x7f2b8406c920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b980bf510 0x7f2b9814df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980bb140 0x7f2b980b5850 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 --2- 172.21.15.40:0/3095851782 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2b9806a950 0x7f2b980b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 >> 172.21.15.40:0/3095851782 conn(0x7f2b980bcfd0 msgr2=0x7f2b98072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:53.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 shutdown_connections 2023-12-20T04:23:53.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.526+0000 7f2b9d6ce640 1 -- 172.21.15.40:0/3095851782 wait complete. 2023-12-20T04:23:53.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:53.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.642+0000 7f60ac3cb640 1 Processor -- start 2023-12-20T04:23:53.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.642+0000 7f60ac3cb640 1 -- start start 2023-12-20T04:23:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60ac3cb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a40bcdd0 0x7f60a40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60ac3cb640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f60a4144ea0 0x7f60a4155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60ac3cb640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a40bc6b0 con 0x7f60a40b64c0 2023-12-20T04:23:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60ac3cb640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40b6900 con 0x7f60a4144ea0 2023-12-20T04:23:53.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60ac3cb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40a59f0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60aa968640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f60a4144ea0 0x7f60a4155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60a9966640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f60a40b64c0 0x7f60a4144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:48362/0 (socket says 172.21.15.40:48362) 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60aa167640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a40bcdd0 0x7f60a40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.643+0000 7f60a9966640 1 -- 172.21.15.40:0/2872045057 learned_addr learned my addr 172.21.15.40:0/2872045057 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.644+0000 7f60aa167640 1 -- 172.21.15.40:0/2872045057 >> v2:172.21.15.69:3300/0 conn(0x7f60a4144ea0 msgr2=0x7f60a4155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.644+0000 7f60aa167640 1 --2- 172.21.15.40:0/2872045057 >> v2:172.21.15.69:3300/0 conn(0x7f60a4144ea0 0x7f60a4155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.644+0000 7f60aa167640 1 -- 172.21.15.40:0/2872045057 >> v1:172.21.15.69:6789/0 conn(0x7f60a40b64c0 legacy=0x7f60a4144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.644+0000 7f60aa167640 1 -- 172.21.15.40:0/2872045057 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a40bc0a0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.644+0000 7f60aa968640 1 --2- 172.21.15.40:0/2872045057 >> v2:172.21.15.69:3300/0 conn(0x7f60a4144ea0 0x7f60a4155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.644+0000 7f60aa167640 1 --2- 172.21.15.40:0/2872045057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a40bcdd0 0x7f60a40b5f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6094009d90 tx=0x7f609402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51e4260b6b6c3c6c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60a9165640 1 -- 172.21.15.40:0/2872045057 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609402cce0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60a9165640 1 -- 172.21.15.40:0/2872045057 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609402ce40 con 0x7f60a40bcdd0 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60a9165640 1 -- 172.21.15.40:0/2872045057 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6094034660 con 0x7f60a40bcdd0 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 -- 172.21.15.40:0/2872045057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a40bcdd0 msgr2=0x7f60a40b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/2872045057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a40bcdd0 0x7f60a40b5f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6094009d90 tx=0x7f609402bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 -- 172.21.15.40:0/2872045057 shutdown_connections 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/2872045057 >> v2:172.21.15.69:3300/0 conn(0x7f60a4144ea0 0x7f60a4155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/2872045057 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a40bcdd0 0x7f60a40b5f80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 -- 172.21.15.40:0/2872045057 >> 172.21.15.40:0/2872045057 conn(0x7f60a4071e60 msgr2=0x7f60a40c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:53.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 -- 172.21.15.40:0/2872045057 shutdown_connections 2023-12-20T04:23:53.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.645+0000 7f60ac3cb640 1 -- 172.21.15.40:0/2872045057 wait complete. 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.646+0000 7f60ac3cb640 1 Processor -- start 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.646+0000 7f60ac3cb640 1 -- start start 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60ac3cb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a40b64c0 0x7f60a414b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60ac3cb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60a40bcdd0 0x7f60a414ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60ac3cb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a4144ea0 0x7f60a413f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60ac3cb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a413fd10 con 0x7f60a40bcdd0 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60ac3cb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a41df840 con 0x7f60a40b64c0 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60ac3cb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a414b480 con 0x7f60a4144ea0 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60a40bcdd0 0x7f60a414ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60a40bcdd0 0x7f60a414ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42892/0 (socket says 172.21.15.40:42892) 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 -- 172.21.15.40:0/160337713 learned_addr learned my addr 172.21.15.40:0/160337713 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60aa968640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a4144ea0 0x7f60a413f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60aa167640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a40b64c0 0x7f60a414b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 -- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a4144ea0 msgr2=0x7f60a413f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a4144ea0 0x7f60a413f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 -- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a40b64c0 msgr2=0x7f60a414b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a40b64c0 0x7f60a414b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 -- 172.21.15.40:0/160337713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c009400 con 0x7f60a40bcdd0 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.647+0000 7f60a9966640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60a40bcdd0 0x7f60a414ada0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f609800c480 tx=0x7f609800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.648+0000 7f60a2ffd640 1 -- 172.21.15.40:0/160337713 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098005ce0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.648+0000 7f60a2ffd640 1 -- 172.21.15.40:0/160337713 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098005e40 con 0x7f60a40bcdd0 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.648+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6094009a70 con 0x7f60a40bcdd0 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.648+0000 7f60a2ffd640 1 -- 172.21.15.40:0/160337713 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980072d0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.648+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a4148a30 con 0x7f60a40bcdd0 2023-12-20T04:23:53.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.649+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a41df9b0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.649+0000 7f60a2ffd640 1 -- 172.21.15.40:0/160337713 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6098007430 con 0x7f60a40bcdd0 2023-12-20T04:23:53.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.649+0000 7f60a2ffd640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f609006a460 0x7f609006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.650+0000 7f60a2ffd640 1 -- 172.21.15.40:0/160337713 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6098087e90 con 0x7f60a40bcdd0 2023-12-20T04:23:53.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.650+0000 7f60aa167640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f609006a460 0x7f609006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.650+0000 7f60aa167640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f609006a460 0x7f609006c920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6094036000 tx=0x7f6094030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.654+0000 7f60a2ffd640 1 -- 172.21.15.40:0/160337713 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f60a41df9b0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.867+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60a41df9b0 con 0x7f60a40bcdd0 2023-12-20T04:23:53.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.868+0000 7f60a2ffd640 1 -- 172.21.15.40:0/160337713 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7f6098089f80 con 0x7f60a40bcdd0 2023-12-20T04:23:53.868 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:53.868 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:53.868 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:53.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f609006a460 msgr2=0x7f609006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f609006a460 0x7f609006c920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6094036000 tx=0x7f6094030000 comp rx=0 tx=0).stop 2023-12-20T04:23:53.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60a40bcdd0 msgr2=0x7f60a414ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60a40bcdd0 0x7f60a414ada0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f609800c480 tx=0x7f609800c940 comp rx=0 tx=0).stop 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 shutdown_connections 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f609006a460 0x7f609006c920 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f60a4144ea0 0x7f60a413f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60a40bcdd0 0x7f60a414ada0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 --2- 172.21.15.40:0/160337713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a40b64c0 0x7f60a414b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 >> 172.21.15.40:0/160337713 conn(0x7f60a4071e60 msgr2=0x7f60a4143690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 shutdown_connections 2023-12-20T04:23:53.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.870+0000 7f60ac3cb640 1 -- 172.21.15.40:0/160337713 wait complete. 2023-12-20T04:23:53.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.986+0000 7f2baa496640 1 Processor -- start 2023-12-20T04:23:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2baa496640 1 -- start start 2023-12-20T04:23:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2baa496640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ba40b6860 0x7f2ba4070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2baa496640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2ba40bc810 0x7f2ba41427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2baa496640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba4142d30 0x7f2ba406b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2baa496640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba4069f50 con 0x7f2ba40b6860 2023-12-20T04:23:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2baa496640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba40710d0 con 0x7f2ba40bc810 2023-12-20T04:23:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2baa496640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40713b0 con 0x7f2ba4142d30 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2ba3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ba40b6860 0x7f2ba4070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2ba3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2ba40b6860 0x7f2ba4070340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42898/0 (socket says 172.21.15.40:42898) 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.987+0000 7f2ba3fff640 1 -- 172.21.15.40:0/1915156673 learned_addr learned my addr 172.21.15.40:0/1915156673 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba37fe640 1 --2- 172.21.15.40:0/1915156673 >> v2:172.21.15.69:3300/0 conn(0x7f2ba40bc810 0x7f2ba41427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba8a33640 1 --2- 172.21.15.40:0/1915156673 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba4142d30 0x7f2ba406b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba3fff640 1 -- 172.21.15.40:0/1915156673 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba4142d30 msgr2=0x7f2ba406b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba3fff640 1 --2- 172.21.15.40:0/1915156673 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba4142d30 0x7f2ba406b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba3fff640 1 -- 172.21.15.40:0/1915156673 >> v2:172.21.15.69:3300/0 conn(0x7f2ba40bc810 msgr2=0x7f2ba41427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba3fff640 1 --2- 172.21.15.40:0/1915156673 >> v2:172.21.15.69:3300/0 conn(0x7f2ba40bc810 0x7f2ba41427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba3fff640 1 -- 172.21.15.40:0/1915156673 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4071690 con 0x7f2ba40b6860 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba3fff640 1 --2- 172.21.15.40:0/1915156673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba40b6860 0x7f2ba4070340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40b7050 tx=0x7f2b9402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1321265b80a5e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.988+0000 7f2ba2ffd640 1 -- 172.21.15.40:0/1915156673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94030860 con 0x7f2ba40b6860 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2ba2ffd640 1 -- 172.21.15.40:0/1915156673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940309c0 con 0x7f2ba40b6860 2023-12-20T04:23:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2ba2ffd640 1 -- 172.21.15.40:0/1915156673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94030d50 con 0x7f2ba40b6860 2023-12-20T04:23:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 -- 172.21.15.40:0/1915156673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba40b6860 msgr2=0x7f2ba4070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 --2- 172.21.15.40:0/1915156673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba40b6860 0x7f2ba4070340 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40b7050 tx=0x7f2b9402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 -- 172.21.15.40:0/1915156673 shutdown_connections 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 --2- 172.21.15.40:0/1915156673 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba4142d30 0x7f2ba406b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 --2- 172.21.15.40:0/1915156673 >> v2:172.21.15.69:3300/0 conn(0x7f2ba40bc810 0x7f2ba41427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 --2- 172.21.15.40:0/1915156673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba40b6860 0x7f2ba4070340 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 -- 172.21.15.40:0/1915156673 >> 172.21.15.40:0/1915156673 conn(0x7f2ba40bcf60 msgr2=0x7f2ba40bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 -- 172.21.15.40:0/1915156673 shutdown_connections 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.989+0000 7f2baa496640 1 -- 172.21.15.40:0/1915156673 wait complete. 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.990+0000 7f2baa496640 1 Processor -- start 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.990+0000 7f2baa496640 1 -- start start 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2baa496640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ba40b6860 0x7f2ba413f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2baa496640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba40bc810 0x7f2ba413cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2baa496640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba4142d30 0x7f2ba41e1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2baa496640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba4149660 con 0x7f2ba4142d30 2023-12-20T04:23:53.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2baa496640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba41e0de0 con 0x7f2ba40b6860 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2baa496640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba413fa90 con 0x7f2ba40bc810 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba4142d30 0x7f2ba41e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba4142d30 0x7f2ba41e1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42908/0 (socket says 172.21.15.40:42908) 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 -- 172.21.15.40:0/3627780481 learned_addr learned my addr 172.21.15.40:0/3627780481 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba3fff640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ba40b6860 0x7f2ba413f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba37fe640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba40bc810 0x7f2ba413cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 -- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba40bc810 msgr2=0x7f2ba413cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba40bc810 0x7f2ba413cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 -- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ba40b6860 msgr2=0x7f2ba413f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ba40b6860 0x7f2ba413f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba8a33640 1 -- 172.21.15.40:0/3627780481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940094d0 con 0x7f2ba4142d30 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.991+0000 7f2ba37fe640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba40bc810 0x7f2ba413cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.992+0000 7f2ba8a33640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba4142d30 0x7f2ba41e1270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00cd70 tx=0x7f2b9c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.992+0000 7f2ba0ff9640 1 -- 172.21.15.40:0/3627780481 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c003b90 con 0x7f2ba4142d30 2023-12-20T04:23:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.992+0000 7f2ba0ff9640 1 -- 172.21.15.40:0/3627780481 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c003cf0 con 0x7f2ba4142d30 2023-12-20T04:23:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.992+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba41498b0 con 0x7f2ba4142d30 2023-12-20T04:23:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.992+0000 7f2ba0ff9640 1 -- 172.21.15.40:0/3627780481 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c004240 con 0x7f2ba4142d30 2023-12-20T04:23:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.992+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba4148990 con 0x7f2ba4142d30 2023-12-20T04:23:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.993+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba404e840 con 0x7f2ba4142d30 2023-12-20T04:23:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.993+0000 7f2ba0ff9640 1 -- 172.21.15.40:0/3627780481 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b9c0043a0 con 0x7f2ba4142d30 2023-12-20T04:23:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.994+0000 7f2ba0ff9640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b9006a430 0x7f2b9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.994+0000 7f2ba0ff9640 1 -- 172.21.15.40:0/3627780481 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b9c012070 con 0x7f2ba4142d30 2023-12-20T04:23:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.994+0000 7f2ba3fff640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b9006a430 0x7f2b9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.994+0000 7f2ba3fff640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b9006a430 0x7f2b9006c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2b94036000 tx=0x7f2b9403b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:53.998+0000 7f2ba0ff9640 1 -- 172.21.15.40:0/3627780481 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2b9c0548a0 con 0x7f2ba4142d30 2023-12-20T04:23:54.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.175+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba4071940 con 0x7f2ba4142d30 2023-12-20T04:23:54.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.176+0000 7f2ba0ff9640 1 -- 172.21.15.40:0/3627780481 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f2b9c057ec0 con 0x7f2ba4142d30 2023-12-20T04:23:54.176 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:54.176 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b9006a430 msgr2=0x7f2b9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b9006a430 0x7f2b9006c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2b94036000 tx=0x7f2b9403b040 comp rx=0 tx=0).stop 2023-12-20T04:23:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba4142d30 msgr2=0x7f2ba41e1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba4142d30 0x7f2ba41e1270 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00cd70 tx=0x7f2b9c00a660 comp rx=0 tx=0).stop 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 shutdown_connections 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2b9006a430 0x7f2b9006c8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ba4142d30 0x7f2ba41e1270 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2ba40bc810 0x7f2ba413cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 --2- 172.21.15.40:0/3627780481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ba40b6860 0x7f2ba413f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 >> 172.21.15.40:0/3627780481 conn(0x7f2ba40bcf60 msgr2=0x7f2ba406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 shutdown_connections 2023-12-20T04:23:54.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.178+0000 7f2baa496640 1 -- 172.21.15.40:0/3627780481 wait complete. 2023-12-20T04:23:54.189 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:23:54.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:54.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.295+0000 7f18e5ef8640 1 Processor -- start 2023-12-20T04:23:54.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.295+0000 7f18e5ef8640 1 -- start start 2023-12-20T04:23:54.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.295+0000 7f18e5ef8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18e00bcdd0 0x7f18e00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.295+0000 7f18e5ef8640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e00b64c0 0x7f18e0144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.295+0000 7f18e5ef8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e00bc6b0 con 0x7f18e0144cd0 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.295+0000 7f18e5ef8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e00b6900 con 0x7f18e00bcdd0 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.295+0000 7f18e5ef8640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00a59f0 con 0x7f18e00b64c0 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18df7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18e00bcdd0 0x7f18e00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18dffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f18e0144cd0 0x7f18e014e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55582/0 (socket says 172.21.15.40:55582) 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18df7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18e00bcdd0 0x7f18e00b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42922/0 (socket says 172.21.15.40:42922) 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18dffff640 1 -- 172.21.15.40:0/840545442 learned_addr learned my addr 172.21.15.40:0/840545442 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18deffd640 1 --2- 172.21.15.40:0/840545442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e00b64c0 0x7f18e0144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18df7fe640 1 -- 172.21.15.40:0/840545442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e00b64c0 msgr2=0x7f18e0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:54.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18df7fe640 1 --2- 172.21.15.40:0/840545442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e00b64c0 0x7f18e0144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18df7fe640 1 -- 172.21.15.40:0/840545442 >> v1:172.21.15.40:6789/0 conn(0x7f18e0144cd0 legacy=0x7f18e014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18df7fe640 1 -- 172.21.15.40:0/840545442 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00bc0a0 con 0x7f18e00bcdd0 2023-12-20T04:23:54.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.296+0000 7f18de7fc640 1 -- 172.21.15.40:0/840545442 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077318606 0 0) 0x7f18e00bc6b0 con 0x7f18e0144cd0 2023-12-20T04:23:54.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18df7fe640 1 --2- 172.21.15.40:0/840545442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00bcdd0 0x7f18e00b5f80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18d00097a0 tx=0x7f18d002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc22cceab126742 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18de7fc640 1 -- 172.21.15.40:0/840545442 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0030610 con 0x7f18e00bcdd0 2023-12-20T04:23:54.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18de7fc640 1 -- 172.21.15.40:0/840545442 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0030770 con 0x7f18e00bcdd0 2023-12-20T04:23:54.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18de7fc640 1 -- 172.21.15.40:0/840545442 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0030b00 con 0x7f18e00bcdd0 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18e5ef8640 1 -- 172.21.15.40:0/840545442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00bcdd0 msgr2=0x7f18e00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/840545442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00bcdd0 0x7f18e00b5f80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18d00097a0 tx=0x7f18d002b960 comp rx=0 tx=0).stop 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18e5ef8640 1 -- 172.21.15.40:0/840545442 shutdown_connections 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/840545442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e00b64c0 0x7f18e0144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/840545442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00bcdd0 0x7f18e00b5f80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18e5ef8640 1 -- 172.21.15.40:0/840545442 >> 172.21.15.40:0/840545442 conn(0x7f18e0071e60 msgr2=0x7f18e00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.297+0000 7f18e5ef8640 1 -- 172.21.15.40:0/840545442 shutdown_connections 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.298+0000 7f18e5ef8640 1 -- 172.21.15.40:0/840545442 wait complete. 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.298+0000 7f18e5ef8640 1 Processor -- start 2023-12-20T04:23:54.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18e5ef8640 1 -- start start 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18e5ef8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00b64c0 0x7f18e013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18e5ef8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18e00bcdd0 0x7f18e013f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18e5ef8640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e0144cd0 0x7f18e0145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18e5ef8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e013fa10 con 0x7f18e00b64c0 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18e5ef8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01d37d0 con 0x7f18e00bcdd0 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18e5ef8640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01d49a0 con 0x7f18e0144cd0 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18df7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00b64c0 0x7f18e013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18df7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00b64c0 0x7f18e013fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42924/0 (socket says 172.21.15.40:42924) 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18df7fe640 1 -- 172.21.15.40:0/4221788339 learned_addr learned my addr 172.21.15.40:0/4221788339 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.299+0000 7f18dffff640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e0144cd0 0x7f18e0145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18deffd640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18e00bcdd0 0x7f18e013f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18df7fe640 1 -- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e0144cd0 msgr2=0x7f18e0145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18df7fe640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e0144cd0 0x7f18e0145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18df7fe640 1 -- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18e00bcdd0 msgr2=0x7f18e013f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18df7fe640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18e00bcdd0 0x7f18e013f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18df7fe640 1 -- 172.21.15.40:0/4221788339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009400 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18df7fe640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00b64c0 0x7f18e013fbe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f18d00097a0 tx=0x7f18d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18c7fff640 1 -- 172.21.15.40:0/4221788339 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0039c90 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18c7fff640 1 -- 172.21.15.40:0/4221788339 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d003f040 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18c7fff640 1 -- 172.21.15.40:0/4221788339 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0004270 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e01d4c80 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.300+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00a5720 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.301+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e004e840 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.302+0000 7f18c7fff640 1 -- 172.21.15.40:0/4221788339 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f18d00043d0 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.302+0000 7f18c7fff640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f18cc06a430 0x7f18cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.302+0000 7f18c7fff640 1 -- 172.21.15.40:0/4221788339 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18d00aa8f0 con 0x7f18e00b64c0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.302+0000 7f18deffd640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f18cc06a430 0x7f18cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.303+0000 7f18deffd640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f18cc06a430 0x7f18cc06c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18e00b95c0 tx=0x7f18d4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.306+0000 7f18c7fff640 1 -- 172.21.15.40:0/4221788339 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f18d00760b0 con 0x7f18e00b64c0 2023-12-20T04:23:54.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.519+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18e00ba4e0 con 0x7f18e00b64c0 2023-12-20T04:23:54.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.520+0000 7f18c7fff640 1 -- 172.21.15.40:0/4221788339 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7f18d0034090 con 0x7f18e00b64c0 2023-12-20T04:23:54.520 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:54.520 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:54.520 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:54.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f18cc06a430 msgr2=0x7f18cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f18cc06a430 0x7f18cc06c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18e00b95c0 tx=0x7f18d4008040 comp rx=0 tx=0).stop 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00b64c0 msgr2=0x7f18e013fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00b64c0 0x7f18e013fbe0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f18d00097a0 tx=0x7f18d00046c0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 shutdown_connections 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f18cc06a430 0x7f18cc06c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f18e0144cd0 0x7f18e0145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18e00bcdd0 0x7f18e013f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 --2- 172.21.15.40:0/4221788339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18e00b64c0 0x7f18e013fbe0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 >> 172.21.15.40:0/4221788339 conn(0x7f18e0071e60 msgr2=0x7f18e01d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 shutdown_connections 2023-12-20T04:23:54.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.522+0000 7f18e5ef8640 1 -- 172.21.15.40:0/4221788339 wait complete. 2023-12-20T04:23:54.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:23:54.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.639+0000 7fd4c2e77640 1 Processor -- start 2023-12-20T04:23:54.639 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.639+0000 7fd4c2e77640 1 -- start start 2023-12-20T04:23:54.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c2e77640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4bc0bcdd0 0x7fd4bc0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c2e77640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc0bc6b0 con 0x7fd4bc144ea0 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c2e77640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc0b6900 con 0x7fd4bc0b64c0 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c2e77640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0a59f0 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c1414640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd4bc144ea0 0x7fd4bc155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55586/0 (socket says 172.21.15.40:55586) 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c0c13640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4bc0bcdd0 0x7fd4bc0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c1414640 1 -- 172.21.15.40:0/1520612674 learned_addr learned my addr 172.21.15.40:0/1520612674 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4bb7fe640 1 -- 172.21.15.40:0/1520612674 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471070728 0 0) 0x7fd4bc0bc6b0 con 0x7fd4bc144ea0 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4bb7fe640 1 -- 172.21.15.40:0/1520612674 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a4003520 con 0x7fd4bc144ea0 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.640+0000 7fd4c0c13640 1 -- 172.21.15.40:0/1520612674 >> v1:172.21.15.69:6789/0 conn(0x7fd4bc0b64c0 legacy=0x7fd4bc144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.641+0000 7fd4c0c13640 1 -- 172.21.15.40:0/1520612674 >> v1:172.21.15.40:6789/0 conn(0x7fd4bc144ea0 legacy=0x7fd4bc155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.641+0000 7fd4c0c13640 1 -- 172.21.15.40:0/1520612674 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0bc0a0 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.641+0000 7fd4c0c13640 1 --2- 172.21.15.40:0/1520612674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc0b5f80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0097a0 tx=0x7fd4ac02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d008c17aa0e3ba server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.641+0000 7fd4bb7fe640 1 -- 172.21.15.40:0/1520612674 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac02f810 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.641+0000 7fd4bb7fe640 1 -- 172.21.15.40:0/1520612674 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac02f970 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.641+0000 7fd4bb7fe640 1 -- 172.21.15.40:0/1520612674 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac02fd00 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.642+0000 7fd4c2e77640 1 -- 172.21.15.40:0/1520612674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 msgr2=0x7fd4bc0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.642+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/1520612674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc0b5f80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0097a0 tx=0x7fd4ac02b9f0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.642+0000 7fd4c2e77640 1 -- 172.21.15.40:0/1520612674 shutdown_connections 2023-12-20T04:23:54.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.642+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/1520612674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc0b5f80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.642+0000 7fd4c2e77640 1 -- 172.21.15.40:0/1520612674 >> 172.21.15.40:0/1520612674 conn(0x7fd4bc071e60 msgr2=0x7fd4bc0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:54.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.642+0000 7fd4c2e77640 1 -- 172.21.15.40:0/1520612674 shutdown_connections 2023-12-20T04:23:54.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.642+0000 7fd4c2e77640 1 -- 172.21.15.40:0/1520612674 wait complete. 2023-12-20T04:23:54.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.643+0000 7fd4c2e77640 1 Processor -- start 2023-12-20T04:23:54.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.643+0000 7fd4c2e77640 1 -- start start 2023-12-20T04:23:54.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4c2e77640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd4bc0b64c0 0x7fd4bc13e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4c2e77640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4c2e77640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4bc144ea0 0x7fd4bc1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4c2e77640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc14a410 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4c2e77640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc147480 con 0x7fd4bc144ea0 2023-12-20T04:23:54.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4c2e77640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc147060 con 0x7fd4bc0b64c0 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42938/0 (socket says 172.21.15.40:42938) 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 -- 172.21.15.40:0/2442851122 learned_addr learned my addr 172.21.15.40:0/2442851122 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 -- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd4bc0b64c0 msgr2=0x7fd4bc13e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd4bc0b64c0 0x7fd4bc13e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 -- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4bc144ea0 msgr2=0x7fd4bc1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4bc144ea0 0x7fd4bc1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 -- 172.21.15.40:0/2442851122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac009400 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.644+0000 7fd4bbfff640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc147c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c450 tx=0x7fd4b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.645+0000 7fd4b97fa640 1 -- 172.21.15.40:0/2442851122 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00052d0 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.645+0000 7fd4b97fa640 1 -- 172.21.15.40:0/2442851122 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0005430 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.645+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc145d40 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.645+0000 7fd4b97fa640 1 -- 172.21.15.40:0/2442851122 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0012870 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.645+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc148180 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.646+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc04e840 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.646+0000 7fd4b97fa640 1 -- 172.21.15.40:0/2442851122 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd4b00129d0 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.646+0000 7fd4b97fa640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd4a806a430 0x7fd4a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.647+0000 7fd4b97fa640 1 -- 172.21.15.40:0/2442851122 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4b00883f0 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.647+0000 7fd4c0c13640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd4a806a430 0x7fd4a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.647+0000 7fd4c0c13640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd4a806a430 0x7fd4a806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac036000 tx=0x7fd4ac039040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.651+0000 7fd4b97fa640 1 -- 172.21.15.40:0/2442851122 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd4b0053a70 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.864+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4bc142c80 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.865+0000 7fd4b97fa640 1 -- 172.21.15.40:0/2442851122 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3944 (secure 0 0 0) 0x7fd4b0057090 con 0x7fd4bc0bcdd0 2023-12-20T04:23:54.865 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:54.865 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/226592206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":226592206},{"type":"v1","addr":"172.21.15.40:6835","nonce":226592206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1453206462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1453206462},{"type":"v1","addr":"172.21.15.40:6834","nonce":1453206462}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:23:26.641520+0000","modified":"2023-12-20T04:23:29.287785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2986767777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2986767777},{"type":"v1","addr":"172.21.15.69:6835","nonce":2986767777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:23:54.865 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd4a806a430 msgr2=0x7fd4a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd4a806a430 0x7fd4a806c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac036000 tx=0x7fd4ac039040 comp rx=0 tx=0).stop 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 msgr2=0x7fd4bc147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc147c40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c450 tx=0x7fd4b000c910 comp rx=0 tx=0).stop 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 shutdown_connections 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd4a806a430 0x7fd4a806c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4bc144ea0 0x7fd4bc1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4bc0bcdd0 0x7fd4bc147c40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 --2- 172.21.15.40:0/2442851122 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd4bc0b64c0 0x7fd4bc13e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 >> 172.21.15.40:0/2442851122 conn(0x7fd4bc071e60 msgr2=0x7fd4bc0b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 shutdown_connections 2023-12-20T04:23:54.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.867+0000 7fd4c2e77640 1 -- 172.21.15.40:0/2442851122 wait complete. 2023-12-20T04:23:54.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:23:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.983+0000 7fdbf0bd9640 1 Processor -- start 2023-12-20T04:23:54.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.984+0000 7fdbf0bd9640 1 -- start start 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.984+0000 7fdbf0bd9640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdbec0b6690 0x7fdbec144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.984+0000 7fdbf0bd9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec144cd0 0x7fdbec155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.984+0000 7fdbf0bd9640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec0bc6b0 con 0x7fdbec0bcdd0 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.984+0000 7fdbf0bd9640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec0a59f0 con 0x7fdbec0b6690 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.984+0000 7fdbf0bd9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0bc0a0 con 0x7fdbec144cd0 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbe9d9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdbec0b6690 0x7fdbec144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbead9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec144cd0 0x7fdbec155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbe9d9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdbec0b6690 0x7fdbec144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:51834/0 (socket says 172.21.15.40:51834) 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbe9d9b640 1 -- 172.21.15.40:0/2073172451 learned_addr learned my addr 172.21.15.40:0/2073172451 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbea59c640 1 --1- 172.21.15.40:0/2073172451 >> v1:172.21.15.69:6789/0 conn(0x7fdbec0bcdd0 0x7fdbec0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:48386/0 (socket says 172.21.15.40:48386) 2023-12-20T04:23:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbe9d9b640 1 -- 172.21.15.40:0/2073172451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec144cd0 msgr2=0x7fdbec155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbe9d9b640 1 --2- 172.21.15.40:0/2073172451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec144cd0 0x7fdbec155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbe9d9b640 1 -- 172.21.15.40:0/2073172451 >> v1:172.21.15.69:6789/0 conn(0x7fdbec0bcdd0 legacy=0x7fdbec0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.985+0000 7fdbe9d9b640 1 -- 172.21.15.40:0/2073172451 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0bc340 con 0x7fdbec0b6690 2023-12-20T04:23:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.986+0000 7fdbe9d9b640 1 --2- 172.21.15.40:0/2073172451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0b6690 0x7fdbec144790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009870 tx=0x7fdbd402ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e14abd2a5e7b909 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.986+0000 7fdbe959a640 1 -- 172.21.15.40:0/2073172451 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd402f840 con 0x7fdbec0b6690 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.986+0000 7fdbe959a640 1 -- 172.21.15.40:0/2073172451 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd402f9a0 con 0x7fdbec0b6690 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.986+0000 7fdbe959a640 1 -- 172.21.15.40:0/2073172451 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd402fd30 con 0x7fdbec0b6690 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.986+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2073172451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0b6690 msgr2=0x7fdbec144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.986+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2073172451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0b6690 0x7fdbec144790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009870 tx=0x7fdbd402ba20 comp rx=0 tx=0).stop 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.987+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2073172451 shutdown_connections 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.987+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2073172451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0b6690 0x7fdbec144790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.987+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2073172451 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec144cd0 0x7fdbec155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.987+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2073172451 >> 172.21.15.40:0/2073172451 conn(0x7fdbec071e60 msgr2=0x7fdbec0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.987+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2073172451 shutdown_connections 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.987+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2073172451 wait complete. 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 Processor -- start 2023-12-20T04:23:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 -- start start 2023-12-20T04:23:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec0b6690 0x7fdbec1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0bcdd0 0x7fdbec14a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec144cd0 0x7fdbec147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1d7430 con 0x7fdbec144cd0 2023-12-20T04:23:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1497e0 con 0x7fdbec0bcdd0 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.988+0000 7fdbf0bd9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec14b150 con 0x7fdbec0b6690 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec144cd0 0x7fdbec147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec144cd0 0x7fdbec147ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42946/0 (socket says 172.21.15.40:42946) 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 -- 172.21.15.40:0/2631198385 learned_addr learned my addr 172.21.15.40:0/2631198385 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbe9d9b640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0bcdd0 0x7fdbec14a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbea59c640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec0b6690 0x7fdbec1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 -- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec0b6690 msgr2=0x7fdbec1492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec0b6690 0x7fdbec1492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 -- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0bcdd0 msgr2=0x7fdbec14a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0bcdd0 0x7fdbec14a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 -- 172.21.15.40:0/2631198385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40094d0 con 0x7fdbec144cd0 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbe9d9b640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0bcdd0 0x7fdbec14a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbead9d640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec144cd0 0x7fdbec147ca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00efc0 tx=0x7fdbdc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbe2ffd640 1 -- 172.21.15.40:0/2631198385 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc009ba0 con 0x7fdbec144cd0 2023-12-20T04:23:54.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbe2ffd640 1 -- 172.21.15.40:0/2631198385 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00f040 con 0x7fdbec144cd0 2023-12-20T04:23:54.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec14ad90 con 0x7fdbec144cd0 2023-12-20T04:23:54.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbe2ffd640 1 -- 172.21.15.40:0/2631198385 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0146c0 con 0x7fdbec144cd0 2023-12-20T04:23:54.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.989+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec1d78f0 con 0x7fdbec144cd0 2023-12-20T04:23:54.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.990+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec1479c0 con 0x7fdbec144cd0 2023-12-20T04:23:54.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.991+0000 7fdbe2ffd640 1 -- 172.21.15.40:0/2631198385 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdbdc014820 con 0x7fdbec144cd0 2023-12-20T04:23:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.991+0000 7fdbe2ffd640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdbcc06a430 0x7fdbcc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.991+0000 7fdbe2ffd640 1 -- 172.21.15.40:0/2631198385 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbdc089220 con 0x7fdbec144cd0 2023-12-20T04:23:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.991+0000 7fdbea59c640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdbcc06a430 0x7fdbcc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.992+0000 7fdbea59c640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdbcc06a430 0x7fdbcc06c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000f60 tx=0x7fdbe4000ed0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:54.996+0000 7fdbe2ffd640 1 -- 172.21.15.40:0/2631198385 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdbec1479c0 con 0x7fdbec144cd0 2023-12-20T04:23:55.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.171+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbec1479c0 con 0x7fdbec144cd0 2023-12-20T04:23:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.172+0000 7fdbe2ffd640 1 -- 172.21.15.40:0/2631198385 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fdbec1479c0 con 0x7fdbec144cd0 2023-12-20T04:23:55.172 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:23:55.172 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:27.643167+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:23:24.802902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:23:25.623791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdbcc06a430 msgr2=0x7fdbcc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdbcc06a430 0x7fdbcc06c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4000f60 tx=0x7fdbe4000ed0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec144cd0 msgr2=0x7fdbec147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec144cd0 0x7fdbec147ca0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc00efc0 tx=0x7fdbdc00c490 comp rx=0 tx=0).stop 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 shutdown_connections 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdbcc06a430 0x7fdbcc06c8f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbec144cd0 0x7fdbec147ca0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec0bcdd0 0x7fdbec14a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 --2- 172.21.15.40:0/2631198385 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdbec0b6690 0x7fdbec1492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 >> 172.21.15.40:0/2631198385 conn(0x7fdbec071e60 msgr2=0x7fdbec0b9040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 shutdown_connections 2023-12-20T04:23:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.174+0000 7fdbf0bd9640 1 -- 172.21.15.40:0/2631198385 wait complete. 2023-12-20T04:23:55.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:23:55.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.292+0000 7f47e1c4b640 1 Processor -- start 2023-12-20T04:23:55.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.292+0000 7f47e1c4b640 1 -- start start 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.292+0000 7f47e1c4b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47dc0b4d60 0x7f47dc0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47e1c4b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc071450 con 0x7f47dc0b77a0 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47e1c4b640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc0b5bb0 con 0x7f47dc142e00 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47e1c4b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc0ba6a0 con 0x7f47dc0b4d60 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47daffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f47dc0b4d60 0x7f47dc0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47dbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f47dc0b77a0 0x7f47dc1531c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55590/0 (socket says 172.21.15.40:55590) 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47dbfff640 1 -- 172.21.15.40:0/432750163 learned_addr learned my addr 172.21.15.40:0/432750163 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47db7fe640 1 --1- 172.21.15.40:0/432750163 >> v1:172.21.15.69:6789/0 conn(0x7f47dc142e00 0x7f47dc0b54a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:48400/0 (socket says 172.21.15.40:48400) 2023-12-20T04:23:55.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47da7fc640 1 -- 172.21.15.40:0/432750163 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124145194 0 0) 0x7f47dc0b5bb0 con 0x7f47dc142e00 2023-12-20T04:23:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47daffd640 1 -- 172.21.15.40:0/432750163 >> v1:172.21.15.69:6789/0 conn(0x7f47dc142e00 legacy=0x7f47dc0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47daffd640 1 -- 172.21.15.40:0/432750163 >> v1:172.21.15.40:6789/0 conn(0x7f47dc0b77a0 legacy=0x7f47dc1531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.293+0000 7f47daffd640 1 -- 172.21.15.40:0/432750163 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc070e00 con 0x7f47dc0b4d60 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47daffd640 1 --2- 172.21.15.40:0/432750163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc0b4d60 0x7f47dc0b7260 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097a0 tx=0x7f47cc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cc3562965a359a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47da7fc640 1 -- 172.21.15.40:0/432750163 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc030610 con 0x7f47dc0b4d60 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47da7fc640 1 -- 172.21.15.40:0/432750163 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc030770 con 0x7f47dc0b4d60 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47da7fc640 1 -- 172.21.15.40:0/432750163 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc030b00 con 0x7f47dc0b4d60 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47e1c4b640 1 -- 172.21.15.40:0/432750163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc0b4d60 msgr2=0x7f47dc0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/432750163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc0b4d60 0x7f47dc0b7260 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097a0 tx=0x7f47cc02b960 comp rx=0 tx=0).stop 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47e1c4b640 1 -- 172.21.15.40:0/432750163 shutdown_connections 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/432750163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc0b4d60 0x7f47dc0b7260 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.294+0000 7f47e1c4b640 1 -- 172.21.15.40:0/432750163 >> 172.21.15.40:0/432750163 conn(0x7f47dc0bab20 msgr2=0x7f47dc0baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.295+0000 7f47e1c4b640 1 -- 172.21.15.40:0/432750163 shutdown_connections 2023-12-20T04:23:55.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.295+0000 7f47e1c4b640 1 -- 172.21.15.40:0/432750163 wait complete. 2023-12-20T04:23:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 Processor -- start 2023-12-20T04:23:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 -- start start 2023-12-20T04:23:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f47dc0b77a0 0x7f47dc145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47dc142e00 0x7f47dc1ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc144090 0x7f47dc144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc143960 con 0x7f47dc144090 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc13eef0 con 0x7f47dc142e00 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47e1c4b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc145bd0 con 0x7f47dc0b77a0 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc144090 0x7f47dc144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc144090 0x7f47dc144510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42960/0 (socket says 172.21.15.40:42960) 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.296+0000 7f47dbfff640 1 -- 172.21.15.40:0/1262640565 learned_addr learned my addr 172.21.15.40:0/1262640565 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47daffd640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47dc142e00 0x7f47dc1ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47db7fe640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f47dc0b77a0 0x7f47dc145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47dbfff640 1 -- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f47dc0b77a0 msgr2=0x7f47dc145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47dbfff640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f47dc0b77a0 0x7f47dc145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47dbfff640 1 -- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47dc142e00 msgr2=0x7f47dc1ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47dbfff640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47dc142e00 0x7f47dc1ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47dbfff640 1 -- 172.21.15.40:0/1262640565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc009400 con 0x7f47dc144090 2023-12-20T04:23:55.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47dbfff640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc144090 0x7f47dc144510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f47d400cb10 tx=0x7f47d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47d3fff640 1 -- 172.21.15.40:0/1262640565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400ac70 con 0x7f47dc144090 2023-12-20T04:23:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47d3fff640 1 -- 172.21.15.40:0/1262640565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400add0 con 0x7f47dc144090 2023-12-20T04:23:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47d3fff640 1 -- 172.21.15.40:0/1262640565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4012600 con 0x7f47dc144090 2023-12-20T04:23:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc1cefe0 con 0x7f47dc144090 2023-12-20T04:23:55.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.297+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc144ff0 con 0x7f47dc144090 2023-12-20T04:23:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.298+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc04e840 con 0x7f47dc144090 2023-12-20T04:23:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.298+0000 7f47d3fff640 1 -- 172.21.15.40:0/1262640565 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f47d4007070 con 0x7f47dc144090 2023-12-20T04:23:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.299+0000 7f47d3fff640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f47bc06a460 0x7f47bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.299+0000 7f47d3fff640 1 -- 172.21.15.40:0/1262640565 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47d4088640 con 0x7f47dc144090 2023-12-20T04:23:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.299+0000 7f47db7fe640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f47bc06a460 0x7f47bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.299+0000 7f47db7fe640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f47bc06a460 0x7f47bc06c920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47c4000f60 tx=0x7f47c4007c00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.303+0000 7f47d3fff640 1 -- 172.21.15.40:0/1262640565 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f47d4053d70 con 0x7f47dc144090 2023-12-20T04:23:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.520+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f47dc0bb9c0 con 0x7f47dc144090 2023-12-20T04:23:55.520 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-12-20T04:23:55.521+0000 7fda12e62640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:23:55.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.527+0000 7f47d3fff640 1 -- 172.21.15.40:0/1262640565 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f47d4057390 con 0x7f47dc144090 2023-12-20T04:23:55.527 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:23:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f47bc06a460 msgr2=0x7f47bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f47bc06a460 0x7f47bc06c920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f47c4000f60 tx=0x7f47c4007c00 comp rx=0 tx=0).stop 2023-12-20T04:23:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc144090 msgr2=0x7f47dc144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc144090 0x7f47dc144510 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f47d400cb10 tx=0x7f47d400a060 comp rx=0 tx=0).stop 2023-12-20T04:23:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 shutdown_connections 2023-12-20T04:23:55.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f47bc06a460 0x7f47bc06c920 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47dc144090 0x7f47dc144510 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47dc142e00 0x7f47dc1ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 --2- 172.21.15.40:0/1262640565 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f47dc0b77a0 0x7f47dc145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 >> 172.21.15.40:0/1262640565 conn(0x7f47dc0bab20 msgr2=0x7f47dc13fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 shutdown_connections 2023-12-20T04:23:55.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.529+0000 7f47e1c4b640 1 -- 172.21.15.40:0/1262640565 wait complete. 2023-12-20T04:23:55.530 INFO:tasks.ceph.mds.b.smithi069.stderr: -4641> 2023-12-20T04:23:31.325+0000 7f539c1f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:23:55.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:23:55.561 INFO:tasks.ceph.mds.b.smithi069.stdout:starting mds.b at 2023-12-20T04:23:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.647+0000 7fd977388640 1 Processor -- start 2023-12-20T04:23:55.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.648+0000 7fd977388640 1 -- start start 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.648+0000 7fd977388640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd9700b9f00 0x7fd9700be220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.648+0000 7fd977388640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 0x7fd97006a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.648+0000 7fd977388640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700ba7f0 con 0x7fd9700b3ab0 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.648+0000 7fd977388640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97006b090 con 0x7fd9700b9f00 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.648+0000 7fd977388640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700baed0 con 0x7fd9700c0f40 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.648+0000 7fd975925640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd9700b3ab0 0x7fd97014e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47812/0 (socket says 172.21.15.40:47812) 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd975925640 1 -- 172.21.15.40:0/2106714924 learned_addr learned my addr 172.21.15.40:0/2106714924 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd975124640 1 --2- 172.21.15.40:0/2106714924 >> v2:172.21.15.69:3300/0 conn(0x7fd9700b9f00 0x7fd9700be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd974923640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 0x7fd97006a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142274742 0 0) 0x7fd9700ba7f0 con 0x7fd9700b3ab0 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd95c003520 con 0x7fd9700b3ab0 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2103461514 0 0) 0x7fd95c003520 con 0x7fd9700b3ab0 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 msgr2=0x7fd97006a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 0x7fd97006a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 >> v2:172.21.15.69:3300/0 conn(0x7fd9700b9f00 msgr2=0x7fd9700be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 --2- 172.21.15.40:0/2106714924 >> v2:172.21.15.69:3300/0 conn(0x7fd9700b9f00 0x7fd9700be220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700be760 con 0x7fd9700b3ab0 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7fd9680019f0 con 0x7fd9700b3ab0 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 >> v1:172.21.15.40:6789/0 conn(0x7fd9700b3ab0 legacy=0x7fd97014e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd95c003970 0x7fd95c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 0x7fd95c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd95c004d00 0x7fd95c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97006b090 con 0x7fd95c003970 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700baed0 con 0x7fd95c004d00 2023-12-20T04:23:55.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c00b9b0 con 0x7fd9700c0f40 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd975124640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd95c003970 0x7fd95c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd974923640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 0x7fd95c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd975925640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd95c004d00 0x7fd95c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd975124640 1 -- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 msgr2=0x7fd95c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd975124640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd9700c0f40 0x7fd95c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.649+0000 7fd975124640 1 -- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd95c004d00 msgr2=0x7fd95c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.650+0000 7fd975124640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd95c004d00 0x7fd95c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.650+0000 7fd975124640 1 -- 172.21.15.40:0/2106714924 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c003520 con 0x7fd95c003970 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.650+0000 7fd975124640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd95c003970 0x7fd95c003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009ac0 tx=0x7fd95c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5277bcf69c501df1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.650+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c02c710 con 0x7fd95c003970 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.650+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c02c870 con 0x7fd95c003970 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.650+0000 7fd967fff640 1 -- 172.21.15.40:0/2106714924 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c02cc00 con 0x7fd95c003970 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.651+0000 7fd977388640 1 -- 172.21.15.40:0/2106714924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd95c003970 msgr2=0x7fd95c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.651+0000 7fd977388640 1 --2- 172.21.15.40:0/2106714924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd95c003970 0x7fd95c003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009ac0 tx=0x7fd95c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.651+0000 7fd975925640 1 -- 172.21.15.40:0/2106714924 reap_dead start 2023-12-20T04:23:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.651+0000 7fd977388640 1 -- 172.21.15.40:0/2106714924 shutdown_connections 2023-12-20T04:23:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.651+0000 7fd977388640 1 -- 172.21.15.40:0/2106714924 >> 172.21.15.40:0/2106714924 conn(0x7fd9700c0420 msgr2=0x7fd9700c0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.651+0000 7fd977388640 1 -- 172.21.15.40:0/2106714924 shutdown_connections 2023-12-20T04:23:55.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.651+0000 7fd977388640 1 -- 172.21.15.40:0/2106714924 wait complete. 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.652+0000 7fd977388640 1 Processor -- start 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.652+0000 7fd977388640 1 -- start start 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd977388640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd95c003970 0x7fd970099b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd977388640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd97009a920 0x7fd97009ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd977388640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b67a0 0x7fd9700b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd977388640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b6310 con 0x7fd9700b67a0 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd977388640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700a1b60 con 0x7fd97009a920 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd977388640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b5ce0 con 0x7fd95c003970 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b67a0 0x7fd9700b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b67a0 0x7fd9700b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53660/0 (socket says 172.21.15.40:53660) 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 -- 172.21.15.40:0/1262774313 learned_addr learned my addr 172.21.15.40:0/1262774313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:55.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd974923640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd97009a920 0x7fd97009ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975124640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd95c003970 0x7fd970099b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 -- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd95c003970 msgr2=0x7fd970099b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd95c003970 0x7fd970099b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 -- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd97009a920 msgr2=0x7fd97009ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd97009a920 0x7fd97009ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 -- 172.21.15.40:0/1262774313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97009b3f0 con 0x7fd9700b67a0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd975925640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b67a0 0x7fd9700b6c20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd9700721c0 tx=0x7fd968007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.653+0000 7fd965ffb640 1 -- 172.21.15.40:0/1262774313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96800aaa0 con 0x7fd9700b67a0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.654+0000 7fd965ffb640 1 -- 172.21.15.40:0/1262774313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800ac20 con 0x7fd9700b67a0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.654+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9700b5fa0 con 0x7fd9700b67a0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.654+0000 7fd965ffb640 1 -- 172.21.15.40:0/1262774313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680133f0 con 0x7fd9700b67a0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.654+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97009a290 con 0x7fd9700b67a0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.655+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9700740a0 con 0x7fd9700b67a0 2023-12-20T04:23:55.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.655+0000 7fd965ffb640 1 -- 172.21.15.40:0/1262774313 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd968013550 con 0x7fd9700b67a0 2023-12-20T04:23:55.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.655+0000 7fd965ffb640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95406a430 0x7fd95406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:55.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.656+0000 7fd965ffb640 1 -- 172.21.15.40:0/1262774313 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd968088fd0 con 0x7fd9700b67a0 2023-12-20T04:23:55.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.656+0000 7fd975124640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95406a430 0x7fd95406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:55.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.656+0000 7fd975124640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95406a430 0x7fd95406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd96c036000 tx=0x7fd96c030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:55.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.660+0000 7fd965ffb640 1 -- 172.21.15.40:0/1262774313 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd968054570 con 0x7fd9700b67a0 2023-12-20T04:23:55.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:55.870+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd9700bf3d0 con 0x7fd9700b67a0 2023-12-20T04:23:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.529+0000 7fd965ffb640 1 -- 172.21.15.40:0/1262774313 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd968057b90 con 0x7fd9700b67a0 2023-12-20T04:23:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95406a430 msgr2=0x7fd95406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95406a430 0x7fd95406c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd96c036000 tx=0x7fd96c030000 comp rx=0 tx=0).stop 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b67a0 msgr2=0x7fd9700b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b67a0 0x7fd9700b6c20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd9700721c0 tx=0x7fd968007a40 comp rx=0 tx=0).stop 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 shutdown_connections 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd95406a430 0x7fd95406c8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd9700b67a0 0x7fd9700b6c20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd97009a920 0x7fd97009ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 --2- 172.21.15.40:0/1262774313 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd95c003970 0x7fd970099b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 >> 172.21.15.40:0/1262774313 conn(0x7fd9700c0420 msgr2=0x7fd97009fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 shutdown_connections 2023-12-20T04:23:56.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.531+0000 7fd977388640 1 -- 172.21.15.40:0/1262774313 wait complete. 2023-12-20T04:23:56.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:23:56.569 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:23:56.596 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:23:56.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:23:56.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.667+0000 7f68b4812640 1 Processor -- start 2023-12-20T04:23:56.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.667+0000 7f68b4812640 1 -- start start 2023-12-20T04:23:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.667+0000 7f68b4812640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f68b00b4010 0x7f68b0070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.667+0000 7f68b4812640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0142660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:56.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.667+0000 7f68b4812640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b00b7f20 con 0x7f68b00b69b0 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.667+0000 7f68b4812640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b00b7bf0 con 0x7f68b00b4010 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.667+0000 7f68b4812640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b00b9780 con 0x7f68b0071490 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68aed9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68a5d9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f68b00b4010 0x7f68b0070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68aed9d640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0142660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:52732/0 (socket says 172.21.15.40:52732) 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68a5d9b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f68b00b4010 0x7f68b0070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:59660/0 (socket says 172.21.15.40:59660) 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68aed9d640 1 -- 172.21.15.40:0/1524023223 learned_addr learned my addr 172.21.15.40:0/1524023223 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68ae59c640 1 --1- 172.21.15.40:0/1524023223 >> v1:172.21.15.69:6789/0 conn(0x7f68b00b69b0 0x7f68b00b8cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:41526/0 (socket says 172.21.15.40:41526) 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68a5d9b640 1 -- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 msgr2=0x7f68b0142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68a5d9b640 1 --2- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68a5d9b640 1 -- 172.21.15.40:0/1524023223 >> v1:172.21.15.69:6789/0 conn(0x7f68b00b69b0 legacy=0x7f68b00b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68add9b640 1 -- 172.21.15.40:0/1524023223 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173173646 0 0) 0x7f68b00b7f20 con 0x7f68b00b69b0 2023-12-20T04:23:56.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68a5d9b640 1 -- 172.21.15.40:0/1524023223 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00b9a30 con 0x7f68b00b4010 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.668+0000 7f68aed9d640 1 --2- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.669+0000 7f68a5d9b640 1 --2- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b4010 0x7f68b0070f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f68980097a0 tx=0x7f689802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6de92a4c1639b77 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.669+0000 7f68add9b640 1 -- 172.21.15.40:0/1524023223 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898030610 con 0x7f68b00b4010 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.669+0000 7f68add9b640 1 -- 172.21.15.40:0/1524023223 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898030770 con 0x7f68b00b4010 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.669+0000 7f68add9b640 1 -- 172.21.15.40:0/1524023223 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898030b00 con 0x7f68b00b4010 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.669+0000 7f68b4812640 1 -- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b4010 msgr2=0x7f68b0070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.669+0000 7f68b4812640 1 --2- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b4010 0x7f68b0070f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f68980097a0 tx=0x7f689802b960 comp rx=0 tx=0).stop 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.670+0000 7f68b4812640 1 -- 172.21.15.40:0/1524023223 shutdown_connections 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.670+0000 7f68b4812640 1 --2- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b4010 0x7f68b0070f50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.670+0000 7f68b4812640 1 --2- 172.21.15.40:0/1524023223 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.670+0000 7f68b4812640 1 -- 172.21.15.40:0/1524023223 >> 172.21.15.40:0/1524023223 conn(0x7f68b006ae90 msgr2=0x7f68b006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.670+0000 7f68b4812640 1 -- 172.21.15.40:0/1524023223 shutdown_connections 2023-12-20T04:23:56.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.670+0000 7f68b4812640 1 -- 172.21.15.40:0/1524023223 wait complete. 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.671+0000 7f68b4812640 1 Processor -- start 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.671+0000 7f68b4812640 1 -- start start 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68b4812640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68b4812640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b69b0 0x7f68b0149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68b4812640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b0147d50 0x7f68b013e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68b4812640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0145190 con 0x7f68b0147d50 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68b4812640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b0149790 con 0x7f68b00b69b0 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68b4812640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b01487f0 con 0x7f68b0071490 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b0147d50 0x7f68b013e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b0147d50 0x7f68b013e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53670/0 (socket says 172.21.15.40:53670) 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 -- 172.21.15.40:0/2535774478 learned_addr learned my addr 172.21.15.40:0/2535774478 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68a5d9b640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b69b0 0x7f68b0149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:56.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68ae59c640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 -- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 msgr2=0x7f68b0144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 -- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b69b0 msgr2=0x7f68b0149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b69b0 0x7f68b0149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 -- 172.21.15.40:0/2535774478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009b30 con 0x7f68b0147d50 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68a5d9b640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b69b0 0x7f68b0149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68aed9d640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b0147d50 0x7f68b013e160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009f10 tx=0x7f68a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68a77fe640 1 -- 172.21.15.40:0/2535774478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8018070 con 0x7f68b0147d50 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68a77fe640 1 -- 172.21.15.40:0/2535774478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800f040 con 0x7f68b0147d50 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6898009400 con 0x7f68b0147d50 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.672+0000 7f68a77fe640 1 -- 172.21.15.40:0/2535774478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800ce60 con 0x7f68b0147d50 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.673+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b0148510 con 0x7f68b0147d50 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.674+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b00b8390 con 0x7f68b0147d50 2023-12-20T04:23:56.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.674+0000 7f68a77fe640 1 -- 172.21.15.40:0/2535774478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f68a8014480 con 0x7f68b0147d50 2023-12-20T04:23:56.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.674+0000 7f68a77fe640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f689006a430 0x7f689006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:56.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.674+0000 7f68a77fe640 1 -- 172.21.15.40:0/2535774478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f68a8088aa0 con 0x7f68b0147d50 2023-12-20T04:23:56.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.675+0000 7f68ae59c640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f689006a430 0x7f689006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:56.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.675+0000 7f68ae59c640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f689006a430 0x7f689006c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000fb0 tx=0x7f68a0007e70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:56.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.679+0000 7f68a77fe640 1 -- 172.21.15.40:0/2535774478 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f68b00b8390 con 0x7f68b0147d50 2023-12-20T04:23:56.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:56.857+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f68b00b8390 con 0x7f68b0147d50 2023-12-20T04:23:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.531+0000 7f68a77fe640 1 -- 172.21.15.40:0/2535774478 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f68b00b8390 con 0x7f68b0147d50 2023-12-20T04:23:57.531 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f689006a430 msgr2=0x7f689006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f689006a430 0x7f689006c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000fb0 tx=0x7f68a0007e70 comp rx=0 tx=0).stop 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b0147d50 msgr2=0x7f68b013e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b0147d50 0x7f68b013e160 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009f10 tx=0x7f68a800c490 comp rx=0 tx=0).stop 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 shutdown_connections 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f689006a430 0x7f689006c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f68b0147d50 0x7f68b013e160 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68b00b69b0 0x7f68b0149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.535+0000 7f68b4812640 1 --2- 172.21.15.40:0/2535774478 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f68b0071490 0x7f68b0144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.536+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 >> 172.21.15.40:0/2535774478 conn(0x7f68b006ae90 msgr2=0x7f68b0145ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.536+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 shutdown_connections 2023-12-20T04:23:57.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.536+0000 7f68b4812640 1 -- 172.21.15.40:0/2535774478 wait complete. 2023-12-20T04:23:57.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:23:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.710+0000 7f4d0daa0640 1 Processor -- start 2023-12-20T04:23:57.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.710+0000 7f4d0daa0640 1 -- start start 2023-12-20T04:23:57.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d0daa0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080bc660 0x7f4d0814ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d0daa0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d0814b290 0x7f4d08155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d0daa0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0814b6e0 con 0x7f4d080b79a0 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d0daa0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0806cd70 con 0x7f4d0814b290 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d0daa0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080bca80 con 0x7f4d080bc660 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d07fff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d0814b290 0x7f4d08155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080bc660 0x7f4d0814ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d06ffd640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080bc660 0x7f4d0814ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:52744/0 (socket says 172.21.15.40:52744) 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d07fff640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d0814b290 0x7f4d08155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:59688/0 (socket says 172.21.15.40:59688) 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.711+0000 7f4d06ffd640 1 -- 172.21.15.40:0/2155660450 learned_addr learned my addr 172.21.15.40:0/2155660450 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.712+0000 7f4d07fff640 1 -- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080bc660 msgr2=0x7f4d0814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.712+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080bc660 0x7f4d0814ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.712+0000 7f4d07fff640 1 -- 172.21.15.40:0/2155660450 >> v1:172.21.15.69:6789/0 conn(0x7f4d080b79a0 legacy=0x7f4d080b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:57.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.712+0000 7f4d07fff640 1 -- 172.21.15.40:0/2155660450 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080b8ba0 con 0x7f4d0814b290 2023-12-20T04:23:57.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.712+0000 7f4d06ffd640 1 --2- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080bc660 0x7f4d0814ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:23:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.712+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0814b290 0x7f4d08155380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009d90 tx=0x7f4d0002bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b86274cbae53826 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d067fc640 1 -- 172.21.15.40:0/2155660450 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0002cce0 con 0x7f4d0814b290 2023-12-20T04:23:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d067fc640 1 -- 172.21.15.40:0/2155660450 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0002ce40 con 0x7f4d0814b290 2023-12-20T04:23:57.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d067fc640 1 -- 172.21.15.40:0/2155660450 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00034660 con 0x7f4d0814b290 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0814b290 msgr2=0x7f4d08155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0814b290 0x7f4d08155380 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009d90 tx=0x7f4d0002bf30 comp rx=0 tx=0).stop 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2155660450 shutdown_connections 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0814b290 0x7f4d08155380 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2155660450 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080bc660 0x7f4d0814ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2155660450 >> 172.21.15.40:0/2155660450 conn(0x7f4d080c0330 msgr2=0x7f4d080c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2155660450 shutdown_connections 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.713+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2155660450 wait complete. 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.714+0000 7f4d0daa0640 1 Processor -- start 2023-12-20T04:23:57.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.714+0000 7f4d0daa0640 1 -- start start 2023-12-20T04:23:57.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d0daa0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080b79a0 0x7f4d0814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:57.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d0daa0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d080bc660 0x7f4d0814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:57.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d0daa0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0814b290 0x7f4d0814d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:57.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d0daa0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080b9440 con 0x7f4d0814b290 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d0daa0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d081d7c80 con 0x7f4d080bc660 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d0daa0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0814ce90 con 0x7f4d080b79a0 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0814b290 0x7f4d0814d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d07fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0814b290 0x7f4d0814d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53686/0 (socket says 172.21.15.40:53686) 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d07fff640 1 -- 172.21.15.40:0/2763523272 learned_addr learned my addr 172.21.15.40:0/2763523272 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d06ffd640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d080bc660 0x7f4d0814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.715+0000 7f4d077fe640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080b79a0 0x7f4d0814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d07fff640 1 -- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080b79a0 msgr2=0x7f4d0814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080b79a0 0x7f4d0814be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d07fff640 1 -- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d080bc660 msgr2=0x7f4d0814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:57.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d080bc660 0x7f4d0814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d07fff640 1 -- 172.21.15.40:0/2763523272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0094d0 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d07fff640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0814b290 0x7f4d0814d320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009eb0 tx=0x7f4d00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4ceffff640 1 -- 172.21.15.40:0/2763523272 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0003d600 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4ceffff640 1 -- 172.21.15.40:0/2763523272 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0003d780 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4ceffff640 1 -- 172.21.15.40:0/2763523272 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0003db30 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d00009a70 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.716+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0814c370 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.717+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0814d020 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.717+0000 7f4ceffff640 1 -- 172.21.15.40:0/2763523272 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d0003b040 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.718+0000 7f4ceffff640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4cf406a430 0x7f4cf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.718+0000 7f4ceffff640 1 -- 172.21.15.40:0/2763523272 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4d000aac50 con 0x7f4d0814b290 2023-12-20T04:23:57.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.718+0000 7f4d077fe640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4cf406a430 0x7f4cf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:57.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.718+0000 7f4d077fe640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4cf406a430 0x7f4cf406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000f60 tx=0x7f4cf8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:57.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.722+0000 7f4ceffff640 1 -- 172.21.15.40:0/2763523272 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4d000b0020 con 0x7f4d0814b290 2023-12-20T04:23:57.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:57.897+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d0804e840 con 0x7f4d0814b290 2023-12-20T04:23:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.537+0000 7f4ceffff640 1 -- 172.21.15.40:0/2763523272 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d00076460 con 0x7f4d0814b290 2023-12-20T04:23:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-12-20T04:23:58.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.542+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4cf406a430 msgr2=0x7f4cf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:58.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.542+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4cf406a430 0x7f4cf406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8000f60 tx=0x7f4cf8009040 comp rx=0 tx=0).stop 2023-12-20T04:23:58.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.542+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0814b290 msgr2=0x7f4d0814d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:58.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.542+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0814b290 0x7f4d0814d320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009eb0 tx=0x7f4d00004a40 comp rx=0 tx=0).stop 2023-12-20T04:23:58.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.543+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 shutdown_connections 2023-12-20T04:23:58.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.543+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4cf406a430 0x7f4cf406c8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.543+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4d0814b290 0x7f4d0814d320 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.543+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d080bc660 0x7f4d0814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.543+0000 7f4d0daa0640 1 --2- 172.21.15.40:0/2763523272 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4d080b79a0 0x7f4d0814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.543+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 >> 172.21.15.40:0/2763523272 conn(0x7f4d080c0330 msgr2=0x7f4d080be7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:58.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.544+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 shutdown_connections 2023-12-20T04:23:58.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.545+0000 7f4d0daa0640 1 -- 172.21.15.40:0/2763523272 wait complete. 2023-12-20T04:23:58.562 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:23:58.562 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:23:58.563 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:23:58.563 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:23:58.563 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:23:58.563 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:23:58.563 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:23:58.563 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:23:58.563 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:23:58.563 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:23:58.564 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:23:58.564 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:23:58.573 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:23:58.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:23:58.574 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:23:58.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:23:58.577 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:23:58.577 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:23:58.616 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:23:58.616 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:58.617 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:23:58.617 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:58.620 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:23:58.620 DEBUG:teuthology.parallel:result is None 2023-12-20T04:23:58.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:23:58.705 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-12-20T04:23:58.705 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-12-20T04:23:58.705 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-20T04:23:58.706+0000 7fe2fb5e9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-12-20T04:23:58.706 INFO:tasks.ceph.mds.b.smithi069.stdout:starting mds.b at 2023-12-20T04:23:58.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.739+0000 7f3c16681640 1 Processor -- start 2023-12-20T04:23:58.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.739+0000 7f3c16681640 1 -- start start 2023-12-20T04:23:58.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c16681640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c100707d0 0x7f3c100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c16681640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c10147280 0x7f3c1014aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c16681640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c100b7310 con 0x7f3c100b2ce0 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c16681640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c100b7030 con 0x7f3c10147280 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c16681640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100b7ce0 con 0x7f3c100707d0 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c14c1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c10147280 0x7f3c1014aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c0f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3c100b2ce0 0x7f3c1014a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47824/0 (socket says 172.21.15.40:47824) 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c0f7fe640 1 -- 172.21.15.40:0/1319365466 learned_addr learned my addr 172.21.15.40:0/1319365466 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.740+0000 7f3c0ffff640 1 --2- 172.21.15.40:0/1319365466 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c100707d0 0x7f3c100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.741+0000 7f3c14c1e640 1 -- 172.21.15.40:0/1319365466 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c100707d0 msgr2=0x7f3c100b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.741+0000 7f3c14c1e640 1 --2- 172.21.15.40:0/1319365466 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c100707d0 0x7f3c100b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.741+0000 7f3c14c1e640 1 -- 172.21.15.40:0/1319365466 >> v1:172.21.15.40:6789/0 conn(0x7f3c100b2ce0 legacy=0x7f3c1014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:58.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.741+0000 7f3c14c1e640 1 -- 172.21.15.40:0/1319365466 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1006fe70 con 0x7f3c10147280 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.741+0000 7f3c14c1e640 1 --2- 172.21.15.40:0/1319365466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c10147280 0x7f3c1014aee0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009dc0 tx=0x7f3c0802cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de58f8154cae2b47 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c0effd640 1 -- 172.21.15.40:0/1319365466 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0802dd50 con 0x7f3c10147280 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c0effd640 1 -- 172.21.15.40:0/1319365466 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08035440 con 0x7f3c10147280 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c0effd640 1 -- 172.21.15.40:0/1319365466 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080357d0 con 0x7f3c10147280 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 -- 172.21.15.40:0/1319365466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c10147280 msgr2=0x7f3c1014aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 --2- 172.21.15.40:0/1319365466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c10147280 0x7f3c1014aee0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009dc0 tx=0x7f3c0802cfa0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 -- 172.21.15.40:0/1319365466 shutdown_connections 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 --2- 172.21.15.40:0/1319365466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c10147280 0x7f3c1014aee0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 --2- 172.21.15.40:0/1319365466 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c100707d0 0x7f3c100b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 -- 172.21.15.40:0/1319365466 >> 172.21.15.40:0/1319365466 conn(0x7f3c10069ba0 msgr2=0x7f3c10069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 -- 172.21.15.40:0/1319365466 shutdown_connections 2023-12-20T04:23:58.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.742+0000 7f3c16681640 1 -- 172.21.15.40:0/1319365466 wait complete. 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.743+0000 7f3c16681640 1 Processor -- start 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c16681640 1 -- start start 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c16681640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c100707d0 0x7f3c1013ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c16681640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c100b2ce0 0x7f3c101dde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c16681640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c10147280 0x7f3c10136340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c16681640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10135c10 con 0x7f3c100b2ce0 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c16681640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10140fb0 con 0x7f3c100707d0 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c16681640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1013b2a0 con 0x7f3c10147280 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c0f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c100b2ce0 0x7f3c101dde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c0f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c100b2ce0 0x7f3c101dde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53732/0 (socket says 172.21.15.40:53732) 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.744+0000 7f3c0f7fe640 1 -- 172.21.15.40:0/1065792328 learned_addr learned my addr 172.21.15.40:0/1065792328 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0ffff640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c100707d0 0x7f3c1013ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c14c1e640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c10147280 0x7f3c10136340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:58.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0f7fe640 1 -- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c10147280 msgr2=0x7f3c10136340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0f7fe640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c10147280 0x7f3c10136340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0f7fe640 1 -- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c100707d0 msgr2=0x7f3c1013ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0f7fe640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c100707d0 0x7f3c1013ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0f7fe640 1 -- 172.21.15.40:0/1065792328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009a70 con 0x7f3c100b2ce0 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c14c1e640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c10147280 0x7f3c10136340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0f7fe640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c100b2ce0 0x7f3c101dde90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c400 tx=0x7f3c0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0cff9640 1 -- 172.21.15.40:0/1065792328 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04005ce0 con 0x7f3c100b2ce0 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0cff9640 1 -- 172.21.15.40:0/1065792328 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04005e40 con 0x7f3c100b2ce0 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c0cff9640 1 -- 172.21.15.40:0/1065792328 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040072d0 con 0x7f3c100b2ce0 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1013f7e0 con 0x7f3c100b2ce0 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.745+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1013eed0 con 0x7f3c100b2ce0 2023-12-20T04:23:58.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.746+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1013fd00 con 0x7f3c100b2ce0 2023-12-20T04:23:58.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.749+0000 7f3c0cff9640 1 -- 172.21.15.40:0/1065792328 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3c040074f0 con 0x7f3c100b2ce0 2023-12-20T04:23:58.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.749+0000 7f3c0cff9640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3bfc06a480 0x7f3bfc06c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:58.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.749+0000 7f3c0cff9640 1 -- 172.21.15.40:0/1065792328 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3c04087e60 con 0x7f3c100b2ce0 2023-12-20T04:23:58.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.749+0000 7f3c0ffff640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3bfc06a480 0x7f3bfc06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:58.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.750+0000 7f3c0ffff640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3bfc06a480 0x7f3bfc06c940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009ad0 tx=0x7f3c00008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:58.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.752+0000 7f3c0cff9640 1 -- 172.21.15.40:0/1065792328 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3c04053830 con 0x7f3c100b2ce0 2023-12-20T04:23:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:58.941+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3c1013fd00 con 0x7f3c100b2ce0 2023-12-20T04:23:59.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.758+0000 7f3c0cff9640 1 -- 172.21.15.40:0/1065792328 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3c1013fd00 con 0x7f3c100b2ce0 2023-12-20T04:23:59.758 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-12-20T04:23:59.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.760+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3bfc06a480 msgr2=0x7f3bfc06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.760+0000 7f3c16681640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3bfc06a480 0x7f3bfc06c940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009ad0 tx=0x7f3c00008040 comp rx=0 tx=0).stop 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.760+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c100b2ce0 msgr2=0x7f3c101dde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.760+0000 7f3c16681640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c100b2ce0 0x7f3c101dde90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3c0400c400 tx=0x7f3c0400c8c0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 shutdown_connections 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3bfc06a480 0x7f3bfc06c940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3c10147280 0x7f3c10136340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c100b2ce0 0x7f3c101dde90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 --2- 172.21.15.40:0/1065792328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c100707d0 0x7f3c1013ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 >> 172.21.15.40:0/1065792328 conn(0x7f3c10069ba0 msgr2=0x7f3c10146220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 shutdown_connections 2023-12-20T04:23:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.761+0000 7f3c16681640 1 -- 172.21.15.40:0/1065792328 wait complete. 2023-12-20T04:23:59.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:23:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.886+0000 7f2c4c566640 1 Processor -- start 2023-12-20T04:23:59.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.886+0000 7f2c4c566640 1 -- start start 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4c566640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c4406a470 0x7f2c440bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4c566640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2c440b3900 0x7f2c4414abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4c566640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4414b110 con 0x7f2c44148040 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4c566640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c440c1220 con 0x7f2c440b3900 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4c566640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440bae20 con 0x7f2c4406a470 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4ab03640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c44148040 0x7f2c4414e0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47832/0 (socket says 172.21.15.40:47832) 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4ab03640 1 -- 172.21.15.40:0/580939726 learned_addr learned my addr 172.21.15.40:0/580939726 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c49b01640 1 --2- 172.21.15.40:0/580939726 >> v2:172.21.15.69:3300/0 conn(0x7f2c440b3900 0x7f2c4414abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c4a302640 1 --2- 172.21.15.40:0/580939726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c4406a470 0x7f2c440bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.887+0000 7f2c49300640 1 -- 172.21.15.40:0/580939726 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592555401 0 0) 0x7f2c4414b110 con 0x7f2c44148040 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.888+0000 7f2c49300640 1 -- 172.21.15.40:0/580939726 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c2c003520 con 0x7f2c44148040 2023-12-20T04:23:59.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.888+0000 7f2c49300640 1 -- 172.21.15.40:0/580939726 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556563119 0 0) 0x7f2c2c003520 con 0x7f2c44148040 2023-12-20T04:23:59.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.888+0000 7f2c4a302640 1 -- 172.21.15.40:0/580939726 >> v2:172.21.15.69:3300/0 conn(0x7f2c440b3900 msgr2=0x7f2c4414abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:23:59.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.888+0000 7f2c4a302640 1 --2- 172.21.15.40:0/580939726 >> v2:172.21.15.69:3300/0 conn(0x7f2c440b3900 0x7f2c4414abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.888+0000 7f2c4a302640 1 -- 172.21.15.40:0/580939726 >> v1:172.21.15.40:6789/0 conn(0x7f2c44148040 legacy=0x7f2c4414e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:59.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.888+0000 7f2c4a302640 1 -- 172.21.15.40:0/580939726 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440bf900 con 0x7f2c4406a470 2023-12-20T04:23:59.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4a302640 1 --2- 172.21.15.40:0/580939726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c4406a470 0x7f2c440bb2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0097a0 tx=0x7f2c3c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3363e552f93c884 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:59.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c49300640 1 -- 172.21.15.40:0/580939726 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c340019f0 con 0x7f2c4406a470 2023-12-20T04:23:59.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c49300640 1 -- 172.21.15.40:0/580939726 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c02e050 con 0x7f2c4406a470 2023-12-20T04:23:59.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c49300640 1 -- 172.21.15.40:0/580939726 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c030730 con 0x7f2c4406a470 2023-12-20T04:23:59.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 -- 172.21.15.40:0/580939726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c4406a470 msgr2=0x7f2c440bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:59.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 --2- 172.21.15.40:0/580939726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c4406a470 0x7f2c440bb2b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0097a0 tx=0x7f2c3c02b790 comp rx=0 tx=0).stop 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 -- 172.21.15.40:0/580939726 shutdown_connections 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 --2- 172.21.15.40:0/580939726 >> v2:172.21.15.69:3300/0 conn(0x7f2c440b3900 0x7f2c4414abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 --2- 172.21.15.40:0/580939726 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c4406a470 0x7f2c440bb2b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 -- 172.21.15.40:0/580939726 >> 172.21.15.40:0/580939726 conn(0x7f2c440c0270 msgr2=0x7f2c440c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 -- 172.21.15.40:0/580939726 shutdown_connections 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.889+0000 7f2c4c566640 1 -- 172.21.15.40:0/580939726 wait complete. 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.890+0000 7f2c4c566640 1 Processor -- start 2023-12-20T04:23:59.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.890+0000 7f2c4c566640 1 -- start start 2023-12-20T04:23:59.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4c566640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c4406a470 0x7f2c4414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:59.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4c566640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c440b3900 0x7f2c4414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4c566640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c44148040 0x7f2c4414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4c566640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4414e760 con 0x7f2c440b3900 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4c566640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c440b4280 con 0x7f2c4406a470 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4c566640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c441dff60 con 0x7f2c44148040 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c49b01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c440b3900 0x7f2c4414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c49b01640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c440b3900 0x7f2c4414cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53742/0 (socket says 172.21.15.40:53742) 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c49b01640 1 -- 172.21.15.40:0/2805671054 learned_addr learned my addr 172.21.15.40:0/2805671054 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4ab03640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c44148040 0x7f2c4414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.891+0000 7f2c4a302640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c4406a470 0x7f2c4414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c49b01640 1 -- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c44148040 msgr2=0x7f2c4414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c49b01640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c44148040 0x7f2c4414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c49b01640 1 -- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c4406a470 msgr2=0x7f2c4414e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c49b01640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c4406a470 0x7f2c4414e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c49b01640 1 -- 172.21.15.40:0/2805671054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c009400 con 0x7f2c440b3900 2023-12-20T04:23:59.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c49b01640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c440b3900 0x7f2c4414cb30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800e9b0 tx=0x7f2c3800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c42ffd640 1 -- 172.21.15.40:0/2805671054 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38009670 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c42ffd640 1 -- 172.21.15.40:0/2805671054 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3800c9a0 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c441e0240 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c42ffd640 1 -- 172.21.15.40:0/2805671054 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800cd50 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.892+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c441e05d0 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.893+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4414eeb0 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.893+0000 7f2c42ffd640 1 -- 172.21.15.40:0/2805671054 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c38013470 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.894+0000 7f2c42ffd640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2c3006a430 0x7f2c3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.894+0000 7f2c42ffd640 1 -- 172.21.15.40:0/2805671054 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c38088770 con 0x7f2c440b3900 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.894+0000 7f2c4a302640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2c3006a430 0x7f2c3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:23:59.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.894+0000 7f2c4a302640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2c3006a430 0x7f2c3006c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c034000 tx=0x7f2c3c02f000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:23:59.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:23:59.898+0000 7f2c42ffd640 1 -- 172.21.15.40:0/2805671054 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2c38054170 con 0x7f2c440b3900 2023-12-20T04:24:00.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.139+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2c441e03d0 con 0x7f2c440b3900 2023-12-20T04:24:00.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.140+0000 7f2c42ffd640 1 -- 172.21.15.40:0/2805671054 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f2c38057790 con 0x7f2c440b3900 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAFbIJl6cAWEBAAS15c3doEp2caBK9E81N01g==", 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-20T04:24:00.140 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAFbIJl8iFPHRAALyhjvBBaHSe977ENcZZpow==", 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.141 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAFbIJlIz8QGBAAGrcvYXDWFVf5GhvQNAuUpQ==", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAIbIJlCDyINRAAmfMMf25bBNKGxum/KnW/Mw==", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.142 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQALbIJljCSyNBAAlAk/lND6EpnRmDgzDN0poA==", 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-12-20T04:24:00.143 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAObIJl3r56MxAAr5/LQ56nAaJiKgFIGpFVIw==", 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQARbIJlRFnkMhAAhnoCqfbZNNZiYeFw21HCpQ==", 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.144 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAXbIJlqDz+ORAAqFbSJiQJcbarmw8Lv+AzJw==", 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAabIJlAGsiOBAAB7CGaBGfIkssUzDWkKEfww==", 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.145 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAdbIJlkcVpNhAA6KGypowWcacAenfrzuWJIA==", 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.146 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAgbIJlYh5FNRAAEktJ21c6KbqHX7YzoLw4IQ==", 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAFbIJlauARJhAAiAWbidqDV0sj50MXKz7orw==", 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-12-20T04:24:00.147 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAEbIJl4UNQIBAAiKmukv4UdnsKSNal0x9M9Q==", 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.148 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAmbIJl/zvtGxAAFC7sm2oalav9ok8NiSky5Q==", 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAmbIJlWUXtGxAAvn29AR3Ek+3y8mhgl/FP0g==", 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.149 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAmbIJl7UztGxAAokky6YFohwEOanicv/NYlw==", 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAmbIJlRFTtGxAAo/UOn7jLqGpJS3Nt9tvh3A==", 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.150 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAmbIJltlvtGxAAwSqlBPTh1ISJ7SY2pWFhcw==", 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAmbIJlhWPtGxAAxWsjR9o34d7mDJLjV+DDag==", 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.151 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAFbIJle3gfDBAALZmlIBpltRbrIpKDMWUxaw==", 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAFbIJlAaWTCBAAl7nRzwbGlORdLJdTxyM4NQ==", 2023-12-20T04:24:00.152 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-12-20T04:24:00.153 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-12-20T04:24:00.153 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-12-20T04:24:00.153 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-12-20T04:24:00.153 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.153 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:00.153 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-12-20T04:24:00.153 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T04:24:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.141+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2c3006a430 msgr2=0x7f2c3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.141+0000 7f2c4c566640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2c3006a430 0x7f2c3006c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c034000 tx=0x7f2c3c02f000 comp rx=0 tx=0).stop 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.141+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c440b3900 msgr2=0x7f2c4414cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.141+0000 7f2c4c566640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c440b3900 0x7f2c4414cb30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800e9b0 tx=0x7f2c3800ee70 comp rx=0 tx=0).stop 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 shutdown_connections 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f2c3006a430 0x7f2c3006c8f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f2c44148040 0x7f2c4414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c440b3900 0x7f2c4414cb30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 --2- 172.21.15.40:0/2805671054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c4406a470 0x7f2c4414e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 >> 172.21.15.40:0/2805671054 conn(0x7f2c440c0270 msgr2=0x7f2c440a15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 shutdown_connections 2023-12-20T04:24:00.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.142+0000 7f2c4c566640 1 -- 172.21.15.40:0/2805671054 wait complete. 2023-12-20T04:24:00.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-20T04:24:00.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.262+0000 7f4e4a305640 1 Processor -- start 2023-12-20T04:24:00.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.262+0000 7f4e4a305640 1 -- start start 2023-12-20T04:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e4a305640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e4414ab10 0x7f4e4414af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e4a305640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e44070be0 0x7f4e44071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e4a305640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e440715b0 con 0x7f4e4406ae20 2023-12-20T04:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e4a305640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e440706a0 con 0x7f4e4414ab10 2023-12-20T04:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e4a305640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440b6b30 con 0x7f4e44070be0 2023-12-20T04:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e437fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4e4414ab10 0x7f4e4414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e43fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4e4406ae20 0x7f4e4406f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47834/0 (socket says 172.21.15.40:47834) 2023-12-20T04:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e43fff640 1 -- 172.21.15.40:0/360111442 learned_addr learned my addr 172.21.15.40:0/360111442 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e488a2640 1 --2- 172.21.15.40:0/360111442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e44070be0 0x7f4e44071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e437fe640 1 -- 172.21.15.40:0/360111442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e44070be0 msgr2=0x7f4e44071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e437fe640 1 --2- 172.21.15.40:0/360111442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e44070be0 0x7f4e44071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e437fe640 1 -- 172.21.15.40:0/360111442 >> v1:172.21.15.40:6789/0 conn(0x7f4e4406ae20 legacy=0x7f4e4406f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e437fe640 1 -- 172.21.15.40:0/360111442 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e440b6290 con 0x7f4e4414ab10 2023-12-20T04:24:00.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.263+0000 7f4e42ffd640 1 -- 172.21.15.40:0/360111442 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260964178 0 0) 0x7f4e440715b0 con 0x7f4e4406ae20 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.264+0000 7f4e437fe640 1 --2- 172.21.15.40:0/360111442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4414ab10 0x7f4e4414af80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400a970 tx=0x7f4e3402cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a817d4aa48b930c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.264+0000 7f4e42ffd640 1 -- 172.21.15.40:0/360111442 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3402db20 con 0x7f4e4414ab10 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.264+0000 7f4e42ffd640 1 -- 172.21.15.40:0/360111442 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3402dc80 con 0x7f4e4414ab10 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.264+0000 7f4e42ffd640 1 -- 172.21.15.40:0/360111442 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34035440 con 0x7f4e4414ab10 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 -- 172.21.15.40:0/360111442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4414ab10 msgr2=0x7f4e4414af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 --2- 172.21.15.40:0/360111442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4414ab10 0x7f4e4414af80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400a970 tx=0x7f4e3402cd70 comp rx=0 tx=0).stop 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 -- 172.21.15.40:0/360111442 shutdown_connections 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 --2- 172.21.15.40:0/360111442 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e44070be0 0x7f4e44071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 --2- 172.21.15.40:0/360111442 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e4414ab10 0x7f4e4414af80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 -- 172.21.15.40:0/360111442 >> 172.21.15.40:0/360111442 conn(0x7f4e440b9100 msgr2=0x7f4e440b9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 -- 172.21.15.40:0/360111442 shutdown_connections 2023-12-20T04:24:00.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.265+0000 7f4e4a305640 1 -- 172.21.15.40:0/360111442 wait complete. 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.266+0000 7f4e4a305640 1 Processor -- start 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.266+0000 7f4e4a305640 1 -- start start 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e4a305640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e4406ae20 0x7f4e440bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e4a305640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e44070be0 0x7f4e4413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e4a305640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e4414ab10 0x7f4e441e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e4a305640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440719d0 con 0x7f4e44070be0 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e4a305640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440b3540 con 0x7f4e4406ae20 2023-12-20T04:24:00.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e4a305640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e440b2f80 con 0x7f4e4414ab10 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e44070be0 0x7f4e4413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e44070be0 0x7f4e4413e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53762/0 (socket says 172.21.15.40:53762) 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 -- 172.21.15.40:0/3393139081 learned_addr learned my addr 172.21.15.40:0/3393139081 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e43fff640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e4406ae20 0x7f4e440bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e488a2640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e4414ab10 0x7f4e441e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 -- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e4414ab10 msgr2=0x7f4e441e05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e4414ab10 0x7f4e441e05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 -- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e4406ae20 msgr2=0x7f4e440bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e4406ae20 0x7f4e440bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 -- 172.21.15.40:0/3393139081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3400a5a0 con 0x7f4e44070be0 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e43fff640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e4406ae20 0x7f4e440bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e488a2640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e4414ab10 0x7f4e441e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.267+0000 7f4e437fe640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e44070be0 0x7f4e4413e460 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400a8c0 tx=0x7f4e34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:00.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.268+0000 7f4e40ff9640 1 -- 172.21.15.40:0/3393139081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3402db20 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.268+0000 7f4e40ff9640 1 -- 172.21.15.40:0/3393139081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34004030 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.268+0000 7f4e40ff9640 1 -- 172.21.15.40:0/3393139081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340043c0 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.268+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e440b3260 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.268+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e44148050 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.269+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4404e840 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.269+0000 7f4e40ff9640 1 -- 172.21.15.40:0/3393139081 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e34003610 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.269+0000 7f4e40ff9640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e2406a430 0x7f4e2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.269+0000 7f4e40ff9640 1 -- 172.21.15.40:0/3393139081 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4e340aafc0 con 0x7f4e44070be0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.269+0000 7f4e43fff640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e2406a430 0x7f4e2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.270+0000 7f4e43fff640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e2406a430 0x7f4e2406c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c007fd0 tx=0x7f4e2c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:00.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.274+0000 7f4e40ff9640 1 -- 172.21.15.40:0/3393139081 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4e340ddca0 con 0x7f4e44070be0 2023-12-20T04:24:00.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.514+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4e440b3700 con 0x7f4e44070be0 2023-12-20T04:24:00.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.518+0000 7f4e40ff9640 1 -- 172.21.15.40:0/3393139081 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4e3403a0a0 con 0x7f4e44070be0 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e2406a430 msgr2=0x7f4e2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e2406a430 0x7f4e2406c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c007fd0 tx=0x7f4e2c009040 comp rx=0 tx=0).stop 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e44070be0 msgr2=0x7f4e4413e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e44070be0 0x7f4e4413e460 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400a8c0 tx=0x7f4e34004730 comp rx=0 tx=0).stop 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 shutdown_connections 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4e2406a430 0x7f4e2406c8f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4e4414ab10 0x7f4e441e05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4e44070be0 0x7f4e4413e460 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 --2- 172.21.15.40:0/3393139081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e4406ae20 0x7f4e440bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 >> 172.21.15.40:0/3393139081 conn(0x7f4e440b9100 msgr2=0x7f4e44140940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 shutdown_connections 2023-12-20T04:24:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.520+0000 7f4e4a305640 1 -- 172.21.15.40:0/3393139081 wait complete. 2023-12-20T04:24:00.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-20T04:24:00.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.637+0000 7f7bf91b1640 1 Processor -- start 2023-12-20T04:24:00.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.637+0000 7f7bf91b1640 1 -- start start 2023-12-20T04:24:00.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf91b1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bf40bcdd0 0x7f7bf40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf91b1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7bf40b64c0 0x7f7bf4144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf91b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf4144cd0 0x7f7bf414e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf91b1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40bc6b0 con 0x7f7bf40bcdd0 2023-12-20T04:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf91b1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf40b6900 con 0x7f7bf40b64c0 2023-12-20T04:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf91b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40a59f0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bf40bcdd0 0x7f7bf40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7bf40bcdd0 0x7f7bf40b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53766/0 (socket says 172.21.15.40:53766) 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 -- 172.21.15.40:0/1275718369 learned_addr learned my addr 172.21.15.40:0/1275718369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf359e640 1 --2- 172.21.15.40:0/1275718369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf4144cd0 0x7f7bf414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bea59c640 1 --2- 172.21.15.40:0/1275718369 >> v2:172.21.15.69:3300/0 conn(0x7f7bf40b64c0 0x7f7bf4144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 -- 172.21.15.40:0/1275718369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf4144cd0 msgr2=0x7f7bf414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 --2- 172.21.15.40:0/1275718369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf4144cd0 0x7f7bf414e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 -- 172.21.15.40:0/1275718369 >> v2:172.21.15.69:3300/0 conn(0x7f7bf40b64c0 msgr2=0x7f7bf4144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 --2- 172.21.15.40:0/1275718369 >> v2:172.21.15.69:3300/0 conn(0x7f7bf40b64c0 0x7f7bf4144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.638+0000 7f7bf2d9d640 1 -- 172.21.15.40:0/1275718369 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40bc0a0 con 0x7f7bf40bcdd0 2023-12-20T04:24:00.645 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf2d9d640 1 --2- 172.21.15.40:0/1275718369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf40bcdd0 0x7f7bf40b5f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40b72e0 tx=0x7f7be402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88e455e26a339e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf259c640 1 -- 172.21.15.40:0/1275718369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4030860 con 0x7f7bf40bcdd0 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf259c640 1 -- 172.21.15.40:0/1275718369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40309c0 con 0x7f7bf40bcdd0 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf259c640 1 -- 172.21.15.40:0/1275718369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4030d50 con 0x7f7bf40bcdd0 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1275718369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf40bcdd0 msgr2=0x7f7bf40b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1275718369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf40bcdd0 0x7f7bf40b5f80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7bf40b72e0 tx=0x7f7be402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1275718369 shutdown_connections 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.639+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1275718369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf4144cd0 0x7f7bf414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.640+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1275718369 >> v2:172.21.15.69:3300/0 conn(0x7f7bf40b64c0 0x7f7bf4144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.640+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1275718369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf40bcdd0 0x7f7bf40b5f80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.640+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1275718369 >> 172.21.15.40:0/1275718369 conn(0x7f7bf4071e60 msgr2=0x7f7bf40c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.640+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1275718369 shutdown_connections 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.640+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1275718369 wait complete. 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.641+0000 7f7bf91b1640 1 Processor -- start 2023-12-20T04:24:00.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.641+0000 7f7bf91b1640 1 -- start start 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.641+0000 7f7bf91b1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bf40b64c0 0x7f7bf4145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.641+0000 7f7bf91b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf40bcdd0 0x7f7bf41d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.641+0000 7f7bf91b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4144cd0 0x7f7bf41e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.641+0000 7f7bf91b1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41d23c0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.641+0000 7f7bf91b1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41d4ef0 con 0x7f7bf40b64c0 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf91b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf41d4a60 con 0x7f7bf40bcdd0 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4144cd0 0x7f7bf41e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4144cd0 0x7f7bf41e2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53768/0 (socket says 172.21.15.40:53768) 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 -- 172.21.15.40:0/1513407662 learned_addr learned my addr 172.21.15.40:0/1513407662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf2d9d640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bf40b64c0 0x7f7bf4145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bea59c640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf40bcdd0 0x7f7bf41d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 -- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf40bcdd0 msgr2=0x7f7bf41d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf40bcdd0 0x7f7bf41d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 -- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bf40b64c0 msgr2=0x7f7bf4145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bf40b64c0 0x7f7bf4145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 -- 172.21.15.40:0/1513407662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40094d0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf2d9d640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bf40b64c0 0x7f7bf4145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf359e640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4144cd0 0x7f7bf41e2a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00efc0 tx=0x7f7bec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bebfff640 1 -- 172.21.15.40:0/1513407662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec009ba0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bebfff640 1 -- 172.21.15.40:0/1513407662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec00f040 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf41463f0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bebfff640 1 -- 172.21.15.40:0/1513407662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec0146c0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.642+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf41d4410 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.643+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf404e840 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.644+0000 7f7bebfff640 1 -- 172.21.15.40:0/1513407662 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7bec014820 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.644+0000 7f7bebfff640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7bd406a460 0x7f7bd406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.644+0000 7f7bebfff640 1 -- 172.21.15.40:0/1513407662 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7bec088e30 con 0x7f7bf4144cd0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.644+0000 7f7bf2d9d640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7bd406a460 0x7f7bd406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:00.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.645+0000 7f7bf2d9d640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7bd406a460 0x7f7bd406c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7be4036000 tx=0x7f7be4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:00.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.649+0000 7f7bebfff640 1 -- 172.21.15.40:0/1513407662 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7bec0548b0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.890+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7bf4142a10 con 0x7f7bf4144cd0 2023-12-20T04:24:00.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.894+0000 7f7bebfff640 1 -- 172.21.15.40:0/1513407662 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7bec0180a0 con 0x7f7bf4144cd0 2023-12-20T04:24:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7bd406a460 msgr2=0x7f7bd406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7bd406a460 0x7f7bd406c920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7be4036000 tx=0x7f7be4008030 comp rx=0 tx=0).stop 2023-12-20T04:24:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4144cd0 msgr2=0x7f7bf41e2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4144cd0 0x7f7bf41e2a10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7bec00efc0 tx=0x7f7bec00c490 comp rx=0 tx=0).stop 2023-12-20T04:24:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 shutdown_connections 2023-12-20T04:24:00.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7bd406a460 0x7f7bd406c920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7bf4144cd0 0x7f7bf41e2a10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7bf40bcdd0 0x7f7bf41d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 --2- 172.21.15.40:0/1513407662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bf40b64c0 0x7f7bf4145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 >> 172.21.15.40:0/1513407662 conn(0x7f7bf4071e60 msgr2=0x7f7bf40b8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 shutdown_connections 2023-12-20T04:24:00.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:00.896+0000 7f7bf91b1640 1 -- 172.21.15.40:0/1513407662 wait complete. 2023-12-20T04:24:00.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-20T04:24:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.014+0000 7f93169ea640 1 Processor -- start 2023-12-20T04:24:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.014+0000 7f93169ea640 1 -- start start 2023-12-20T04:24:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f93169ea640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9310144ea0 0x7f9310156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f93169ea640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93100bc6b0 con 0x7f93100b6690 2023-12-20T04:24:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f93169ea640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93100a59f0 con 0x7f93100bcdd0 2023-12-20T04:24:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f93169ea640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93100bc0a0 con 0x7f9310144ea0 2023-12-20T04:24:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f930f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f93100b6690 0x7f9310144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47842/0 (socket says 172.21.15.40:47842) 2023-12-20T04:24:01.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f930f7fe640 1 -- 172.21.15.40:0/1401287126 learned_addr learned my addr 172.21.15.40:0/1401287126 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f9314f87640 1 --2- 172.21.15.40:0/1401287126 >> v2:172.21.15.69:3300/0 conn(0x7f9310144ea0 0x7f9310156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f930effd640 1 -- 172.21.15.40:0/1401287126 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475020115 0 0) 0x7f93100bc6b0 con 0x7f93100b6690 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f930effd640 1 -- 172.21.15.40:0/1401287126 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f8003520 con 0x7f93100b6690 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f930effd640 1 -- 172.21.15.40:0/1401287126 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823915810 0 0) 0x7f93100a59f0 con 0x7f93100bcdd0 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f930effd640 1 -- 172.21.15.40:0/1401287126 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93100bc6b0 con 0x7f93100bcdd0 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f9314f87640 1 -- 172.21.15.40:0/1401287126 >> v1:172.21.15.69:6789/0 conn(0x7f93100bcdd0 legacy=0x7f93100b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f9314f87640 1 -- 172.21.15.40:0/1401287126 >> v1:172.21.15.40:6789/0 conn(0x7f93100b6690 legacy=0x7f9310144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.015+0000 7f9314f87640 1 -- 172.21.15.40:0/1401287126 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100bc340 con 0x7f9310144ea0 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.016+0000 7f9314f87640 1 --2- 172.21.15.40:0/1401287126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9310144ea0 0x7f9310156350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f93100a5b80 tx=0x7f930802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ef0ce848b88630 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.016+0000 7f930effd640 1 -- 172.21.15.40:0/1401287126 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930802cd80 con 0x7f9310144ea0 2023-12-20T04:24:01.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.016+0000 7f930effd640 1 -- 172.21.15.40:0/1401287126 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308034440 con 0x7f9310144ea0 2023-12-20T04:24:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.016+0000 7f930effd640 1 -- 172.21.15.40:0/1401287126 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93080347d0 con 0x7f9310144ea0 2023-12-20T04:24:01.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.017+0000 7f93169ea640 1 -- 172.21.15.40:0/1401287126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9310144ea0 msgr2=0x7f9310156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.017+0000 7f93169ea640 1 --2- 172.21.15.40:0/1401287126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9310144ea0 0x7f9310156350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f93100a5b80 tx=0x7f930802bfd0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.017+0000 7f93169ea640 1 -- 172.21.15.40:0/1401287126 shutdown_connections 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.017+0000 7f93169ea640 1 --2- 172.21.15.40:0/1401287126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9310144ea0 0x7f9310156350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.017+0000 7f93169ea640 1 -- 172.21.15.40:0/1401287126 >> 172.21.15.40:0/1401287126 conn(0x7f9310071e60 msgr2=0x7f93100c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.017+0000 7f93169ea640 1 -- 172.21.15.40:0/1401287126 shutdown_connections 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.017+0000 7f93169ea640 1 -- 172.21.15.40:0/1401287126 wait complete. 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.018+0000 7f93169ea640 1 Processor -- start 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.018+0000 7f93169ea640 1 -- start start 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93100b6690 0x7f93101462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93100bcdd0 0x7f93101d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9310144ea0 0x7f93101e3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9310146820 con 0x7f9310144ea0 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93101d4240 con 0x7f93100bcdd0 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93101d3db0 con 0x7f93100b6690 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9310144ea0 0x7f93101e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9310144ea0 0x7f93101e3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53782/0 (socket says 172.21.15.40:53782) 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 -- 172.21.15.40:0/2280984456 learned_addr learned my addr 172.21.15.40:0/2280984456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f930f7fe640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93100bcdd0 0x7f93101d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f930ffff640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93100b6690 0x7f93101462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 -- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93100b6690 msgr2=0x7f93101462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93100b6690 0x7f93101462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 -- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93100bcdd0 msgr2=0x7f93101d1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93100bcdd0 0x7f93101d1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 -- 172.21.15.40:0/2280984456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308009a70 con 0x7f9310144ea0 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f930f7fe640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93100bcdd0 0x7f93101d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:01.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f9314f87640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9310144ea0 0x7f93101e3160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f930802c5e0 tx=0x7f9308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f930cff9640 1 -- 172.21.15.40:0/2280984456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308009450 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f930cff9640 1 -- 172.21.15.40:0/2280984456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308040450 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93101d3480 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f930cff9640 1 -- 172.21.15.40:0/2280984456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9308040800 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.019+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93101d3a40 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.020+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93100b5c10 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.021+0000 7f930cff9640 1 -- 172.21.15.40:0/2280984456 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9308040960 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.021+0000 7f930cff9640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92fc06a430 0x7f92fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.021+0000 7f930cff9640 1 -- 172.21.15.40:0/2280984456 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93080ab230 con 0x7f9310144ea0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.021+0000 7f930ffff640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92fc06a430 0x7f92fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.022+0000 7f930ffff640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92fc06a430 0x7f92fc06c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f93000011e0 tx=0x7f9300009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.025+0000 7f930cff9640 1 -- 172.21.15.40:0/2280984456 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f93100b5c10 con 0x7f9310144ea0 2023-12-20T04:24:01.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.266+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f93100b5c10 con 0x7f9310144ea0 2023-12-20T04:24:01.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.269+0000 7f930cff9640 1 -- 172.21.15.40:0/2280984456 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f93100b5c10 con 0x7f9310144ea0 2023-12-20T04:24:01.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92fc06a430 msgr2=0x7f92fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92fc06a430 0x7f92fc06c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f93000011e0 tx=0x7f9300009040 comp rx=0 tx=0).stop 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9310144ea0 msgr2=0x7f93101e3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9310144ea0 0x7f93101e3160 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f930802c5e0 tx=0x7f9308004a40 comp rx=0 tx=0).stop 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 shutdown_connections 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92fc06a430 0x7f92fc06c8f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9310144ea0 0x7f93101e3160 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93100bcdd0 0x7f93101d1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 --2- 172.21.15.40:0/2280984456 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f93100b6690 0x7f93101462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 >> 172.21.15.40:0/2280984456 conn(0x7f9310071e60 msgr2=0x7f93100b8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 shutdown_connections 2023-12-20T04:24:01.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.271+0000 7f93169ea640 1 -- 172.21.15.40:0/2280984456 wait complete. 2023-12-20T04:24:01.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-20T04:24:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.389+0000 7f6cb0a41640 1 Processor -- start 2023-12-20T04:24:01.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.389+0000 7f6cb0a41640 1 -- start start 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.389+0000 7f6cb0a41640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0bcdd0 0x7f6cac0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6cb0a41640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cac144ea0 0x7f6cac155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6cb0a41640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac0bc6b0 con 0x7f6cac0b64c0 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6cb0a41640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0b6900 con 0x7f6cac144ea0 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6cb0a41640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0a59f0 con 0x7f6cac0bcdd0 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cac144ea0 0x7f6cac155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cac144ea0 0x7f6cac155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53794/0 (socket says 172.21.15.40:53794) 2023-12-20T04:24:01.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caad9d640 1 -- 172.21.15.40:0/2652182662 learned_addr learned my addr 172.21.15.40:0/2652182662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caa59c640 1 --2- 172.21.15.40:0/2652182662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0bcdd0 0x7f6cac0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caad9d640 1 -- 172.21.15.40:0/2652182662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0bcdd0 msgr2=0x7f6cac0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caad9d640 1 --2- 172.21.15.40:0/2652182662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0bcdd0 0x7f6cac0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caad9d640 1 -- 172.21.15.40:0/2652182662 >> v1:172.21.15.69:6789/0 conn(0x7f6cac0b64c0 legacy=0x7f6cac144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.390+0000 7f6caad9d640 1 -- 172.21.15.40:0/2652182662 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0bc0a0 con 0x7f6cac144ea0 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6caad9d640 1 --2- 172.21.15.40:0/2652182662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac155340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009e50 tx=0x7f6ca402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9e387dbca73a9e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6ca9d9b640 1 -- 172.21.15.40:0/2652182662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca402cb90 con 0x7f6cac144ea0 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6ca9d9b640 1 -- 172.21.15.40:0/2652182662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca402ccf0 con 0x7f6cac144ea0 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6ca9d9b640 1 -- 172.21.15.40:0/2652182662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4034610 con 0x7f6cac144ea0 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6cb0a41640 1 -- 172.21.15.40:0/2652182662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 msgr2=0x7f6cac155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/2652182662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac155340 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009e50 tx=0x7f6ca402bff0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6cb0a41640 1 -- 172.21.15.40:0/2652182662 shutdown_connections 2023-12-20T04:24:01.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/2652182662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac155340 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/2652182662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0bcdd0 0x7f6cac0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.391+0000 7f6cb0a41640 1 -- 172.21.15.40:0/2652182662 >> 172.21.15.40:0/2652182662 conn(0x7f6cac071e60 msgr2=0x7f6cac0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.392+0000 7f6cb0a41640 1 -- 172.21.15.40:0/2652182662 shutdown_connections 2023-12-20T04:24:01.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.392+0000 7f6cb0a41640 1 -- 172.21.15.40:0/2652182662 wait complete. 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 Processor -- start 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 -- start start 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0b64c0 0x7f6cac1e2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cac0bcdd0 0x7f6cac14a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac147d70 con 0x7f6cac144ea0 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac14a530 con 0x7f6cac0bcdd0 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6cb0a41640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac09a0a0 con 0x7f6cac0b64c0 2023-12-20T04:24:01.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.393+0000 7f6caad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac147830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53802/0 (socket says 172.21.15.40:53802) 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 -- 172.21.15.40:0/3283357255 learned_addr learned my addr 172.21.15.40:0/3283357255 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caa59c640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0b64c0 0x7f6cac1e2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6ca3fff640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cac0bcdd0 0x7f6cac14a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 -- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0b64c0 msgr2=0x7f6cac1e2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0b64c0 0x7f6cac1e2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 -- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cac0bcdd0 msgr2=0x7f6cac14a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cac0bcdd0 0x7f6cac14a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 -- 172.21.15.40:0/3283357255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4009b30 con 0x7f6cac144ea0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6caad9d640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac147830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4036040 tx=0x7f6ca4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6ca2ffd640 1 -- 172.21.15.40:0/3283357255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4009510 con 0x7f6cac144ea0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6ca2ffd640 1 -- 172.21.15.40:0/3283357255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca403e450 con 0x7f6cac144ea0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac099ae0 con 0x7f6cac144ea0 2023-12-20T04:24:01.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6ca2ffd640 1 -- 172.21.15.40:0/3283357255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca403e7e0 con 0x7f6cac144ea0 2023-12-20T04:24:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.394+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac099450 con 0x7f6cac144ea0 2023-12-20T04:24:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.395+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac14a320 con 0x7f6cac144ea0 2023-12-20T04:24:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.396+0000 7f6ca2ffd640 1 -- 172.21.15.40:0/3283357255 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ca403e940 con 0x7f6cac144ea0 2023-12-20T04:24:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.396+0000 7f6ca2ffd640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.396+0000 7f6ca2ffd640 1 -- 172.21.15.40:0/3283357255 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ca40aaef0 con 0x7f6cac144ea0 2023-12-20T04:24:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.396+0000 7f6caa59c640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.397+0000 7f6caa59c640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009b40 tx=0x7f6c9c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.400+0000 7f6ca2ffd640 1 -- 172.21.15.40:0/3283357255 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6ca40768e0 con 0x7f6cac144ea0 2023-12-20T04:24:01.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.642+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6cac04e840 con 0x7f6cac144ea0 2023-12-20T04:24:01.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.646+0000 7f6ca2ffd640 1 -- 172.21.15.40:0/3283357255 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6ca40430a0 con 0x7f6cac144ea0 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.647+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c8c06a430 msgr2=0x7f6c8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.647+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009b40 tx=0x7f6c9c009190 comp rx=0 tx=0).stop 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.647+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 msgr2=0x7f6cac147830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.647+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac147830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4036040 tx=0x7f6ca4004a40 comp rx=0 tx=0).stop 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 shutdown_connections 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c8c06a430 0x7f6c8c06c8f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cac144ea0 0x7f6cac147830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cac0bcdd0 0x7f6cac14a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 --2- 172.21.15.40:0/3283357255 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6cac0b64c0 0x7f6cac1e2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 >> 172.21.15.40:0/3283357255 conn(0x7f6cac071e60 msgr2=0x7f6cac0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:01.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 shutdown_connections 2023-12-20T04:24:01.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.648+0000 7f6cb0a41640 1 -- 172.21.15.40:0/3283357255 wait complete. 2023-12-20T04:24:01.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-20T04:24:01.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.765+0000 7ff7de981640 1 Processor -- start 2023-12-20T04:24:01.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.765+0000 7ff7de981640 1 -- start start 2023-12-20T04:24:01.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7de981640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 0x7ff7d8144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7de981640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d80bc6b0 con 0x7ff7d8144cd0 2023-12-20T04:24:01.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7de981640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d80a59f0 con 0x7ff7d80bcdd0 2023-12-20T04:24:01.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7de981640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80bc0a0 con 0x7ff7d80b6690 2023-12-20T04:24:01.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7dcf1e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff7d8144cd0 0x7ff7d8155340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47850/0 (socket says 172.21.15.40:47850) 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7dcf1e640 1 -- 172.21.15.40:0/3871239449 learned_addr learned my addr 172.21.15.40:0/3871239449 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d77fe640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 0x7ff7d8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105548860 0 0) 0x7ff7d80bc6b0 con 0x7ff7d8144cd0 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c0003520 con 0x7ff7d8144cd0 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223098143 0 0) 0x7ff7c0003520 con 0x7ff7d8144cd0 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 msgr2=0x7ff7d8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 0x7ff7d8144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 >> v1:172.21.15.69:6789/0 conn(0x7ff7d80bcdd0 legacy=0x7ff7d80b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80bc340 con 0x7ff7d8144cd0 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7ff7d00019f0 con 0x7ff7d8144cd0 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 >> v1:172.21.15.40:6789/0 conn(0x7ff7d8144cd0 legacy=0x7ff7d8155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c00039a0 0x7ff7c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00047c0 0x7ff7c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 0x7ff7c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80bc0a0 con 0x7ff7c00039a0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c000bac0 con 0x7ff7c00047c0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.766+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c000bc80 con 0x7ff7d80b6690 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7d7fff640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c00039a0 0x7ff7c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7d77fe640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00047c0 0x7ff7c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7dcf1e640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 0x7ff7c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7d7fff640 1 -- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 msgr2=0x7ff7c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7d7fff640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d80b6690 0x7ff7c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7d7fff640 1 -- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00047c0 msgr2=0x7ff7c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7d7fff640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00047c0 0x7ff7c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.767+0000 7ff7d7fff640 1 -- 172.21.15.40:0/3871239449 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0003520 con 0x7ff7c00039a0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7d7fff640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c00039a0 0x7ff7c0003dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc001720 tx=0x7ff7c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b542ac0583f6c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0052d0 con 0x7ff7c00039a0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc02e050 con 0x7ff7c00039a0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7d6ffd640 1 -- 172.21.15.40:0/3871239449 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0035f0 con 0x7ff7c00039a0 2023-12-20T04:24:01.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7de981640 1 -- 172.21.15.40:0/3871239449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c00039a0 msgr2=0x7ff7c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7de981640 1 --2- 172.21.15.40:0/3871239449 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7c00039a0 0x7ff7c0003dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc001720 tx=0x7ff7c00057f0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7dcf1e640 1 -- 172.21.15.40:0/3871239449 reap_dead start 2023-12-20T04:24:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7de981640 1 -- 172.21.15.40:0/3871239449 shutdown_connections 2023-12-20T04:24:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7de981640 1 -- 172.21.15.40:0/3871239449 >> 172.21.15.40:0/3871239449 conn(0x7ff7d8071e60 msgr2=0x7ff7d80c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7de981640 1 -- 172.21.15.40:0/3871239449 shutdown_connections 2023-12-20T04:24:01.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.768+0000 7ff7de981640 1 -- 172.21.15.40:0/3871239449 wait complete. 2023-12-20T04:24:01.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.769+0000 7ff7de981640 1 Processor -- start 2023-12-20T04:24:01.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7de981640 1 -- start start 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7de981640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00039a0 0x7ff7d8147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7de981640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d8140520 0x7ff7d8140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7de981640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7d81dfd20 0x7ff7d81e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7de981640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81475a0 con 0x7ff7d81dfd20 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7de981640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d81e0710 con 0x7ff7c00039a0 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7de981640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d8140ea0 con 0x7ff7d8140520 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7dcf1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7d81dfd20 0x7ff7d81e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7dcf1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7d81dfd20 0x7ff7d81e01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53822/0 (socket says 172.21.15.40:53822) 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7dcf1e640 1 -- 172.21.15.40:0/1812711047 learned_addr learned my addr 172.21.15.40:0/1812711047 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7d7fff640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00039a0 0x7ff7d8147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.770+0000 7ff7d77fe640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d8140520 0x7ff7d8140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7dcf1e640 1 -- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d8140520 msgr2=0x7ff7d8140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7dcf1e640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d8140520 0x7ff7d8140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7dcf1e640 1 -- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00039a0 msgr2=0x7ff7d8147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:01.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7dcf1e640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00039a0 0x7ff7d8147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7dcf1e640 1 -- 172.21.15.40:0/1812711047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d8142960 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7dcf1e640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7d81dfd20 0x7ff7d81e01d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80ba490 tx=0x7ff7d000a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7d4ff9640 1 -- 172.21.15.40:0/1812711047 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000ac60 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7d4ff9640 1 -- 172.21.15.40:0/1812711047 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d000adc0 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d81df820 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7d4ff9640 1 -- 172.21.15.40:0/1812711047 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0013630 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.771+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d81453f0 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.772+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d81dfa40 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.772+0000 7ff7d4ff9640 1 -- 172.21.15.40:0/1812711047 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff7d0013790 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.773+0000 7ff7d4ff9640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff7c406a430 0x7ff7c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.773+0000 7ff7d4ff9640 1 -- 172.21.15.40:0/1812711047 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff7d0088c30 con 0x7ff7d81dfd20 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.773+0000 7ff7d7fff640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff7c406a430 0x7ff7c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:01.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.773+0000 7ff7d7fff640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff7c406a430 0x7ff7c406c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc033000 tx=0x7ff7cc009030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:01.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:01.777+0000 7ff7d4ff9640 1 -- 172.21.15.40:0/1812711047 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff7d81dfa40 con 0x7ff7d81dfd20 2023-12-20T04:24:02.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.018+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff7d81dfa10 con 0x7ff7d81dfd20 2023-12-20T04:24:02.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.021+0000 7ff7d4ff9640 1 -- 172.21.15.40:0/1812711047 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff7d0054570 con 0x7ff7d81dfd20 2023-12-20T04:24:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff7c406a430 msgr2=0x7ff7c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff7c406a430 0x7ff7c406c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc033000 tx=0x7ff7cc009030 comp rx=0 tx=0).stop 2023-12-20T04:24:02.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7d81dfd20 msgr2=0x7ff7d81e01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7d81dfd20 0x7ff7d81e01d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80ba490 tx=0x7ff7d000a6e0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 shutdown_connections 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff7c406a430 0x7ff7c406c8f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7d81dfd20 0x7ff7d81e01d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff7d8140520 0x7ff7d8140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 --2- 172.21.15.40:0/1812711047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7c00039a0 0x7ff7d8147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.023+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 >> 172.21.15.40:0/1812711047 conn(0x7ff7d8071e60 msgr2=0x7ff7d81d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.024+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 shutdown_connections 2023-12-20T04:24:02.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.024+0000 7ff7de981640 1 -- 172.21.15.40:0/1812711047 wait complete. 2023-12-20T04:24:02.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-20T04:24:02.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.141+0000 7f42dd670640 1 Processor -- start 2023-12-20T04:24:02.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.141+0000 7f42dd670640 1 -- start start 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.141+0000 7f42dd670640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d81488c0 0x7f42d8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.141+0000 7f42dd670640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f42d8148d10 0x7f42d8153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42dd670640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d80b80e0 con 0x7f42d80b7d00 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42dd670640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80b44f0 con 0x7f42d81488c0 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42dd670640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d80b5640 con 0x7f42d8148d10 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42cffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d81488c0 0x7f42d8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42cffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d81488c0 0x7f42d8070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53834/0 (socket says 172.21.15.40:53834) 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42cffff640 1 -- 172.21.15.40:0/4221556343 learned_addr learned my addr 172.21.15.40:0/4221556343 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42d77fe640 1 --2- 172.21.15.40:0/4221556343 >> v2:172.21.15.69:3300/0 conn(0x7f42d8148d10 0x7f42d8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42cffff640 1 -- 172.21.15.40:0/4221556343 >> v2:172.21.15.69:3300/0 conn(0x7f42d8148d10 msgr2=0x7f42d8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:02.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42cffff640 1 --2- 172.21.15.40:0/4221556343 >> v2:172.21.15.69:3300/0 conn(0x7f42d8148d10 0x7f42d8153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42cffff640 1 -- 172.21.15.40:0/4221556343 >> v1:172.21.15.69:6789/0 conn(0x7f42d80b7d00 legacy=0x7f42d80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.142+0000 7f42cffff640 1 -- 172.21.15.40:0/4221556343 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d80b5920 con 0x7f42d81488c0 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42cffff640 1 --2- 172.21.15.40:0/4221556343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8070d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42d806eae0 tx=0x7f42c002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cc60df6ca71a9d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42d67fc640 1 -- 172.21.15.40:0/4221556343 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0030860 con 0x7f42d81488c0 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42d67fc640 1 -- 172.21.15.40:0/4221556343 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c00309c0 con 0x7f42d81488c0 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42d67fc640 1 -- 172.21.15.40:0/4221556343 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0030d50 con 0x7f42d81488c0 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42dd670640 1 -- 172.21.15.40:0/4221556343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 msgr2=0x7f42d8070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42dd670640 1 --2- 172.21.15.40:0/4221556343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8070d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42d806eae0 tx=0x7f42c002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42dd670640 1 -- 172.21.15.40:0/4221556343 shutdown_connections 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.143+0000 7f42dd670640 1 --2- 172.21.15.40:0/4221556343 >> v2:172.21.15.69:3300/0 conn(0x7f42d8148d10 0x7f42d8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.144+0000 7f42dd670640 1 --2- 172.21.15.40:0/4221556343 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8070d60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.144+0000 7f42dd670640 1 -- 172.21.15.40:0/4221556343 >> 172.21.15.40:0/4221556343 conn(0x7f42d80bc220 msgr2=0x7f42d80bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.144+0000 7f42dd670640 1 -- 172.21.15.40:0/4221556343 shutdown_connections 2023-12-20T04:24:02.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.144+0000 7f42dd670640 1 -- 172.21.15.40:0/4221556343 wait complete. 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 Processor -- start 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 -- start start 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42d80b7d00 0x7f42d8143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42d8148d10 0x7f42d813abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d80b2480 con 0x7f42d81488c0 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8145710 con 0x7f42d80b7d00 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42dd670640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d8144140 con 0x7f42d8148d10 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53844/0 (socket says 172.21.15.40:53844) 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42cffff640 1 -- 172.21.15.40:0/2529289017 learned_addr learned my addr 172.21.15.40:0/2529289017 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42d6ffd640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42d80b7d00 0x7f42d8143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.145+0000 7f42d77fe640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42d8148d10 0x7f42d813abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cffff640 1 -- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42d8148d10 msgr2=0x7f42d813abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cffff640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42d8148d10 0x7f42d813abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cffff640 1 -- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42d80b7d00 msgr2=0x7f42d8143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cffff640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42d80b7d00 0x7f42d8143c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cffff640 1 -- 172.21.15.40:0/2529289017 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00094d0 con 0x7f42d81488c0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cffff640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8144990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42c002b9e0 tx=0x7f42c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2529289017 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0039d60 con 0x7f42d81488c0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2529289017 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c0043400 con 0x7f42d81488c0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d8146220 con 0x7f42d81488c0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2529289017 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00437b0 con 0x7f42d81488c0 2023-12-20T04:24:02.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.146+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d8145c00 con 0x7f42d81488c0 2023-12-20T04:24:02.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.147+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d804e840 con 0x7f42d81488c0 2023-12-20T04:24:02.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.147+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2529289017 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42c0043910 con 0x7f42d81488c0 2023-12-20T04:24:02.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.148+0000 7f42cf7fe640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f42b806a460 0x7f42b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.148+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2529289017 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f42c003e070 con 0x7f42d81488c0 2023-12-20T04:24:02.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.148+0000 7f42d6ffd640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f42b806a460 0x7f42b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.149+0000 7f42d6ffd640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f42b806a460 0x7f42b806c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42c8000f60 tx=0x7f42c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.152+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2529289017 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f42c00770b0 con 0x7f42d81488c0 2023-12-20T04:24:02.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.393+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f42d81e02f0 con 0x7f42d81488c0 2023-12-20T04:24:02.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.396+0000 7f42cf7fe640 1 -- 172.21.15.40:0/2529289017 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f42c00340a0 con 0x7f42d81488c0 2023-12-20T04:24:02.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f42b806a460 msgr2=0x7f42b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f42b806a460 0x7f42b806c920 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f42c8000f60 tx=0x7f42c8009040 comp rx=0 tx=0).stop 2023-12-20T04:24:02.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 msgr2=0x7f42d8144990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8144990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f42c002b9e0 tx=0x7f42c0004730 comp rx=0 tx=0).stop 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 shutdown_connections 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f42b806a460 0x7f42b806c920 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42d8148d10 0x7f42d813abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d81488c0 0x7f42d8144990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 --2- 172.21.15.40:0/2529289017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42d80b7d00 0x7f42d8143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 >> 172.21.15.40:0/2529289017 conn(0x7f42d80bc220 msgr2=0x7f42d80bc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 shutdown_connections 2023-12-20T04:24:02.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.398+0000 7f42dd670640 1 -- 172.21.15.40:0/2529289017 wait complete. 2023-12-20T04:24:02.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:24:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.516+0000 7f25e1f16640 1 Processor -- start 2023-12-20T04:24:02.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.516+0000 7f25e1f16640 1 -- start start 2023-12-20T04:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.516+0000 7f25e1f16640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0b6690 0x7f25dc144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25e1f16640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25dc144cd0 0x7f25dc155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25e1f16640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25dc0bc6b0 con 0x7f25dc0bcdd0 2023-12-20T04:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25e1f16640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25dc0a59f0 con 0x7f25dc144cd0 2023-12-20T04:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25e1f16640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc0bc0a0 con 0x7f25dc0b6690 2023-12-20T04:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25dbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25dc144cd0 0x7f25dc155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25dbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f25dc144cd0 0x7f25dc155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53846/0 (socket says 172.21.15.40:53846) 2023-12-20T04:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25dbfff640 1 -- 172.21.15.40:0/1669940078 learned_addr learned my addr 172.21.15.40:0/1669940078 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25daffd640 1 --2- 172.21.15.40:0/1669940078 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0b6690 0x7f25dc144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25dbfff640 1 -- 172.21.15.40:0/1669940078 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0b6690 msgr2=0x7f25dc144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25dbfff640 1 --2- 172.21.15.40:0/1669940078 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0b6690 0x7f25dc144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25dbfff640 1 -- 172.21.15.40:0/1669940078 >> v1:172.21.15.69:6789/0 conn(0x7f25dc0bcdd0 legacy=0x7f25dc0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.517+0000 7f25dbfff640 1 -- 172.21.15.40:0/1669940078 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0bc340 con 0x7f25dc144cd0 2023-12-20T04:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25dbfff640 1 --2- 172.21.15.40:0/1669940078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc155340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009e50 tx=0x7f25d402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34adad0c19f4a94 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25da7fc640 1 -- 172.21.15.40:0/1669940078 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d402cb90 con 0x7f25dc144cd0 2023-12-20T04:24:02.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25da7fc640 1 -- 172.21.15.40:0/1669940078 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d402ccf0 con 0x7f25dc144cd0 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25da7fc640 1 -- 172.21.15.40:0/1669940078 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4034610 con 0x7f25dc144cd0 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25e1f16640 1 -- 172.21.15.40:0/1669940078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 msgr2=0x7f25dc155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25e1f16640 1 --2- 172.21.15.40:0/1669940078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc155340 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f25d4009e50 tx=0x7f25d402bff0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25e1f16640 1 -- 172.21.15.40:0/1669940078 shutdown_connections 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25e1f16640 1 --2- 172.21.15.40:0/1669940078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc155340 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25e1f16640 1 --2- 172.21.15.40:0/1669940078 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0b6690 0x7f25dc144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.518+0000 7f25e1f16640 1 -- 172.21.15.40:0/1669940078 >> 172.21.15.40:0/1669940078 conn(0x7f25dc071e60 msgr2=0x7f25dc0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.519+0000 7f25e1f16640 1 -- 172.21.15.40:0/1669940078 shutdown_connections 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.519+0000 7f25e1f16640 1 -- 172.21.15.40:0/1669940078 wait complete. 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.519+0000 7f25e1f16640 1 Processor -- start 2023-12-20T04:24:02.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25e1f16640 1 -- start start 2023-12-20T04:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25e1f16640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25dc0b6690 0x7f25dc14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25e1f16640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0bcdd0 0x7f25dc1453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25e1f16640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25e1f16640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc14b9c0 con 0x7f25dc144cd0 2023-12-20T04:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25e1f16640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc148310 con 0x7f25dc0b6690 2023-12-20T04:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25e1f16640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25dc14b6e0 con 0x7f25dc0bcdd0 2023-12-20T04:24:02.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53854/0 (socket says 172.21.15.40:53854) 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.520+0000 7f25dbfff640 1 -- 172.21.15.40:0/2469513827 learned_addr learned my addr 172.21.15.40:0/2469513827 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25daffd640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0bcdd0 0x7f25dc1453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25db7fe640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25dc0b6690 0x7f25dc14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25dbfff640 1 -- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0bcdd0 msgr2=0x7f25dc1453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25dbfff640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0bcdd0 0x7f25dc1453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25dbfff640 1 -- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25dc0b6690 msgr2=0x7f25dc14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25dbfff640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25dc0b6690 0x7f25dc14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25dbfff640 1 -- 172.21.15.40:0/2469513827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d4009b30 con 0x7f25dc144cd0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25dbfff640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc147c20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f25d4036040 tx=0x7f25d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25c3fff640 1 -- 172.21.15.40:0/2469513827 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4009510 con 0x7f25dc144cd0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25c3fff640 1 -- 172.21.15.40:0/2469513827 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d403e450 con 0x7f25dc144cd0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25c3fff640 1 -- 172.21.15.40:0/2469513827 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d403e800 con 0x7f25dc144cd0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25dc1e3c40 con 0x7f25dc144cd0 2023-12-20T04:24:02.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.521+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25dc14aa10 con 0x7f25dc144cd0 2023-12-20T04:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.522+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25dc14aba0 con 0x7f25dc144cd0 2023-12-20T04:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.523+0000 7f25c3fff640 1 -- 172.21.15.40:0/2469513827 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f25d403e960 con 0x7f25dc144cd0 2023-12-20T04:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.523+0000 7f25c3fff640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f25c806a430 0x7f25c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.523+0000 7f25c3fff640 1 -- 172.21.15.40:0/2469513827 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25d40ab160 con 0x7f25dc144cd0 2023-12-20T04:24:02.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.523+0000 7f25db7fe640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f25c806a430 0x7f25c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.524+0000 7f25db7fe640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f25c806a430 0x7f25c806c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f25cc000f60 tx=0x7f25cc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.527+0000 7f25c3fff640 1 -- 172.21.15.40:0/2469513827 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f25d4076b30 con 0x7f25dc144cd0 2023-12-20T04:24:02.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.707+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25dc149db0 con 0x7f25dc144cd0 2023-12-20T04:24:02.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.708+0000 7f25c3fff640 1 -- 172.21.15.40:0/2469513827 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12341 (secure 0 0 0) 0x7f25dc149db0 con 0x7f25dc144cd0 2023-12-20T04:24:02.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:02.710 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:23:59.754312+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:24:02.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f25c806a430 msgr2=0x7f25c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f25c806a430 0x7f25c806c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f25cc000f60 tx=0x7f25cc009040 comp rx=0 tx=0).stop 2023-12-20T04:24:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 msgr2=0x7f25dc147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc147c20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f25d4036040 tx=0x7f25d4004a40 comp rx=0 tx=0).stop 2023-12-20T04:24:02.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 shutdown_connections 2023-12-20T04:24:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f25c806a430 0x7f25c806c8f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f25dc144cd0 0x7f25dc147c20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f25dc0bcdd0 0x7f25dc1453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 --2- 172.21.15.40:0/2469513827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25dc0b6690 0x7f25dc14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 >> 172.21.15.40:0/2469513827 conn(0x7f25dc071e60 msgr2=0x7f25dc0b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 shutdown_connections 2023-12-20T04:24:02.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.710+0000 7f25e1f16640 1 -- 172.21.15.40:0/2469513827 wait complete. 2023-12-20T04:24:02.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:24:02.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:24:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.831+0000 7f8167df0640 1 Processor -- start 2023-12-20T04:24:02.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f8167df0640 1 -- start start 2023-12-20T04:24:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f8167df0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f81600bb140 0x7f81600be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f8167df0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81600bfa50 con 0x7f81600bf510 2023-12-20T04:24:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f8167df0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816006b040 con 0x7f816006a950 2023-12-20T04:24:02.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f8167df0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81600bbda0 con 0x7f81600bb140 2023-12-20T04:24:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f8165b8c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f81600bb140 0x7f81600be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f816638d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f81600bf510 0x7f8160155500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47862/0 (socket says 172.21.15.40:47862) 2023-12-20T04:24:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.832+0000 7f816638d640 1 -- 172.21.15.40:0/1694644372 learned_addr learned my addr 172.21.15.40:0/1694644372 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.833+0000 7f8165b8c640 1 -- 172.21.15.40:0/1694644372 >> v1:172.21.15.69:6789/0 conn(0x7f816006a950 legacy=0x7f81600bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.833+0000 7f8165b8c640 1 -- 172.21.15.40:0/1694644372 >> v1:172.21.15.40:6789/0 conn(0x7f81600bf510 legacy=0x7f8160155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.833+0000 7f8165b8c640 1 -- 172.21.15.40:0/1694644372 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600bb520 con 0x7f81600bb140 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.833+0000 7f8165b8c640 1 --2- 172.21.15.40:0/1694644372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81600be350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f815c0097a0 tx=0x7f815c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8002624ab8fed7e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.833+0000 7f8164b8a640 1 -- 172.21.15.40:0/1694644372 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c030610 con 0x7f81600bb140 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.833+0000 7f8164b8a640 1 -- 172.21.15.40:0/1694644372 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c030770 con 0x7f81600bb140 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8164b8a640 1 -- 172.21.15.40:0/1694644372 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c030b00 con 0x7f81600bb140 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8167df0640 1 -- 172.21.15.40:0/1694644372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 msgr2=0x7f81600be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8167df0640 1 --2- 172.21.15.40:0/1694644372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81600be350 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f815c0097a0 tx=0x7f815c02b960 comp rx=0 tx=0).stop 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8167df0640 1 -- 172.21.15.40:0/1694644372 shutdown_connections 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8167df0640 1 --2- 172.21.15.40:0/1694644372 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81600be350 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8167df0640 1 -- 172.21.15.40:0/1694644372 >> 172.21.15.40:0/1694644372 conn(0x7f81600bcfd0 msgr2=0x7f81600bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:02.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8167df0640 1 -- 172.21.15.40:0/1694644372 shutdown_connections 2023-12-20T04:24:02.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.834+0000 7f8167df0640 1 -- 172.21.15.40:0/1694644372 wait complete. 2023-12-20T04:24:02.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.835+0000 7f8167df0640 1 Processor -- start 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.835+0000 7f8167df0640 1 -- start start 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8167df0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f816006a950 0x7f8160146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8167df0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81601e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8167df0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81600bf510 0x7f8160143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8167df0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81601472e0 con 0x7f81600bb140 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8167df0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600a06c0 con 0x7f816006a950 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8167df0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81600a2d60 con 0x7f81600bf510 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81601e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81601e3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53874/0 (socket says 172.21.15.40:53874) 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 -- 172.21.15.40:0/954006263 learned_addr learned my addr 172.21.15.40:0/954006263 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8165b8c640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f816006a950 0x7f8160146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816638d640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81600bf510 0x7f8160143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 -- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81600bf510 msgr2=0x7f8160143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81600bf510 0x7f8160143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 -- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f816006a950 msgr2=0x7f8160146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f816006a950 0x7f8160146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 -- 172.21.15.40:0/954006263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c009400 con 0x7f81600bb140 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f8165b8c640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f816006a950 0x7f8160146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f816538b640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81601e3650 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f815000c400 tx=0x7f815000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f81567fc640 1 -- 172.21.15.40:0/954006263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81500052d0 con 0x7f81600bb140 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.836+0000 7f81567fc640 1 -- 172.21.15.40:0/954006263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150005430 con 0x7f81600bb140 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.837+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81600a0910 con 0x7f81600bb140 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.837+0000 7f81567fc640 1 -- 172.21.15.40:0/954006263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150003830 con 0x7f81600bb140 2023-12-20T04:24:02.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.837+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81600a23b0 con 0x7f81600bb140 2023-12-20T04:24:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.838+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81600740a0 con 0x7f81600bb140 2023-12-20T04:24:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.838+0000 7f81567fc640 1 -- 172.21.15.40:0/954006263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8150003990 con 0x7f81600bb140 2023-12-20T04:24:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.838+0000 7f81567fc640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f814406a430 0x7f814406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.839+0000 7f81567fc640 1 -- 172.21.15.40:0/954006263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8150087b60 con 0x7f81600bb140 2023-12-20T04:24:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.839+0000 7f8165b8c640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f814406a430 0x7f814406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:02.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.839+0000 7f8165b8c640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f814406a430 0x7f814406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c03b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:02.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:02.843+0000 7f81567fc640 1 -- 172.21.15.40:0/954006263 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f81500534a0 con 0x7f81600bb140 2023-12-20T04:24:03.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.017+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81600ba4a0 con 0x7f81600bb140 2023-12-20T04:24:03.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.018+0000 7f81567fc640 1 -- 172.21.15.40:0/954006263 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8150017020 con 0x7f81600bb140 2023-12-20T04:24:03.019 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f814406a430 msgr2=0x7f814406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f814406a430 0x7f814406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c03b040 comp rx=0 tx=0).stop 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 msgr2=0x7f81601e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81601e3650 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f815000c400 tx=0x7f815000c8c0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 shutdown_connections 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f814406a430 0x7f814406c8f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f81600bf510 0x7f8160143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81600bb140 0x7f81601e3650 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 --2- 172.21.15.40:0/954006263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f816006a950 0x7f8160146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.019+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 >> 172.21.15.40:0/954006263 conn(0x7f81600bcfd0 msgr2=0x7f81600a3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:03.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.020+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 shutdown_connections 2023-12-20T04:24:03.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.020+0000 7f8167df0640 1 -- 172.21.15.40:0/954006263 wait complete. 2023-12-20T04:24:03.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:24:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.136+0000 7f0ad16f8640 1 Processor -- start 2023-12-20T04:24:03.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.136+0000 7f0ad16f8640 1 -- start start 2023-12-20T04:24:03.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0ad16f8640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 0x7f0acc14aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0ad16f8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc06acb0 con 0x7f0acc06b420 2023-12-20T04:24:03.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0ad16f8640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc071470 con 0x7f0acc0b9ff0 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0ad16f8640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0b8160 con 0x7f0acc0b7d80 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0acb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0acc06b420 0x7f0acc155380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47878/0 (socket says 172.21.15.40:47878) 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0acb7fe640 1 -- 172.21.15.40:0/1775694473 learned_addr learned my addr 172.21.15.40:0/1775694473 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0acaffd640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 0x7f0acc14aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949918737 0 0) 0x7f0acc06acb0 con 0x7f0acc06b420 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.137+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab4003520 con 0x7f0acc06b420 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761169047 0 0) 0x7f0acc071470 con 0x7f0acc0b9ff0 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0acc06acb0 con 0x7f0acc0b9ff0 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739168596 0 0) 0x7f0ab4003520 con 0x7f0acc06b420 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 msgr2=0x7f0acc14aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 0x7f0acc14aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 >> v1:172.21.15.69:6789/0 conn(0x7f0acc0b9ff0 legacy=0x7f0acc070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc0ba4f0 con 0x7f0acc06b420 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f0ac4001970 con 0x7f0acc06b420 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 >> v1:172.21.15.40:6789/0 conn(0x7f0acc06b420 legacy=0x7f0acc155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 0x7f0ab4003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab40040e0 0x7f0ab40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ab4004d00 0x7f0ab4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0b8160 con 0x7f0ab40040e0 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab400bac0 con 0x7f0ab4004d00 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab400bc80 con 0x7f0acc0b7d80 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0aca7fc640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab40040e0 0x7f0ab40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0acaffd640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 0x7f0ab4003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0acb7fe640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ab4004d00 0x7f0ab4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0aca7fc640 1 -- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 msgr2=0x7f0ab4003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0aca7fc640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0acc0b7d80 0x7f0ab4003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0aca7fc640 1 -- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ab4004d00 msgr2=0x7f0ab4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0aca7fc640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ab4004d00 0x7f0ab4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.138+0000 7f0aca7fc640 1 -- 172.21.15.40:0/1775694473 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4003520 con 0x7f0ab40040e0 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.139+0000 7f0aca7fc640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab40040e0 0x7f0ab40047c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00018d0 tx=0x7f0ab40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a40fdf698da7a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.139+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac002f050 con 0x7f0ab40040e0 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.139+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac00052d0 con 0x7f0ab40040e0 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.139+0000 7f0ac9ffb640 1 -- 172.21.15.40:0/1775694473 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0003810 con 0x7f0ab40040e0 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.140+0000 7f0ad16f8640 1 -- 172.21.15.40:0/1775694473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab40040e0 msgr2=0x7f0ab40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.140+0000 7f0ad16f8640 1 --2- 172.21.15.40:0/1775694473 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ab40040e0 0x7f0ab40047c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ac00018d0 tx=0x7f0ab40057f0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.140+0000 7f0acb7fe640 1 -- 172.21.15.40:0/1775694473 reap_dead start 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.140+0000 7f0ad16f8640 1 -- 172.21.15.40:0/1775694473 shutdown_connections 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.140+0000 7f0ad16f8640 1 -- 172.21.15.40:0/1775694473 >> 172.21.15.40:0/1775694473 conn(0x7f0acc0bab20 msgr2=0x7f0acc0baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.140+0000 7f0ad16f8640 1 -- 172.21.15.40:0/1775694473 shutdown_connections 2023-12-20T04:24:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.140+0000 7f0ad16f8640 1 -- 172.21.15.40:0/1775694473 wait complete. 2023-12-20T04:24:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.141+0000 7f0ad16f8640 1 Processor -- start 2023-12-20T04:24:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.141+0000 7f0ad16f8640 1 -- start start 2023-12-20T04:24:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.141+0000 7f0ad16f8640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0ab40040e0 0x7f0acc145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.141+0000 7f0ad16f8640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0acc14eb20 0x7f0acc149b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ad16f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0acc14d4f0 0x7f0acc1e2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ad16f8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc14a070 con 0x7f0acc14d4f0 2023-12-20T04:24:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ad16f8640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc1e00e0 con 0x7f0acc14eb20 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ad16f8640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc1df7b0 con 0x7f0ab40040e0 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0acc14d4f0 0x7f0acc1e2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0acc14d4f0 0x7f0acc1e2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53900/0 (socket says 172.21.15.40:53900) 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 -- 172.21.15.40:0/3892593764 learned_addr learned my addr 172.21.15.40:0/3892593764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0aca7fc640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0acc14eb20 0x7f0acc149b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acaffd640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0ab40040e0 0x7f0acc145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 -- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0ab40040e0 msgr2=0x7f0acc145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0ab40040e0 0x7f0acc145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 -- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0acc14eb20 msgr2=0x7f0acc149b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0acc14eb20 0x7f0acc149b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 -- 172.21.15.40:0/3892593764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc1dfa90 con 0x7f0acc14d4f0 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0aca7fc640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0acc14eb20 0x7f0acc149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:24:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0acb7fe640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0acc14d4f0 0x7f0acc1e2c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0acc1485f0 tx=0x7f0ac4007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ab37fe640 1 -- 172.21.15.40:0/3892593764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400fa30 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ab37fe640 1 -- 172.21.15.40:0/3892593764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac400fb90 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ab37fe640 1 -- 172.21.15.40:0/3892593764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac40133f0 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc1dfd70 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.142+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc14a7e0 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.143+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc06bf00 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.144+0000 7f0ab37fe640 1 -- 172.21.15.40:0/3892593764 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ac4013550 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.144+0000 7f0ab37fe640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0ab806a430 0x7f0ab806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.144+0000 7f0ab37fe640 1 -- 172.21.15.40:0/3892593764 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ac40887b0 con 0x7f0acc14d4f0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.144+0000 7f0acaffd640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0ab806a430 0x7f0ab806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.145+0000 7f0acaffd640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0ab806a430 0x7f0ab806c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009ae0 tx=0x7f0abc009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:03.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.148+0000 7f0ab37fe640 1 -- 172.21.15.40:0/3892593764 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0ac40540f0 con 0x7f0acc14d4f0 2023-12-20T04:24:03.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.327+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0acc1e0270 con 0x7f0acc14d4f0 2023-12-20T04:24:03.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.327+0000 7f0ab37fe640 1 -- 172.21.15.40:0/3892593764 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0ac4057710 con 0x7f0acc14d4f0 2023-12-20T04:24:03.329 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:03.329 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-12-20T04:24:03.329 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-12-20T04:24:03.329 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-12-20T04:24:03.330 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-12-20T04:24:03.330 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-12-20T04:24:03.330 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-12-20T04:24:03.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0ab806a430 msgr2=0x7f0ab806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0ab806a430 0x7f0ab806c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009ae0 tx=0x7f0abc009190 comp rx=0 tx=0).stop 2023-12-20T04:24:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0acc14d4f0 msgr2=0x7f0acc1e2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0acc14d4f0 0x7f0acc1e2c10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0acc1485f0 tx=0x7f0ac4007b10 comp rx=0 tx=0).stop 2023-12-20T04:24:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 shutdown_connections 2023-12-20T04:24:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0ab806a430 0x7f0ab806c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0acc14d4f0 0x7f0acc1e2c10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0acc14eb20 0x7f0acc149b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 --2- 172.21.15.40:0/3892593764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0ab40040e0 0x7f0acc145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 >> 172.21.15.40:0/3892593764 conn(0x7f0acc0bab20 msgr2=0x7f0acc0bd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:03.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 shutdown_connections 2023-12-20T04:24:03.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.329+0000 7f0ad16f8640 1 -- 172.21.15.40:0/3892593764 wait complete. 2023-12-20T04:24:03.341 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:24:03.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:24:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.450+0000 7f791115c640 1 Processor -- start 2023-12-20T04:24:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.450+0000 7f791115c640 1 -- start start 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f791115c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c145160 0x7f790c0b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f791115c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c0b9030 con 0x7f790c14ac60 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f791115c640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790c06b3c0 con 0x7f790c0ba670 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f791115c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0b9ce0 con 0x7f790c145160 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f790b59e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f790c14ac60 0x7f790c1554f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47888/0 (socket says 172.21.15.40:47888) 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f790b59e640 1 -- 172.21.15.40:0/2184350455 learned_addr learned my addr 172.21.15.40:0/2184350455 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f790ad9d640 1 --2- 172.21.15.40:0/2184350455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c145160 0x7f790c0b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901674941 0 0) 0x7f790c0b9030 con 0x7f790c14ac60 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.451+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f4003520 con 0x7f790c14ac60 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.452+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629687428 0 0) 0x7f790c06b3c0 con 0x7f790c0ba670 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.452+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f790c0b9030 con 0x7f790c0ba670 2023-12-20T04:24:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.452+0000 7f790ad9d640 1 -- 172.21.15.40:0/2184350455 >> v1:172.21.15.69:6789/0 conn(0x7f790c0ba670 legacy=0x7f790c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.452+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2482466948 0 0) 0x7f78f4003520 con 0x7f790c14ac60 2023-12-20T04:24:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.452+0000 7f790ad9d640 1 -- 172.21.15.40:0/2184350455 >> v1:172.21.15.40:6789/0 conn(0x7f790c14ac60 legacy=0x7f790c1554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.452+0000 7f790ad9d640 1 -- 172.21.15.40:0/2184350455 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0baad0 con 0x7f790c145160 2023-12-20T04:24:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.452+0000 7f790ad9d640 1 --2- 172.21.15.40:0/2184350455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c145160 0x7f790c0b97a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79040097d0 tx=0x7f790402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f2e9664fa6ee27c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0019f0 con 0x7f790c145160 2023-12-20T04:24:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790402e050 con 0x7f790c145160 2023-12-20T04:24:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f7909d9b640 1 -- 172.21.15.40:0/2184350455 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7904030730 con 0x7f790c145160 2023-12-20T04:24:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f791115c640 1 -- 172.21.15.40:0/2184350455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c145160 msgr2=0x7f790c0b97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f791115c640 1 --2- 172.21.15.40:0/2184350455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c145160 0x7f790c0b97a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f79040097d0 tx=0x7f790402b770 comp rx=0 tx=0).stop 2023-12-20T04:24:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f791115c640 1 -- 172.21.15.40:0/2184350455 shutdown_connections 2023-12-20T04:24:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f791115c640 1 --2- 172.21.15.40:0/2184350455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c145160 0x7f790c0b97a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f791115c640 1 -- 172.21.15.40:0/2184350455 >> 172.21.15.40:0/2184350455 conn(0x7f790c0be0c0 msgr2=0x7f790c0be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f791115c640 1 -- 172.21.15.40:0/2184350455 shutdown_connections 2023-12-20T04:24:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.453+0000 7f791115c640 1 -- 172.21.15.40:0/2184350455 wait complete. 2023-12-20T04:24:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 Processor -- start 2023-12-20T04:24:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 -- start start 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f790c0ba670 0x7f790c142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f790c145160 0x7f790c147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c14ac60 0x7f790c140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c142d60 con 0x7f790c145160 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0b7ba0 con 0x7f790c0ba670 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f791115c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790c0b7510 con 0x7f790c14ac60 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f790a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f790c145160 0x7f790c147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f790a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f790c145160 0x7f790c147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53912/0 (socket says 172.21.15.40:53912) 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.455+0000 7f790a59c640 1 -- 172.21.15.40:0/3776710601 learned_addr learned my addr 172.21.15.40:0/3776710601 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790ad9d640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f790c0ba670 0x7f790c142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790b59e640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c14ac60 0x7f790c140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790a59c640 1 -- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c14ac60 msgr2=0x7f790c140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790a59c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c14ac60 0x7f790c140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790a59c640 1 -- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f790c0ba670 msgr2=0x7f790c142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790a59c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f790c0ba670 0x7f790c142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790a59c640 1 -- 172.21.15.40:0/3776710601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904009400 con 0x7f790c145160 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790b59e640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c14ac60 0x7f790c140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f790a59c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f790c145160 0x7f790c147560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f790000c4c0 tx=0x7f790000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f78f37fe640 1 -- 172.21.15.40:0/3776710601 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000052d0 con 0x7f790c145160 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f78f37fe640 1 -- 172.21.15.40:0/3776710601 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900005430 con 0x7f790c145160 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c0b6640 con 0x7f790c145160 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f78f37fe640 1 -- 172.21.15.40:0/3776710601 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900012870 con 0x7f790c145160 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.456+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790c0b7780 con 0x7f790c145160 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.457+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f790c06cbd0 con 0x7f790c145160 2023-12-20T04:24:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.457+0000 7f78f37fe640 1 -- 172.21.15.40:0/3776710601 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f79000129d0 con 0x7f790c145160 2023-12-20T04:24:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.458+0000 7f78f37fe640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f78f806a430 0x7f78f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.458+0000 7f78f37fe640 1 -- 172.21.15.40:0/3776710601 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7900088020 con 0x7f790c145160 2023-12-20T04:24:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.458+0000 7f790ad9d640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f78f806a430 0x7f78f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.459+0000 7f790ad9d640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f78f806a430 0x7f78f806c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7904034000 tx=0x7f7904008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:03.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.462+0000 7f78f37fe640 1 -- 172.21.15.40:0/3776710601 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f79000539f0 con 0x7f790c145160 2023-12-20T04:24:03.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:03.642+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f790c04e840 con 0x7f790c145160 2023-12-20T04:24:04.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.551+0000 7f78f37fe640 1 -- 172.21.15.40:0/3776710601 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7900057010 con 0x7f790c145160 2023-12-20T04:24:04.552 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f78f806a430 msgr2=0x7f78f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f78f806a430 0x7f78f806c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7904034000 tx=0x7f7904008030 comp rx=0 tx=0).stop 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f790c145160 msgr2=0x7f790c147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f790c145160 0x7f790c147560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f790000c4c0 tx=0x7f790000c980 comp rx=0 tx=0).stop 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 shutdown_connections 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f78f806a430 0x7f78f806c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f790c14ac60 0x7f790c140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f790c145160 0x7f790c147560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 --2- 172.21.15.40:0/3776710601 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f790c0ba670 0x7f790c142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 >> 172.21.15.40:0/3776710601 conn(0x7f790c0be0c0 msgr2=0x7f790c143960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 shutdown_connections 2023-12-20T04:24:04.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.558+0000 7f791115c640 1 -- 172.21.15.40:0/3776710601 wait complete. 2023-12-20T04:24:04.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:24:04.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.690+0000 7feaede73640 1 Processor -- start 2023-12-20T04:24:04.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.690+0000 7feaede73640 1 -- start start 2023-12-20T04:24:04.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.691+0000 7feaede73640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7feae814c430 0x7feae814c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:04.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.691+0000 7feaede73640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80659b0 con 0x7feae80702c0 2023-12-20T04:24:04.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.691+0000 7feaede73640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae8071710 con 0x7feae806fee0 2023-12-20T04:24:04.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.691+0000 7feaede73640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae8072090 con 0x7feae814c430 2023-12-20T04:24:04.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.691+0000 7feae6ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feae80702c0 0x7feae814b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47904/0 (socket says 172.21.15.40:47904) 2023-12-20T04:24:04.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.691+0000 7feae6ffd640 1 -- 172.21.15.40:0/1075462669 learned_addr learned my addr 172.21.15.40:0/1075462669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:04.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.691+0000 7feae7fff640 1 --2- 172.21.15.40:0/1075462669 >> v2:172.21.15.69:3300/0 conn(0x7feae814c430 0x7feae814c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.692+0000 7feae67fc640 1 -- 172.21.15.40:0/1075462669 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421611886 0 0) 0x7feae80659b0 con 0x7feae80702c0 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.692+0000 7feae67fc640 1 -- 172.21.15.40:0/1075462669 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead0003520 con 0x7feae80702c0 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.692+0000 7feae7fff640 1 -- 172.21.15.40:0/1075462669 >> v1:172.21.15.69:6789/0 conn(0x7feae806fee0 legacy=0x7feae8070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.692+0000 7feae67fc640 1 -- 172.21.15.40:0/1075462669 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3669345258 0 0) 0x7fead0003520 con 0x7feae80702c0 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.692+0000 7feae7fff640 1 -- 172.21.15.40:0/1075462669 >> v1:172.21.15.40:6789/0 conn(0x7feae80702c0 legacy=0x7feae814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.692+0000 7feae7fff640 1 -- 172.21.15.40:0/1075462669 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8071cb0 con 0x7feae814c430 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feae7fff640 1 --2- 172.21.15.40:0/1075462669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 0x7feae814c840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae002bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5cf2d2ad23adf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feae67fc640 1 -- 172.21.15.40:0/1075462669 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc001670 con 0x7feae814c430 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feae67fc640 1 -- 172.21.15.40:0/1075462669 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae002c820 con 0x7feae814c430 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feae67fc640 1 -- 172.21.15.40:0/1075462669 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae002cbb0 con 0x7feae814c430 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feaede73640 1 -- 172.21.15.40:0/1075462669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 msgr2=0x7feae814c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feaede73640 1 --2- 172.21.15.40:0/1075462669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 0x7feae814c840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae002bcf0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feaede73640 1 -- 172.21.15.40:0/1075462669 shutdown_connections 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feaede73640 1 --2- 172.21.15.40:0/1075462669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 0x7feae814c840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feaede73640 1 -- 172.21.15.40:0/1075462669 >> 172.21.15.40:0/1075462669 conn(0x7feae806cd10 msgr2=0x7feae8069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feaede73640 1 -- 172.21.15.40:0/1075462669 shutdown_connections 2023-12-20T04:24:04.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.693+0000 7feaede73640 1 -- 172.21.15.40:0/1075462669 wait complete. 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.694+0000 7feaede73640 1 Processor -- start 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feaede73640 1 -- start start 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feaede73640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae806fee0 0x7feae81e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feaede73640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feae80702c0 0x7feae80a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feaede73640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 0x7feae80a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feaede73640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80a24e0 con 0x7feae806fee0 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feaede73640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80a27c0 con 0x7feae814c430 2023-12-20T04:24:04.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feaede73640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae809ff80 con 0x7feae80702c0 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feae77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae806fee0 0x7feae81e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feae77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae806fee0 0x7feae81e3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53928/0 (socket says 172.21.15.40:53928) 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feae77fe640 1 -- 172.21.15.40:0/2228043694 learned_addr learned my addr 172.21.15.40:0/2228043694 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feae7fff640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 0x7feae80a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.695+0000 7feae6ffd640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feae80702c0 0x7feae80a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feae77fe640 1 -- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feae80702c0 msgr2=0x7feae80a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feae77fe640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feae80702c0 0x7feae80a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feae77fe640 1 -- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 msgr2=0x7feae80a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feae77fe640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 0x7feae80a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feae77fe640 1 -- 172.21.15.40:0/2228043694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0009a70 con 0x7feae806fee0 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feae77fe640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae806fee0 0x7feae81e3ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fead800c400 tx=0x7fead800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:04.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feacffff640 1 -- 172.21.15.40:0/2228043694 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead80052d0 con 0x7feae806fee0 2023-12-20T04:24:04.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feacffff640 1 -- 172.21.15.40:0/2228043694 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead8005430 con 0x7feae806fee0 2023-12-20T04:24:04.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae80a0260 con 0x7feae806fee0 2023-12-20T04:24:04.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feacffff640 1 -- 172.21.15.40:0/2228043694 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead8003830 con 0x7feae806fee0 2023-12-20T04:24:04.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.696+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae80a2140 con 0x7feae806fee0 2023-12-20T04:24:04.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.697+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae80a0480 con 0x7feae806fee0 2023-12-20T04:24:04.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.698+0000 7feacffff640 1 -- 172.21.15.40:0/2228043694 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fead8003990 con 0x7feae806fee0 2023-12-20T04:24:04.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.698+0000 7feacffff640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fead406a430 0x7fead406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.698+0000 7feacffff640 1 -- 172.21.15.40:0/2228043694 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fead8087cc0 con 0x7feae806fee0 2023-12-20T04:24:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.698+0000 7feae6ffd640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fead406a430 0x7fead406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:04.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.699+0000 7feae6ffd640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fead406a430 0x7fead406c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feae809dbb0 tx=0x7feadc001e00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:04.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.703+0000 7feacffff640 1 -- 172.21.15.40:0/2228043694 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fead80534b0 con 0x7feae806fee0 2023-12-20T04:24:04.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:04.879+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feae80a2620 con 0x7feae806fee0 2023-12-20T04:24:05.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.558+0000 7feacffff640 1 -- 172.21.15.40:0/2228043694 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7feae80a2620 con 0x7feae806fee0 2023-12-20T04:24:05.560 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fead406a430 msgr2=0x7fead406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fead406a430 0x7fead406c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feae809dbb0 tx=0x7feadc001e00 comp rx=0 tx=0).stop 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae806fee0 msgr2=0x7feae81e3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae806fee0 0x7feae81e3ca0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fead800c400 tx=0x7fead800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 shutdown_connections 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fead406a430 0x7fead406c8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feae814c430 0x7feae80a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7feae80702c0 0x7feae80a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 --2- 172.21.15.40:0/2228043694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feae806fee0 0x7feae81e3ca0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.566+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 >> 172.21.15.40:0/2228043694 conn(0x7feae806cd10 msgr2=0x7feae809c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:05.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.569+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 shutdown_connections 2023-12-20T04:24:05.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.569+0000 7feaede73640 1 -- 172.21.15.40:0/2228043694 wait complete. 2023-12-20T04:24:05.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:24:05.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.701+0000 7f394428f640 1 Processor -- start 2023-12-20T04:24:05.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.701+0000 7f394428f640 1 -- start start 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.702+0000 7f394428f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c06acb0 0x7f393c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.702+0000 7f394428f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c06b1d0 con 0x7f393c0ba6e0 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.702+0000 7f394428f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c14e210 con 0x7f393c0bab40 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.702+0000 7f394428f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c14e5f0 con 0x7f393c06acb0 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.702+0000 7f394182a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f393c0ba6e0 0x7f393c153460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43038/0 (socket says 172.21.15.40:43038) 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.702+0000 7f394182a640 1 -- 172.21.15.40:0/1681501455 learned_addr learned my addr 172.21.15.40:0/1681501455 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.702+0000 7f394282c640 1 --2- 172.21.15.40:0/1681501455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c06acb0 0x7f393c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.703+0000 7f3941029640 1 -- 172.21.15.40:0/1681501455 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472051673 0 0) 0x7f393c06b1d0 con 0x7f393c0ba6e0 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.703+0000 7f3941029640 1 -- 172.21.15.40:0/1681501455 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3928003520 con 0x7f393c0ba6e0 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.703+0000 7f3941029640 1 -- 172.21.15.40:0/1681501455 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459417358 0 0) 0x7f393c14e210 con 0x7f393c0bab40 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.703+0000 7f3941029640 1 -- 172.21.15.40:0/1681501455 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f393c06b1d0 con 0x7f393c0bab40 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.703+0000 7f394282c640 1 -- 172.21.15.40:0/1681501455 >> v1:172.21.15.69:6789/0 conn(0x7f393c0bab40 legacy=0x7f393c14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.703+0000 7f394282c640 1 -- 172.21.15.40:0/1681501455 >> v1:172.21.15.40:6789/0 conn(0x7f393c0ba6e0 legacy=0x7f393c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.703+0000 7f394282c640 1 -- 172.21.15.40:0/1681501455 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c06b4b0 con 0x7f393c06acb0 2023-12-20T04:24:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f394282c640 1 --2- 172.21.15.40:0/1681501455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c06acb0 0x7f393c156b90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3934009dc0 tx=0x7f393402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda48ae204a5a1a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f3941029640 1 -- 172.21.15.40:0/1681501455 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393402cc40 con 0x7f393c06acb0 2023-12-20T04:24:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f3941029640 1 -- 172.21.15.40:0/1681501455 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393402cda0 con 0x7f393c06acb0 2023-12-20T04:24:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f3941029640 1 -- 172.21.15.40:0/1681501455 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934034640 con 0x7f393c06acb0 2023-12-20T04:24:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f394428f640 1 -- 172.21.15.40:0/1681501455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c06acb0 msgr2=0x7f393c156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f394428f640 1 --2- 172.21.15.40:0/1681501455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c06acb0 0x7f393c156b90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3934009dc0 tx=0x7f393402be90 comp rx=0 tx=0).stop 2023-12-20T04:24:05.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f394428f640 1 -- 172.21.15.40:0/1681501455 shutdown_connections 2023-12-20T04:24:05.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f394428f640 1 --2- 172.21.15.40:0/1681501455 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c06acb0 0x7f393c156b90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f394428f640 1 -- 172.21.15.40:0/1681501455 >> 172.21.15.40:0/1681501455 conn(0x7f393c0be0c0 msgr2=0x7f393c0be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:05.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.704+0000 7f394428f640 1 -- 172.21.15.40:0/1681501455 shutdown_connections 2023-12-20T04:24:05.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.705+0000 7f394428f640 1 -- 172.21.15.40:0/1681501455 wait complete. 2023-12-20T04:24:05.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 Processor -- start 2023-12-20T04:24:05.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 -- start start 2023-12-20T04:24:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f393c06acb0 0x7f393c0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f393c0ba6e0 0x7f393c1dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c0bab40 0x7f393c1d7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0b6ac0 con 0x7f393c06acb0 2023-12-20T04:24:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c146b60 con 0x7f393c0ba6e0 2023-12-20T04:24:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394428f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0b7c80 con 0x7f393c0bab40 2023-12-20T04:24:05.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394202b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f393c06acb0 0x7f393c0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394202b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f393c06acb0 0x7f393c0b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53064/0 (socket says 172.21.15.40:53064) 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394202b640 1 -- 172.21.15.40:0/1196622150 learned_addr learned my addr 172.21.15.40:0/1196622150 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394282c640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c0bab40 0x7f393c1d7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.706+0000 7f394182a640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f393c0ba6e0 0x7f393c1dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394202b640 1 -- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c0bab40 msgr2=0x7f393c1d7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394202b640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c0bab40 0x7f393c1d7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394202b640 1 -- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f393c0ba6e0 msgr2=0x7f393c1dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394202b640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f393c0ba6e0 0x7f393c1dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394202b640 1 -- 172.21.15.40:0/1196622150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934009a70 con 0x7f393c06acb0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394202b640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f393c06acb0 0x7f393c0b6580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f393800c490 tx=0x7f393800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f3932ffd640 1 -- 172.21.15.40:0/1196622150 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380052d0 con 0x7f393c06acb0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f3932ffd640 1 -- 172.21.15.40:0/1196622150 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938005450 con 0x7f393c06acb0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c14bb00 con 0x7f393c06acb0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f3932ffd640 1 -- 172.21.15.40:0/1196622150 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938003830 con 0x7f393c06acb0 2023-12-20T04:24:05.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.707+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c0b5fb0 con 0x7f393c06acb0 2023-12-20T04:24:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.708+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c066bf0 con 0x7f393c06acb0 2023-12-20T04:24:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.709+0000 7f3932ffd640 1 -- 172.21.15.40:0/1196622150 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3938003990 con 0x7f393c06acb0 2023-12-20T04:24:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.709+0000 7f3932ffd640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f392006a430 0x7f392006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.709+0000 7f3932ffd640 1 -- 172.21.15.40:0/1196622150 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3938087de0 con 0x7f393c06acb0 2023-12-20T04:24:05.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.709+0000 7f394182a640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f392006a430 0x7f392006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:05.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.710+0000 7f394182a640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f392006a430 0x7f392006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f393c0b5390 tx=0x7f392c007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:05.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.714+0000 7f3932ffd640 1 -- 172.21.15.40:0/1196622150 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f39380534e0 con 0x7f393c06acb0 2023-12-20T04:24:05.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.926+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f393c0740a0 con 0x7f393c06acb0 2023-12-20T04:24:05.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.931+0000 7f3932ffd640 1 -- 172.21.15.40:0/1196622150 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3938056b00 con 0x7f393c06acb0 2023-12-20T04:24:05.932 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 4 and data pool 5 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.937+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f392006a430 msgr2=0x7f392006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.937+0000 7f394428f640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f392006a430 0x7f392006c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f393c0b5390 tx=0x7f392c007d30 comp rx=0 tx=0).stop 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.937+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f393c06acb0 msgr2=0x7f393c0b6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.937+0000 7f394428f640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f393c06acb0 0x7f393c0b6580 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f393800c490 tx=0x7f393800c950 comp rx=0 tx=0).stop 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.938+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 shutdown_connections 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.938+0000 7f394428f640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f392006a430 0x7f392006c8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.938+0000 7f394428f640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f393c0bab40 0x7f393c1d7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.938+0000 7f394428f640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f393c0ba6e0 0x7f393c1dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.938+0000 7f394428f640 1 --2- 172.21.15.40:0/1196622150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f393c06acb0 0x7f393c0b6580 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f393800c490 tx=0x7f393800c950 comp rx=0 tx=0).stop 2023-12-20T04:24:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.938+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 >> 172.21.15.40:0/1196622150 conn(0x7f393c0be0c0 msgr2=0x7f393c0bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.940+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 shutdown_connections 2023-12-20T04:24:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:05.941+0000 7f394428f640 1 -- 172.21.15.40:0/1196622150 wait complete. 2023-12-20T04:24:05.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:24:06.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.068+0000 7f7b1a612640 1 Processor -- start 2023-12-20T04:24:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.068+0000 7f7b1a612640 1 -- start start 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.068+0000 7f7b1a612640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7b140b6690 0x7f7b14144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.068+0000 7f7b1a612640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b14144cd0 0x7f7b14155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.068+0000 7f7b1a612640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b140bc6b0 con 0x7f7b140bcdd0 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.068+0000 7f7b1a612640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b140a59f0 con 0x7f7b140b6690 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.068+0000 7f7b1a612640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b140bc0a0 con 0x7f7b14144cd0 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b18baf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b14144cd0 0x7f7b14155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b137fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7b140b6690 0x7f7b14144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b18baf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b14144cd0 0x7f7b14155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:60760/0 (socket says 172.21.15.40:60760) 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b137fe640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7b140b6690 0x7f7b14144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.40:33702/0 (socket says 172.21.15.40:33702) 2023-12-20T04:24:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b18baf640 1 -- 172.21.15.40:0/748948829 learned_addr learned my addr 172.21.15.40:0/748948829 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b13fff640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7b140bcdd0 0x7f7b140b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.40:56234/0 (socket says 172.21.15.40:56234) 2023-12-20T04:24:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b18baf640 1 -- 172.21.15.40:0/748948829 >> v2:172.21.15.69:3300/0 conn(0x7f7b140b6690 msgr2=0x7f7b14144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b18baf640 1 --2- 172.21.15.40:0/748948829 >> v2:172.21.15.69:3300/0 conn(0x7f7b140b6690 0x7f7b14144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b18baf640 1 -- 172.21.15.40:0/748948829 >> v1:172.21.15.69:6789/0 conn(0x7f7b140bcdd0 legacy=0x7f7b140b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.069+0000 7f7b18baf640 1 -- 172.21.15.40:0/748948829 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b140bc340 con 0x7f7b14144cd0 2023-12-20T04:24:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b18baf640 1 --2- 172.21.15.40:0/748948829 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b14144cd0 0x7f7b14155340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009e50 tx=0x7f7b0c02bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23eb0ea02a6ec264 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b12ffd640 1 -- 172.21.15.40:0/748948829 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c02cb90 con 0x7f7b14144cd0 2023-12-20T04:24:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b12ffd640 1 -- 172.21.15.40:0/748948829 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0c02ccf0 con 0x7f7b14144cd0 2023-12-20T04:24:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b12ffd640 1 -- 172.21.15.40:0/748948829 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c034610 con 0x7f7b14144cd0 2023-12-20T04:24:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b1a612640 1 -- 172.21.15.40:0/748948829 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b14144cd0 msgr2=0x7f7b14155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b1a612640 1 --2- 172.21.15.40:0/748948829 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b14144cd0 0x7f7b14155340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009e50 tx=0x7f7b0c02bff0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b1a612640 1 -- 172.21.15.40:0/748948829 shutdown_connections 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b1a612640 1 --2- 172.21.15.40:0/748948829 >> v2:172.21.15.69:3300/0 conn(0x7f7b140b6690 0x7f7b14144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b1a612640 1 --2- 172.21.15.40:0/748948829 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b14144cd0 0x7f7b14155340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.070+0000 7f7b1a612640 1 -- 172.21.15.40:0/748948829 >> 172.21.15.40:0/748948829 conn(0x7f7b14071e60 msgr2=0x7f7b140c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.071+0000 7f7b1a612640 1 -- 172.21.15.40:0/748948829 shutdown_connections 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.071+0000 7f7b1a612640 1 -- 172.21.15.40:0/748948829 wait complete. 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.071+0000 7f7b1a612640 1 Processor -- start 2023-12-20T04:24:06.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b1a612640 1 -- start start 2023-12-20T04:24:06.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b1a612640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140b6690 0x7f7b14149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b1a612640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b140bcdd0 0x7f7b1414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b1a612640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b14144cd0 0x7f7b14147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b1a612640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b141496a0 con 0x7f7b140b6690 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b1a612640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14147a50 con 0x7f7b14144cd0 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b1a612640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b141d7960 con 0x7f7b140bcdd0 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b13fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140b6690 0x7f7b14149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b13fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140b6690 0x7f7b14149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53078/0 (socket says 172.21.15.40:53078) 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b13fff640 1 -- 172.21.15.40:0/2002484064 learned_addr learned my addr 172.21.15.40:0/2002484064 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b18baf640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b14144cd0 0x7f7b14147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.072+0000 7f7b137fe640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b140bcdd0 0x7f7b1414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b137fe640 1 -- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b14144cd0 msgr2=0x7f7b14147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b137fe640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b14144cd0 0x7f7b14147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b137fe640 1 -- 172.21.15.40:0/2002484064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140b6690 msgr2=0x7f7b14149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b137fe640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140b6690 0x7f7b14149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b137fe640 1 -- 172.21.15.40:0/2002484064 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0c009b30 con 0x7f7b140bcdd0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b13fff640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140b6690 0x7f7b14149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b137fe640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b140bcdd0 0x7f7b1414a470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800e870 tx=0x7f7b0800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b10ff9640 1 -- 172.21.15.40:0/2002484064 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08009410 con 0x7f7b140bcdd0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b10ff9640 1 -- 172.21.15.40:0/2002484064 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b08009e40 con 0x7f7b140bcdd0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1414ae30 con 0x7f7b140bcdd0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b10ff9640 1 -- 172.21.15.40:0/2002484064 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0800cb80 con 0x7f7b140bcdd0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.073+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b14149ca0 con 0x7f7b140bcdd0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.074+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b141d77c0 con 0x7f7b140bcdd0 2023-12-20T04:24:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.075+0000 7f7b10ff9640 1 -- 172.21.15.40:0/2002484064 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b08013470 con 0x7f7b140bcdd0 2023-12-20T04:24:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.075+0000 7f7b10ff9640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7b0006a430 0x7f7b0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.075+0000 7f7b10ff9640 1 -- 172.21.15.40:0/2002484064 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b08088540 con 0x7f7b140bcdd0 2023-12-20T04:24:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.075+0000 7f7b13fff640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7b0006a430 0x7f7b0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.076+0000 7f7b13fff640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7b0006a430 0x7f7b0006c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f60 tx=0x7f7b04007f00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.080+0000 7f7b10ff9640 1 -- 172.21.15.40:0/2002484064 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7b141d77c0 con 0x7f7b140bcdd0 2023-12-20T04:24:06.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.257+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b141d77c0 con 0x7f7b140bcdd0 2023-12-20T04:24:06.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.258+0000 7f7b10ff9640 1 -- 172.21.15.40:0/2002484064 <== mon.2 v2:172.21.15.69:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16066 (secure 0 0 0) 0x7f7b141d77c0 con 0x7f7b140bcdd0 2023-12-20T04:24:06.259 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:06.259 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:24:05.927567+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:24:03.672943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:24:04.910865+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:24:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7b0006a430 msgr2=0x7f7b0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7b0006a430 0x7f7b0006c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f60 tx=0x7f7b04007f00 comp rx=0 tx=0).stop 2023-12-20T04:24:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b140bcdd0 msgr2=0x7f7b1414a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b140bcdd0 0x7f7b1414a470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800e870 tx=0x7f7b0800ed30 comp rx=0 tx=0).stop 2023-12-20T04:24:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 shutdown_connections 2023-12-20T04:24:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7b0006a430 0x7f7b0006c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b14144cd0 0x7f7b14147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7b140bcdd0 0x7f7b1414a470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 --2- 172.21.15.40:0/2002484064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b140b6690 0x7f7b14149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 >> 172.21.15.40:0/2002484064 conn(0x7f7b14071e60 msgr2=0x7f7b140b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 shutdown_connections 2023-12-20T04:24:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.260+0000 7f7b1a612640 1 -- 172.21.15.40:0/2002484064 wait complete. 2023-12-20T04:24:06.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:24:06.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.376+0000 7fa338477640 1 Processor -- start 2023-12-20T04:24:06.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.376+0000 7fa338477640 1 -- start start 2023-12-20T04:24:06.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa338477640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa330144ea0 0x7fa330156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa338477640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300bc6b0 con 0x7fa3300bcdd0 2023-12-20T04:24:06.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa338477640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300a59f0 con 0x7fa3300b6690 2023-12-20T04:24:06.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa338477640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300bc0a0 con 0x7fa330144ea0 2023-12-20T04:24:06.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa336213640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa3300bcdd0 0x7fa3300b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43048/0 (socket says 172.21.15.40:43048) 2023-12-20T04:24:06.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa336213640 1 -- 172.21.15.40:0/3738657037 learned_addr learned my addr 172.21.15.40:0/3738657037 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:06.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa336a14640 1 --2- 172.21.15.40:0/3738657037 >> v2:172.21.15.40:3300/0 conn(0x7fa330144ea0 0x7fa330156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa336a14640 1 -- 172.21.15.40:0/3738657037 >> v1:172.21.15.69:6789/0 conn(0x7fa3300b6690 legacy=0x7fa330144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa336a14640 1 -- 172.21.15.40:0/3738657037 >> v1:172.21.15.40:6789/0 conn(0x7fa3300bcdd0 legacy=0x7fa3300b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa335211640 1 -- 172.21.15.40:0/3738657037 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294766817 0 0) 0x7fa3300bc6b0 con 0x7fa3300bcdd0 2023-12-20T04:24:06.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.377+0000 7fa336a14640 1 -- 172.21.15.40:0/3738657037 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300bc340 con 0x7fa330144ea0 2023-12-20T04:24:06.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.378+0000 7fa336a14640 1 --2- 172.21.15.40:0/3738657037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa330144ea0 0x7fa330156350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa3300a5b80 tx=0x7fa32802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2dbd6a59266772d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.378+0000 7fa335211640 1 -- 172.21.15.40:0/3738657037 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32802cd80 con 0x7fa330144ea0 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.378+0000 7fa335211640 1 -- 172.21.15.40:0/3738657037 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328034440 con 0x7fa330144ea0 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.378+0000 7fa335211640 1 -- 172.21.15.40:0/3738657037 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280347d0 con 0x7fa330144ea0 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.379+0000 7fa338477640 1 -- 172.21.15.40:0/3738657037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa330144ea0 msgr2=0x7fa330156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.379+0000 7fa338477640 1 --2- 172.21.15.40:0/3738657037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa330144ea0 0x7fa330156350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa3300a5b80 tx=0x7fa32802bfd0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.379+0000 7fa338477640 1 -- 172.21.15.40:0/3738657037 shutdown_connections 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.379+0000 7fa338477640 1 --2- 172.21.15.40:0/3738657037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa330144ea0 0x7fa330156350 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.379+0000 7fa338477640 1 -- 172.21.15.40:0/3738657037 >> 172.21.15.40:0/3738657037 conn(0x7fa330071e60 msgr2=0x7fa3300c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.379+0000 7fa338477640 1 -- 172.21.15.40:0/3738657037 shutdown_connections 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.379+0000 7fa338477640 1 -- 172.21.15.40:0/3738657037 wait complete. 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 Processor -- start 2023-12-20T04:24:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 -- start start 2023-12-20T04:24:06.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3300b6690 0x7fa3301d3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3300bcdd0 0x7fa3301dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa330144ea0 0x7fa3301dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3301d3ca0 con 0x7fa3300b6690 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330148e20 con 0x7fa330144ea0 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa338477640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa330148860 con 0x7fa3300bcdd0 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa336213640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3300b6690 0x7fa3301d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa336213640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3300b6690 0x7fa3301d3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53102/0 (socket says 172.21.15.40:53102) 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.380+0000 7fa336213640 1 -- 172.21.15.40:0/4191564664 learned_addr learned my addr 172.21.15.40:0/4191564664 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336a14640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa330144ea0 0x7fa3301dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa335a12640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3300bcdd0 0x7fa3301dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336213640 1 -- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3300bcdd0 msgr2=0x7fa3301dfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336213640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3300bcdd0 0x7fa3301dfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336213640 1 -- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa330144ea0 msgr2=0x7fa3301dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336213640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa330144ea0 0x7fa3301dffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336213640 1 -- 172.21.15.40:0/4191564664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009a70 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336a14640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa330144ea0 0x7fa3301dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa335a12640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3300bcdd0 0x7fa3301dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa336213640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3300b6690 0x7fa3301d3760 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c4a0 tx=0x7fa32c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa326ffd640 1 -- 172.21.15.40:0/4191564664 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0074e0 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa326ffd640 1 -- 172.21.15.40:0/4191564664 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c007640 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33014a1d0 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa326ffd640 1 -- 172.21.15.40:0/4191564664 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c004a00 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.381+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa330148ab0 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.382+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33004e840 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.382+0000 7fa326ffd640 1 -- 172.21.15.40:0/4191564664 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa32c004b60 con 0x7fa3300b6690 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.383+0000 7fa326ffd640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa31406a460 0x7fa31406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.383+0000 7fa326ffd640 1 -- 172.21.15.40:0/4191564664 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa32c087dc0 con 0x7fa3300b6690 2023-12-20T04:24:06.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.383+0000 7fa335a12640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa31406a460 0x7fa31406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.384+0000 7fa335a12640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa31406a460 0x7fa31406c920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3301d3050 tx=0x7fa320009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.387+0000 7fa326ffd640 1 -- 172.21.15.40:0/4191564664 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa32c053440 con 0x7fa3300b6690 2023-12-20T04:24:06.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.565+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa330144a40 con 0x7fa3300b6690 2023-12-20T04:24:06.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.566+0000 7fa326ffd640 1 -- 172.21.15.40:0/4191564664 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16066 (secure 0 0 0) 0x7fa32c018090 con 0x7fa3300b6690 2023-12-20T04:24:06.567 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:06.567 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:24:05.927567+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:24:03.672943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:24:04.910865+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:24:06.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa31406a460 msgr2=0x7fa31406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa31406a460 0x7fa31406c920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3301d3050 tx=0x7fa320009040 comp rx=0 tx=0).stop 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3300b6690 msgr2=0x7fa3301d3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3300b6690 0x7fa3301d3760 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c4a0 tx=0x7fa32c00c960 comp rx=0 tx=0).stop 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 shutdown_connections 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa31406a460 0x7fa31406c920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa330144ea0 0x7fa3301dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa3300bcdd0 0x7fa3301dfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 --2- 172.21.15.40:0/4191564664 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3300b6690 0x7fa3301d3760 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 >> 172.21.15.40:0/4191564664 conn(0x7fa330071e60 msgr2=0x7fa330140850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 shutdown_connections 2023-12-20T04:24:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.568+0000 7fa338477640 1 -- 172.21.15.40:0/4191564664 wait complete. 2023-12-20T04:24:06.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:24:06.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.688+0000 7fd6fefce640 1 Processor -- start 2023-12-20T04:24:06.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.688+0000 7fd6fefce640 1 -- start start 2023-12-20T04:24:06.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fefce640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd6f80bf510 0x7fd6f80be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fefce640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6f806a950 0x7fd6f80bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fefce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f80bfa50 con 0x7fd6f80bb140 2023-12-20T04:24:06.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fefce640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f80bbda0 con 0x7fd6f806a950 2023-12-20T04:24:06.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fefce640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f806b040 con 0x7fd6f80bf510 2023-12-20T04:24:06.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fd56b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6f806a950 0x7fd6f80bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fd56b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6f806a950 0x7fd6f80bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53106/0 (socket says 172.21.15.40:53106) 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fcd6a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6f80bb140 0x7fd6f80bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43060/0 (socket says 172.21.15.40:43060) 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fd56b640 1 -- 172.21.15.40:0/1684031053 learned_addr learned my addr 172.21.15.40:0/1684031053 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6effff640 1 --2- 172.21.15.40:0/1684031053 >> v2:172.21.15.69:3300/0 conn(0x7fd6f80bf510 0x7fd6f80be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fd56b640 1 -- 172.21.15.40:0/1684031053 >> v2:172.21.15.69:3300/0 conn(0x7fd6f80bf510 msgr2=0x7fd6f80be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fd56b640 1 --2- 172.21.15.40:0/1684031053 >> v2:172.21.15.69:3300/0 conn(0x7fd6f80bf510 0x7fd6f80be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fd56b640 1 -- 172.21.15.40:0/1684031053 >> v1:172.21.15.40:6789/0 conn(0x7fd6f80bb140 legacy=0x7fd6f80bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6fd56b640 1 -- 172.21.15.40:0/1684031053 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80bb520 con 0x7fd6f806a950 2023-12-20T04:24:06.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.689+0000 7fd6effff640 1 --2- 172.21.15.40:0/1684031053 >> v2:172.21.15.69:3300/0 conn(0x7fd6f80bf510 0x7fd6f80be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.690+0000 7fd6fd56b640 1 --2- 172.21.15.40:0/1684031053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80bfee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd6f806b650 tx=0x7fd6f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c9c48061e1fca0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.690+0000 7fd6ef7fe640 1 -- 172.21.15.40:0/1684031053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f002ca80 con 0x7fd6f806a950 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.690+0000 7fd6ef7fe640 1 -- 172.21.15.40:0/1684031053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f002cbe0 con 0x7fd6f806a950 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.690+0000 7fd6ef7fe640 1 -- 172.21.15.40:0/1684031053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00343f0 con 0x7fd6f806a950 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.690+0000 7fd6fefce640 1 -- 172.21.15.40:0/1684031053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 msgr2=0x7fd6f80bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.690+0000 7fd6fefce640 1 --2- 172.21.15.40:0/1684031053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80bfee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd6f806b650 tx=0x7fd6f002bee0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.691+0000 7fd6fefce640 1 -- 172.21.15.40:0/1684031053 shutdown_connections 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.691+0000 7fd6fefce640 1 --2- 172.21.15.40:0/1684031053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80bfee0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.691+0000 7fd6fefce640 1 --2- 172.21.15.40:0/1684031053 >> v2:172.21.15.69:3300/0 conn(0x7fd6f80bf510 0x7fd6f80be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.691+0000 7fd6fefce640 1 -- 172.21.15.40:0/1684031053 >> 172.21.15.40:0/1684031053 conn(0x7fd6f80bcfd0 msgr2=0x7fd6f80bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.691+0000 7fd6fefce640 1 -- 172.21.15.40:0/1684031053 shutdown_connections 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.691+0000 7fd6fefce640 1 -- 172.21.15.40:0/1684031053 wait complete. 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 Processor -- start 2023-12-20T04:24:06.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 -- start start 2023-12-20T04:24:06.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80a29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6f80bb140 0x7fd6f8147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd6f80bf510 0x7fd6f8148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f814aed0 con 0x7fd6f806a950 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80a2ef0 con 0x7fd6f80bb140 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fefce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f814eda0 con 0x7fd6f80bf510 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.692+0000 7fd6fcd6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80a29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80a29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53108/0 (socket says 172.21.15.40:53108) 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 -- 172.21.15.40:0/4031461249 learned_addr learned my addr 172.21.15.40:0/4031461249 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6effff640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6f80bb140 0x7fd6f8147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fd56b640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd6f80bf510 0x7fd6f8148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 -- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd6f80bf510 msgr2=0x7fd6f8148250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd6f80bf510 0x7fd6f8148250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 -- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6f80bb140 msgr2=0x7fd6f8147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6f80bb140 0x7fd6f8147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 -- 172.21.15.40:0/4031461249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0009b30 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6effff640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6f80bb140 0x7fd6f8147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fcd6a640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80a29b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c3e0 tx=0x7fd6f400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6ed7fa640 1 -- 172.21.15.40:0/4031461249 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40074e0 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6ed7fa640 1 -- 172.21.15.40:0/4031461249 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f4007640 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6ed7fa640 1 -- 172.21.15.40:0/4031461249 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40049e0 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f814e790 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.693+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f814ea30 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.694+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f806b330 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.695+0000 7fd6ed7fa640 1 -- 172.21.15.40:0/4031461249 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6f4004b40 con 0x7fd6f806a950 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.695+0000 7fd6ed7fa640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd6e406a430 0x7fd6e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:06.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.695+0000 7fd6ed7fa640 1 -- 172.21.15.40:0/4031461249 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6f4088310 con 0x7fd6f806a950 2023-12-20T04:24:06.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.695+0000 7fd6effff640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd6e406a430 0x7fd6e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:06.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.696+0000 7fd6effff640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd6e406a430 0x7fd6e406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6f81499c0 tx=0x7fd6e8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:06.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.699+0000 7fd6ed7fa640 1 -- 172.21.15.40:0/4031461249 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd6f40537f0 con 0x7fd6f806a950 2023-12-20T04:24:06.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.911+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd6f80740a0 con 0x7fd6f806a950 2023-12-20T04:24:06.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.940+0000 7fd6ed7fa640 1 -- 172.21.15.40:0/4031461249 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd6f4056e10 con 0x7fd6f806a950 2023-12-20T04:24:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd6e406a430 msgr2=0x7fd6e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd6e406a430 0x7fd6e406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd6f81499c0 tx=0x7fd6e8008040 comp rx=0 tx=0).stop 2023-12-20T04:24:06.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 msgr2=0x7fd6f80a29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80a29b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400c3e0 tx=0x7fd6f400c8a0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 shutdown_connections 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd6e406a430 0x7fd6e406c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd6f80bf510 0x7fd6f8148250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6f80bb140 0x7fd6f8147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 --2- 172.21.15.40:0/4031461249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6f806a950 0x7fd6f80a29b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 >> 172.21.15.40:0/4031461249 conn(0x7fd6f80bcfd0 msgr2=0x7fd6f80a5730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 shutdown_connections 2023-12-20T04:24:06.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:06.942+0000 7fd6fefce640 1 -- 172.21.15.40:0/4031461249 wait complete. 2023-12-20T04:24:06.954 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:24:06.954 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:24:07.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.062+0000 7f1bed38e640 1 Processor -- start 2023-12-20T04:24:07.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.062+0000 7f1bed38e640 1 -- start start 2023-12-20T04:24:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1bed38e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1be80bb140 0x7f1be80be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1bed38e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1be806a950 0x7f1be80bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1bed38e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be80bfa50 con 0x7f1be80bee00 2023-12-20T04:24:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1bed38e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be80bbda0 con 0x7f1be80bb140 2023-12-20T04:24:07.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1bed38e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be806b040 con 0x7f1be806a950 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1be80bb140 0x7f1be80be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1be80bee00 0x7f1be80bf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43066/0 (socket says 172.21.15.40:43066) 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be77fe640 1 -- 172.21.15.40:0/793820636 learned_addr learned my addr 172.21.15.40:0/793820636 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be67fc640 1 --2- 172.21.15.40:0/793820636 >> v2:172.21.15.69:3300/0 conn(0x7f1be806a950 0x7f1be80bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be6ffd640 1 -- 172.21.15.40:0/793820636 >> v2:172.21.15.69:3300/0 conn(0x7f1be806a950 msgr2=0x7f1be80bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be6ffd640 1 --2- 172.21.15.40:0/793820636 >> v2:172.21.15.69:3300/0 conn(0x7f1be806a950 0x7f1be80bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be6ffd640 1 -- 172.21.15.40:0/793820636 >> v1:172.21.15.40:6789/0 conn(0x7f1be80bee00 legacy=0x7f1be80bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be6ffd640 1 -- 172.21.15.40:0/793820636 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80bb520 con 0x7f1be80bb140 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be5ffb640 1 -- 172.21.15.40:0/793820636 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992998992 0 0) 0x7f1be80bfa50 con 0x7f1be80bee00 2023-12-20T04:24:07.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.063+0000 7f1be67fc640 1 --2- 172.21.15.40:0/793820636 >> v2:172.21.15.69:3300/0 conn(0x7f1be806a950 0x7f1be80bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.064+0000 7f1be6ffd640 1 --2- 172.21.15.40:0/793820636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bb140 0x7f1be80be350 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1be806b650 tx=0x7f1be002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a36561b21c6bc0e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.064+0000 7f1be5ffb640 1 -- 172.21.15.40:0/793820636 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be002e070 con 0x7f1be80bb140 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.064+0000 7f1be5ffb640 1 -- 172.21.15.40:0/793820636 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be00315a0 con 0x7f1be80bb140 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.064+0000 7f1be5ffb640 1 -- 172.21.15.40:0/793820636 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be0031930 con 0x7f1be80bb140 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 -- 172.21.15.40:0/793820636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bb140 msgr2=0x7f1be80be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 --2- 172.21.15.40:0/793820636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bb140 0x7f1be80be350 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1be806b650 tx=0x7f1be002b840 comp rx=0 tx=0).stop 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 -- 172.21.15.40:0/793820636 shutdown_connections 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 --2- 172.21.15.40:0/793820636 >> v2:172.21.15.69:3300/0 conn(0x7f1be806a950 0x7f1be80bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 --2- 172.21.15.40:0/793820636 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bb140 0x7f1be80be350 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 -- 172.21.15.40:0/793820636 >> 172.21.15.40:0/793820636 conn(0x7f1be80bcfd0 msgr2=0x7f1be80bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 -- 172.21.15.40:0/793820636 shutdown_connections 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.065+0000 7f1bed38e640 1 -- 172.21.15.40:0/793820636 wait complete. 2023-12-20T04:24:07.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.066+0000 7f1bed38e640 1 Processor -- start 2023-12-20T04:24:07.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.066+0000 7f1bed38e640 1 -- start start 2023-12-20T04:24:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.066+0000 7f1bed38e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1be806a950 0x7f1be80b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.066+0000 7f1bed38e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1be80bb140 0x7f1be814e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bed38e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bee00 0x7f1be814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bed38e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be814eae0 con 0x7f1be80bee00 2023-12-20T04:24:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bed38e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be80a2d20 con 0x7f1be80bb140 2023-12-20T04:24:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bed38e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be81e32c0 con 0x7f1be806a950 2023-12-20T04:24:07.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bee00 0x7f1be814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bee00 0x7f1be814ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53138/0 (socket says 172.21.15.40:53138) 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 -- 172.21.15.40:0/1303473199 learned_addr learned my addr 172.21.15.40:0/1303473199 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be67fc640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1be80bb140 0x7f1be814e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be6ffd640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1be806a950 0x7f1be80b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 -- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1be806a950 msgr2=0x7f1be80b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1be806a950 0x7f1be80b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 -- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1be80bb140 msgr2=0x7f1be814e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1be80bb140 0x7f1be814e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 -- 172.21.15.40:0/1303473199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0009400 con 0x7f1be80bee00 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be67fc640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1be80bb140 0x7f1be814e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be6ffd640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1be806a950 0x7f1be80b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:07.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1be77fe640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bee00 0x7f1be814ce20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800c7e0 tx=0x7f1bd800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bcf7fe640 1 -- 172.21.15.40:0/1303473199 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800a640 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bcf7fe640 1 -- 172.21.15.40:0/1303473199 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800a7c0 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be80b51a0 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bcf7fe640 1 -- 172.21.15.40:0/1303473199 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800ab70 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.067+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be81e37f0 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.069+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be80740a0 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.069+0000 7f1bcf7fe640 1 -- 172.21.15.40:0/1303473199 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1bd800acd0 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.069+0000 7f1bcf7fe640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1bd406a430 0x7f1bd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.070+0000 7f1bcf7fe640 1 -- 172.21.15.40:0/1303473199 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bd8088140 con 0x7f1be80bee00 2023-12-20T04:24:07.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.070+0000 7f1be6ffd640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1bd406a430 0x7f1bd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:07.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.070+0000 7f1be6ffd640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1bd406a430 0x7f1bd406c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1be0036000 tx=0x7f1be003d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:07.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.074+0000 7f1bcf7fe640 1 -- 172.21.15.40:0/1303473199 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1bd8053730 con 0x7f1be80bee00 2023-12-20T04:24:07.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:07.290+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1be80ba4a0 con 0x7f1be80bee00 2023-12-20T04:24:08.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.266+0000 7f1bcf7fe640 1 -- 172.21.15.40:0/1303473199 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1bd8056d50 con 0x7f1be80bee00 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1bd406a430 msgr2=0x7f1bd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1bd406a430 0x7f1bd406c8f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1be0036000 tx=0x7f1be003d040 comp rx=0 tx=0).stop 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bee00 msgr2=0x7f1be814ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bee00 0x7f1be814ce20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800c7e0 tx=0x7f1bd800cca0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 shutdown_connections 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1bd406a430 0x7f1bd406c8f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1be80bee00 0x7f1be814ce20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1be80bb140 0x7f1be814e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 --2- 172.21.15.40:0/1303473199 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1be806a950 0x7f1be80b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 >> 172.21.15.40:0/1303473199 conn(0x7f1be80bcfd0 msgr2=0x7f1be8149da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 shutdown_connections 2023-12-20T04:24:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.269+0000 7f1bed38e640 1 -- 172.21.15.40:0/1303473199 wait complete. 2023-12-20T04:24:08.283 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:24:08.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:24:08.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.394+0000 7fddc4b11640 1 Processor -- start 2023-12-20T04:24:08.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.394+0000 7fddc4b11640 1 -- start start 2023-12-20T04:24:08.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddc4b11640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fddc00bcdd0 0x7fddc00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddc4b11640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc00bc6b0 con 0x7fddc00b64c0 2023-12-20T04:24:08.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddc4b11640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc00b6900 con 0x7fddc0144ea0 2023-12-20T04:24:08.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddc4b11640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc00a59f0 con 0x7fddc00bcdd0 2023-12-20T04:24:08.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddbe59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fddc00bcdd0 0x7fddc00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddbdd9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fddc00b64c0 0x7fddc0144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43078/0 (socket says 172.21.15.40:43078) 2023-12-20T04:24:08.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddbdd9b640 1 -- 172.21.15.40:0/2113286553 learned_addr learned my addr 172.21.15.40:0/2113286553 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddbe59c640 1 -- 172.21.15.40:0/2113286553 >> v1:172.21.15.69:6789/0 conn(0x7fddc0144ea0 legacy=0x7fddc0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddbe59c640 1 -- 172.21.15.40:0/2113286553 >> v1:172.21.15.40:6789/0 conn(0x7fddc00b64c0 legacy=0x7fddc0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.395+0000 7fddbe59c640 1 -- 172.21.15.40:0/2113286553 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc00bc0a0 con 0x7fddc00bcdd0 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.396+0000 7fddbe59c640 1 --2- 172.21.15.40:0/2113286553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc00b5f80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fddb80097a0 tx=0x7fddb802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc4f97d729c06f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.396+0000 7fddbd59a640 1 -- 172.21.15.40:0/2113286553 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8030610 con 0x7fddc00bcdd0 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.396+0000 7fddbd59a640 1 -- 172.21.15.40:0/2113286553 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb8030770 con 0x7fddc00bcdd0 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.396+0000 7fddbd59a640 1 -- 172.21.15.40:0/2113286553 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb8030b00 con 0x7fddc00bcdd0 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.397+0000 7fddc4b11640 1 -- 172.21.15.40:0/2113286553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 msgr2=0x7fddc00b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.397+0000 7fddc4b11640 1 --2- 172.21.15.40:0/2113286553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc00b5f80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fddb80097a0 tx=0x7fddb802b960 comp rx=0 tx=0).stop 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.397+0000 7fddc4b11640 1 -- 172.21.15.40:0/2113286553 shutdown_connections 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.397+0000 7fddc4b11640 1 --2- 172.21.15.40:0/2113286553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc00b5f80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.397+0000 7fddc4b11640 1 -- 172.21.15.40:0/2113286553 >> 172.21.15.40:0/2113286553 conn(0x7fddc0071e60 msgr2=0x7fddc00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:08.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.397+0000 7fddc4b11640 1 -- 172.21.15.40:0/2113286553 shutdown_connections 2023-12-20T04:24:08.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.397+0000 7fddc4b11640 1 -- 172.21.15.40:0/2113286553 wait complete. 2023-12-20T04:24:08.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.398+0000 7fddc4b11640 1 Processor -- start 2023-12-20T04:24:08.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.398+0000 7fddc4b11640 1 -- start start 2023-12-20T04:24:08.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddc4b11640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddc00b64c0 0x7fddc01d1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddc4b11640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddc4b11640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fddc0144ea0 0x7fddc0149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddc4b11640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc0146460 con 0x7fddc00bcdd0 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddc4b11640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc01494e0 con 0x7fddc00b64c0 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddc4b11640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc01d15c0 con 0x7fddc0144ea0 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc014add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53152/0 (socket says 172.21.15.40:53152) 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 -- 172.21.15.40:0/555737678 learned_addr learned my addr 172.21.15.40:0/555737678 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbe59c640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddc00b64c0 0x7fddc01d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbed9d640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fddc0144ea0 0x7fddc0149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 -- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fddc0144ea0 msgr2=0x7fddc0149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fddc0144ea0 0x7fddc0149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 -- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddc00b64c0 msgr2=0x7fddc01d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddc00b64c0 0x7fddc01d1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 -- 172.21.15.40:0/555737678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8009400 con 0x7fddc00bcdd0 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbed9d640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fddc0144ea0 0x7fddc0149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddbdd9b640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc014add0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c4a0 tx=0x7fddb400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.399+0000 7fddaeffd640 1 -- 172.21.15.40:0/555737678 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4005ce0 con 0x7fddc00bcdd0 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.400+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc0142570 con 0x7fddc00bcdd0 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.400+0000 7fddaeffd640 1 -- 172.21.15.40:0/555737678 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb4005e40 con 0x7fddc00bcdd0 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.400+0000 7fddaeffd640 1 -- 172.21.15.40:0/555737678 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4007270 con 0x7fddc00bcdd0 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.400+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc0149730 con 0x7fddc00bcdd0 2023-12-20T04:24:08.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.401+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc004e840 con 0x7fddc00bcdd0 2023-12-20T04:24:08.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.401+0000 7fddaeffd640 1 -- 172.21.15.40:0/555737678 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fddb4007490 con 0x7fddc00bcdd0 2023-12-20T04:24:08.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.402+0000 7fddaeffd640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdda006a430 0x7fdda006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.402+0000 7fddaeffd640 1 -- 172.21.15.40:0/555737678 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddb4087dd0 con 0x7fddc00bcdd0 2023-12-20T04:24:08.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.402+0000 7fddbe59c640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdda006a430 0x7fdda006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.402+0000 7fddbe59c640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdda006a430 0x7fdda006c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fddb8036000 tx=0x7fddb803b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:08.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.406+0000 7fddaeffd640 1 -- 172.21.15.40:0/555737678 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fddb4053480 con 0x7fddc00bcdd0 2023-12-20T04:24:08.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.619+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddc0142e60 con 0x7fddc00bcdd0 2023-12-20T04:24:08.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.620+0000 7fddaeffd640 1 -- 172.21.15.40:0/555737678 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3952 (secure 0 0 0) 0x7fddb4089f80 con 0x7fddc00bcdd0 2023-12-20T04:24:08.621 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:08.621 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1306717467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1306717467},{"type":"v1","addr":"172.21.15.40:6835","nonce":1306717467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4625,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1583424120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1583424120},{"type":"v1","addr":"172.21.15.69:6835","nonce":1583424120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:24:05.927869+0000","modified":"2023-12-20T04:24:08.263654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/3041271085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3041271085},{"type":"v1","addr":"172.21.15.40:6834","nonce":3041271085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:24:08.621 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2023-12-20T04:24:08.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdda006a430 msgr2=0x7fdda006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdda006a430 0x7fdda006c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fddb8036000 tx=0x7fddb803b040 comp rx=0 tx=0).stop 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 msgr2=0x7fddc014add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc014add0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c4a0 tx=0x7fddb400c960 comp rx=0 tx=0).stop 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 shutdown_connections 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdda006a430 0x7fdda006c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fddc0144ea0 0x7fddc0149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddc00bcdd0 0x7fddc014add0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 --2- 172.21.15.40:0/555737678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fddc00b64c0 0x7fddc01d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.621+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 >> 172.21.15.40:0/555737678 conn(0x7fddc0071e60 msgr2=0x7fddc00b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.622+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 shutdown_connections 2023-12-20T04:24:08.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.622+0000 7fddc4b11640 1 -- 172.21.15.40:0/555737678 wait complete. 2023-12-20T04:24:08.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:24:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.738+0000 7f0fe031b640 1 Processor -- start 2023-12-20T04:24:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.738+0000 7f0fe031b640 1 -- start start 2023-12-20T04:24:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fe031b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fd806a470 0x7f0fd80bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fe031b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd814abd0 0x7f0fd8155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fe031b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd80bae20 con 0x7f0fd80b3900 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fe031b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd80c1220 con 0x7f0fd806a470 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fe031b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80bf900 con 0x7f0fd814abd0 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fde0b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fd806a470 0x7f0fd80bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fdd8b6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0fd80b3900 0x7f0fd8148040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43088/0 (socket says 172.21.15.40:43088) 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fdd8b6640 1 -- 172.21.15.40:0/1160704072 learned_addr learned my addr 172.21.15.40:0/1160704072 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.739+0000 7f0fde8b8640 1 --2- 172.21.15.40:0/1160704072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd814abd0 0x7f0fd8155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fde0b7640 1 -- 172.21.15.40:0/1160704072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd814abd0 msgr2=0x7f0fd8155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fde0b7640 1 --2- 172.21.15.40:0/1160704072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd814abd0 0x7f0fd8155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fde0b7640 1 -- 172.21.15.40:0/1160704072 >> v1:172.21.15.40:6789/0 conn(0x7f0fd80b3900 legacy=0x7f0fd8148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fdd0b5640 1 -- 172.21.15.40:0/1160704072 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580340515 0 0) 0x7f0fd80bae20 con 0x7f0fd80b3900 2023-12-20T04:24:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fde0b7640 1 -- 172.21.15.40:0/1160704072 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd814b080 con 0x7f0fd806a470 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fde0b7640 1 --2- 172.21.15.40:0/1160704072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd806a470 0x7f0fd80bb2b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40097a0 tx=0x7f0fd402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1c3c3986fe3907 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fdd0b5640 1 -- 172.21.15.40:0/1160704072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4031830 con 0x7f0fd806a470 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.740+0000 7f0fdd0b5640 1 -- 172.21.15.40:0/1160704072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd4031990 con 0x7f0fd806a470 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fdd0b5640 1 -- 172.21.15.40:0/1160704072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4031d20 con 0x7f0fd806a470 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 -- 172.21.15.40:0/1160704072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd806a470 msgr2=0x7f0fd80bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1160704072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd806a470 0x7f0fd80bb2b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0fd40097a0 tx=0x7f0fd402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 -- 172.21.15.40:0/1160704072 shutdown_connections 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1160704072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd814abd0 0x7f0fd8155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1160704072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd806a470 0x7f0fd80bb2b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 -- 172.21.15.40:0/1160704072 >> 172.21.15.40:0/1160704072 conn(0x7f0fd80c0270 msgr2=0x7f0fd80c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 -- 172.21.15.40:0/1160704072 shutdown_connections 2023-12-20T04:24:08.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.741+0000 7f0fe031b640 1 -- 172.21.15.40:0/1160704072 wait complete. 2023-12-20T04:24:08.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.742+0000 7f0fe031b640 1 Processor -- start 2023-12-20T04:24:08.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.742+0000 7f0fe031b640 1 -- start start 2023-12-20T04:24:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fe031b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd806a470 0x7f0fd80bf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fe031b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fd80b3900 0x7f0fd81e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fe031b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd814abd0 0x7f0fd814e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fe031b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80bf560 con 0x7f0fd814abd0 2023-12-20T04:24:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fe031b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd81da860 con 0x7f0fd80b3900 2023-12-20T04:24:08.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fe031b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd80a50a0 con 0x7f0fd806a470 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd814abd0 0x7f0fd814e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd814abd0 0x7f0fd814e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53174/0 (socket says 172.21.15.40:53174) 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 -- 172.21.15.40:0/1161878262 learned_addr learned my addr 172.21.15.40:0/1161878262 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde0b7640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd806a470 0x7f0fd80bf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fdd8b6640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fd80b3900 0x7f0fd81e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 -- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd806a470 msgr2=0x7f0fd80bf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd806a470 0x7f0fd80bf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 -- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fd80b3900 msgr2=0x7f0fd81e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fd80b3900 0x7f0fd81e0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 -- 172.21.15.40:0/1161878262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4009400 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde0b7640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd806a470 0x7f0fd80bf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.743+0000 7f0fde8b8640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd814abd0 0x7f0fd814e5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009d30 tx=0x7f0fd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.744+0000 7f0fceffd640 1 -- 172.21.15.40:0/1161878262 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0009ba0 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.744+0000 7f0fceffd640 1 -- 172.21.15.40:0/1161878262 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd000f040 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.744+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd80a4ae0 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.744+0000 7f0fceffd640 1 -- 172.21.15.40:0/1161878262 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00146c0 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.744+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd80a59a0 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.745+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd80a5800 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.745+0000 7f0fceffd640 1 -- 172.21.15.40:0/1161878262 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fd0014820 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.745+0000 7f0fceffd640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fbc06a430 0x7f0fbc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.745+0000 7f0fceffd640 1 -- 172.21.15.40:0/1161878262 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fd0089680 con 0x7f0fd814abd0 2023-12-20T04:24:08.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.746+0000 7f0fde0b7640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fbc06a430 0x7f0fbc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:08.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.746+0000 7f0fde0b7640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fbc06a430 0x7f0fbc06c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4036000 tx=0x7f0fd4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:08.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.750+0000 7f0fceffd640 1 -- 172.21.15.40:0/1161878262 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0fd80a5800 con 0x7f0fd814abd0 2023-12-20T04:24:08.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.926+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd80a5800 con 0x7f0fd814abd0 2023-12-20T04:24:08.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.928+0000 7f0fceffd640 1 -- 172.21.15.40:0/1161878262 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f0fd80a5800 con 0x7f0fd814abd0 2023-12-20T04:24:08.928 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:08.929 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:24:06.929899+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:24:03.672943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:24:04.910865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fbc06a430 msgr2=0x7f0fbc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fbc06a430 0x7f0fbc06c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4036000 tx=0x7f0fd4008030 comp rx=0 tx=0).stop 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd814abd0 msgr2=0x7f0fd814e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd814abd0 0x7f0fd814e5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009d30 tx=0x7f0fd000c490 comp rx=0 tx=0).stop 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 shutdown_connections 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0fbc06a430 0x7f0fbc06c8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd814abd0 0x7f0fd814e5a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fd80b3900 0x7f0fd81e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 --2- 172.21.15.40:0/1161878262 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0fd806a470 0x7f0fd80bf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:08.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 >> 172.21.15.40:0/1161878262 conn(0x7f0fd80c0270 msgr2=0x7f0fd81491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 shutdown_connections 2023-12-20T04:24:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:08.930+0000 7f0fe031b640 1 -- 172.21.15.40:0/1161878262 wait complete. 2023-12-20T04:24:08.942 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:24:08.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:24:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.047+0000 7f92e4c4a640 1 Processor -- start 2023-12-20T04:24:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.047+0000 7f92e4c4a640 1 -- start start 2023-12-20T04:24:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92e4c4a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e0144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92e4c4a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00bc6b0 con 0x7f92e00bcdd0 2023-12-20T04:24:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92e4c4a640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e00a59f0 con 0x7f92e0144cd0 2023-12-20T04:24:09.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92e4c4a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e00bc0a0 con 0x7f92e00b6690 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92de59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92e00bcdd0 0x7f92e00b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43096/0 (socket says 172.21.15.40:43096) 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92de59c640 1 -- 172.21.15.40:0/4068293113 learned_addr learned my addr 172.21.15.40:0/4068293113 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92d7fff640 1 --2- 172.21.15.40:0/4068293113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e0144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92ddd9b640 1 -- 172.21.15.40:0/4068293113 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023077371 0 0) 0x7f92e00bc6b0 con 0x7f92e00bcdd0 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92ddd9b640 1 -- 172.21.15.40:0/4068293113 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92cc003520 con 0x7f92e00bcdd0 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92ddd9b640 1 -- 172.21.15.40:0/4068293113 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478233481 0 0) 0x7f92e00a59f0 con 0x7f92e0144cd0 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92ddd9b640 1 -- 172.21.15.40:0/4068293113 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e00bc6b0 con 0x7f92e0144cd0 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92d7fff640 1 -- 172.21.15.40:0/4068293113 >> v1:172.21.15.69:6789/0 conn(0x7f92e0144cd0 legacy=0x7f92e0155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92d7fff640 1 -- 172.21.15.40:0/4068293113 >> v1:172.21.15.40:6789/0 conn(0x7f92e00bcdd0 legacy=0x7f92e00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.048+0000 7f92d7fff640 1 -- 172.21.15.40:0/4068293113 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00bc340 con 0x7f92e00b6690 2023-12-20T04:24:09.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.049+0000 7f92d7fff640 1 --2- 172.21.15.40:0/4068293113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e0144790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92c80097d0 tx=0x7f92c802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea01926472866e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.049+0000 7f92ddd9b640 1 -- 172.21.15.40:0/4068293113 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8030880 con 0x7f92e00b6690 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.049+0000 7f92ddd9b640 1 -- 172.21.15.40:0/4068293113 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c80309e0 con 0x7f92e00b6690 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.049+0000 7f92ddd9b640 1 -- 172.21.15.40:0/4068293113 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8030d50 con 0x7f92e00b6690 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.050+0000 7f92e4c4a640 1 -- 172.21.15.40:0/4068293113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 msgr2=0x7f92e0144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.050+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/4068293113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e0144790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92c80097d0 tx=0x7f92c802b9c0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.050+0000 7f92e4c4a640 1 -- 172.21.15.40:0/4068293113 shutdown_connections 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.050+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/4068293113 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e0144790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.050+0000 7f92e4c4a640 1 -- 172.21.15.40:0/4068293113 >> 172.21.15.40:0/4068293113 conn(0x7f92e0071e60 msgr2=0x7f92e00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.050+0000 7f92e4c4a640 1 -- 172.21.15.40:0/4068293113 shutdown_connections 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.050+0000 7f92e4c4a640 1 -- 172.21.15.40:0/4068293113 wait complete. 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.051+0000 7f92e4c4a640 1 Processor -- start 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.051+0000 7f92e4c4a640 1 -- start start 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e01e3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92e00bcdd0 0x7f92e01e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92e0144cd0 0x7f92e01e0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01e3750 con 0x7f92e0144cd0 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01e3eb0 con 0x7f92e00bcdd0 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e01d4d80 con 0x7f92e00b6690 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92e0144cd0 0x7f92e01e0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92e0144cd0 0x7f92e01e0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53184/0 (socket says 172.21.15.40:53184) 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 -- 172.21.15.40:0/355158909 learned_addr learned my addr 172.21.15.40:0/355158909 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92d7fff640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92e00bcdd0 0x7f92e01e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92de59c640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e01e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 -- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 msgr2=0x7f92e01e3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e01e3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 -- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92e00bcdd0 msgr2=0x7f92e01e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92e00bcdd0 0x7f92e01e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 -- 172.21.15.40:0/355158909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8009400 con 0x7f92e0144cd0 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92ded9d640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92e0144cd0 0x7f92e01e0630 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f92d800c6e0 tx=0x7f92d800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92d6ffd640 1 -- 172.21.15.40:0/355158909 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8003b70 con 0x7f92e0144cd0 2023-12-20T04:24:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92d6ffd640 1 -- 172.21.15.40:0/355158909 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d8003cd0 con 0x7f92e0144cd0 2023-12-20T04:24:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e01e3930 con 0x7f92e0144cd0 2023-12-20T04:24:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92d6ffd640 1 -- 172.21.15.40:0/355158909 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d80052d0 con 0x7f92e0144cd0 2023-12-20T04:24:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.052+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e01dfbd0 con 0x7f92e0144cd0 2023-12-20T04:24:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.054+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e004e840 con 0x7f92e0144cd0 2023-12-20T04:24:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.054+0000 7f92d6ffd640 1 -- 172.21.15.40:0/355158909 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f92d8005430 con 0x7f92e0144cd0 2023-12-20T04:24:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.054+0000 7f92d6ffd640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92c006a430 0x7f92c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.054+0000 7f92d6ffd640 1 -- 172.21.15.40:0/355158909 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92d8088710 con 0x7f92e0144cd0 2023-12-20T04:24:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.055+0000 7f92de59c640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92c006a430 0x7f92c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.055+0000 7f92de59c640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92c006a430 0x7f92c006c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92d00011e0 tx=0x7f92d0007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.058+0000 7f92d6ffd640 1 -- 172.21.15.40:0/355158909 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f92d8053ca0 con 0x7f92e0144cd0 2023-12-20T04:24:09.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.235+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92e01dfa50 con 0x7f92c006a430 2023-12-20T04:24:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.242+0000 7f92d6ffd640 1 -- 172.21.15.40:0/355158909 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249846 (secure 0 0 0) 0x7f92d00014d0 con 0x7f92c006a430 2023-12-20T04:24:09.246 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92c006a430 msgr2=0x7f92c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92c006a430 0x7f92c006c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f92d00011e0 tx=0x7f92d0007d30 comp rx=0 tx=0).stop 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92e0144cd0 msgr2=0x7f92e01e0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92e0144cd0 0x7f92e01e0630 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f92d800c6e0 tx=0x7f92d800cba0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 shutdown_connections 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f92c006a430 0x7f92c006c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92e0144cd0 0x7f92e01e0630 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92e00bcdd0 0x7f92e01e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 --2- 172.21.15.40:0/355158909 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f92e00b6690 0x7f92e01e3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 >> 172.21.15.40:0/355158909 conn(0x7f92e0071e60 msgr2=0x7f92e0140950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 shutdown_connections 2023-12-20T04:24:09.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.245+0000 7f92e4c4a640 1 -- 172.21.15.40:0/355158909 wait complete. 2023-12-20T04:24:09.257 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-20T04:24:08.537082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219112,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":3579904,"data_stored":2053560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000895"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-20T04:23:59.256597+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:23:59.256597+0000","last_peered":"2023-12-20T04:23:59.256597+0000","last_clean":"2023-12-20T04:23:59.256597+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:23:59.256597+0000","last_undegraded":"2023-12-20T04:23:59.256597+0000","last_fullsized":"2023-12-20T04:23:59.256597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:24:09.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:24:09.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.402+0000 7f8453641640 1 Processor -- start 2023-12-20T04:24:09.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.402+0000 7f8453641640 1 -- start start 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.403+0000 7f8453641640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 0x7f844c14ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.403+0000 7f8453641640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c070480 con 0x7f844c06fc10 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.403+0000 7f8453641640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c0701a0 con 0x7f844c06af20 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.403+0000 7f8453641640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c071080 con 0x7f844c141cb0 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.403+0000 7f8451bde640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f844c06fc10 0x7f844c152090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43108/0 (socket says 172.21.15.40:43108) 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.403+0000 7f8451bde640 1 -- 172.21.15.40:0/1231109397 learned_addr learned my addr 172.21.15.40:0/1231109397 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8450bdc640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 0x7f844c14ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793336481 0 0) 0x7f844c070480 con 0x7f844c06fc10 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8434003520 con 0x7f844c06fc10 2023-12-20T04:24:09.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990848463 0 0) 0x7f844c0701a0 con 0x7f844c06af20 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f844c070480 con 0x7f844c06af20 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3228447621 0 0) 0x7f8434003520 con 0x7f844c06fc10 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 msgr2=0x7f844c14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 0x7f844c14ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 >> v1:172.21.15.69:6789/0 conn(0x7f844c06af20 legacy=0x7f844c1415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c070ca0 con 0x7f844c06fc10 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f843c0019f0 con 0x7f844c06fc10 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 >> v1:172.21.15.40:6789/0 conn(0x7f844c06fc10 legacy=0x7f844c152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434003b30 0x7f8434003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 0x7f84340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434004d00 0x7f8434005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c071080 con 0x7f8434004d00 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843400bb10 con 0x7f8434003b30 2023-12-20T04:24:09.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843400bca0 con 0x7f844c141cb0 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8451bde640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434004d00 0x7f8434005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8450bdc640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 0x7f84340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f84513dd640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434003b30 0x7f8434003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8451bde640 1 -- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 msgr2=0x7f84340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8451bde640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f844c141cb0 0x7f84340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8451bde640 1 -- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434003b30 msgr2=0x7f8434003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8451bde640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434003b30 0x7f8434003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.404+0000 7f8451bde640 1 -- 172.21.15.40:0/1231109397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434003520 con 0x7f8434004d00 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.405+0000 7f8451bde640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434004d00 0x7f8434005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f843c00a740 tx=0x7f84340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cb0e68a912f3f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.405+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c034630 con 0x7f8434004d00 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.405+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c02f070 con 0x7f8434004d00 2023-12-20T04:24:09.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.405+0000 7f844bfff640 1 -- 172.21.15.40:0/1231109397 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c034a10 con 0x7f8434004d00 2023-12-20T04:24:09.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.406+0000 7f8453641640 1 -- 172.21.15.40:0/1231109397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434004d00 msgr2=0x7f8434005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.406+0000 7f8453641640 1 --2- 172.21.15.40:0/1231109397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434004d00 0x7f8434005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f843c00a740 tx=0x7f84340057f0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.406+0000 7f8451bde640 1 -- 172.21.15.40:0/1231109397 reap_dead start 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.406+0000 7f8453641640 1 -- 172.21.15.40:0/1231109397 shutdown_connections 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.406+0000 7f8453641640 1 -- 172.21.15.40:0/1231109397 >> 172.21.15.40:0/1231109397 conn(0x7f844c0b9c30 msgr2=0x7f844c0ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.406+0000 7f8453641640 1 -- 172.21.15.40:0/1231109397 shutdown_connections 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.406+0000 7f8453641640 1 -- 172.21.15.40:0/1231109397 wait complete. 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.407+0000 7f8453641640 1 Processor -- start 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.407+0000 7f8453641640 1 -- start start 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8453641640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8434004d00 0x7f844c13a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8453641640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c1434f0 0x7f844c1e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8453641640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f844c13c620 0x7f844c138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8453641640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c1e1850 con 0x7f844c1434f0 2023-12-20T04:24:09.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8453641640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c1e1ff0 con 0x7f844c13c620 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8453641640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c13ce50 con 0x7f8434004d00 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c1434f0 0x7f844c1e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c1434f0 0x7f844c1e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53200/0 (socket says 172.21.15.40:53200) 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 -- 172.21.15.40:0/2145429714 learned_addr learned my addr 172.21.15.40:0/2145429714 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f84513dd640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8434004d00 0x7f844c13a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8451bde640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f844c13c620 0x7f844c138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 -- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8434004d00 msgr2=0x7f844c13a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8434004d00 0x7f844c13a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 -- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f844c13c620 msgr2=0x7f844c138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f844c13c620 0x7f844c138250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 -- 172.21.15.40:0/2145429714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c144df0 con 0x7f844c1434f0 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8450bdc640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c1434f0 0x7f844c1e1310 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8440011910 tx=0x7f8440011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8449ffb640 1 -- 172.21.15.40:0/2145429714 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8440009590 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8449ffb640 1 -- 172.21.15.40:0/2145429714 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8440004240 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.408+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c1e1a30 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.409+0000 7f8449ffb640 1 -- 172.21.15.40:0/2145429714 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844000f8e0 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.409+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c13caa0 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.410+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c0b8b90 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.410+0000 7f8449ffb640 1 -- 172.21.15.40:0/2145429714 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f844000fa40 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.410+0000 7f8449ffb640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f843806a430 0x7f843806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.410+0000 7f8449ffb640 1 -- 172.21.15.40:0/2145429714 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8440088e80 con 0x7f844c1434f0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.411+0000 7f84513dd640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f843806a430 0x7f843806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.411+0000 7f84513dd640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f843806a430 0x7f843806c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8444001940 tx=0x7f8444009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.415+0000 7f8449ffb640 1 -- 172.21.15.40:0/2145429714 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f84400545b0 con 0x7f844c1434f0 2023-12-20T04:24:09.543 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-20T04:24:09.542+0000 7f2c20929640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:24:09.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.587+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f844c06b300 con 0x7f843806a430 2023-12-20T04:24:09.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.594+0000 7f8449ffb640 1 -- 172.21.15.40:0/2145429714 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249846 (secure 0 0 0) 0x7f8444012980 con 0x7f843806a430 2023-12-20T04:24:09.597 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:09.599 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:24:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f843806a430 msgr2=0x7f843806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f843806a430 0x7f843806c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8444001940 tx=0x7f8444009040 comp rx=0 tx=0).stop 2023-12-20T04:24:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c1434f0 msgr2=0x7f844c1e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c1434f0 0x7f844c1e1310 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8440011910 tx=0x7f8440011dd0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 shutdown_connections 2023-12-20T04:24:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f843806a430 0x7f843806c8f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f844c13c620 0x7f844c138250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c1434f0 0x7f844c1e1310 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 --2- 172.21.15.40:0/2145429714 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f8434004d00 0x7f844c13a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 >> 172.21.15.40:0/2145429714 conn(0x7f844c0b9c30 msgr2=0x7f844c071510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 shutdown_connections 2023-12-20T04:24:09.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.597+0000 7f8453641640 1 -- 172.21.15.40:0/2145429714 wait complete. 2023-12-20T04:24:09.608 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-20T04:24:08.537082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219112,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":3579904,"data_stored":2053560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000895"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-20T04:23:59.256597+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:23:59.256597+0000","last_peered":"2023-12-20T04:23:59.256597+0000","last_clean":"2023-12-20T04:23:59.256597+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:23:59.256597+0000","last_undegraded":"2023-12-20T04:23:59.256597+0000","last_fullsized":"2023-12-20T04:23:59.256597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:24:09.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:24:09.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.754+0000 7f5837bfa640 1 Processor -- start 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.754+0000 7f5837bfa640 1 -- start start 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5837bfa640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58300b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5837bfa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58300b64c0 0x7f5830144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5837bfa640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5830144cd0 0x7f583014e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5837bfa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58300bc6b0 con 0x7f58300b64c0 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5837bfa640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58300b6900 con 0x7f5830144cd0 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5837bfa640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58300a59f0 con 0x7f58300bcdd0 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5835195640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58300b64c0 0x7f5830144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5835195640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58300b64c0 0x7f5830144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53214/0 (socket says 172.21.15.40:53214) 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5835195640 1 -- 172.21.15.40:0/3941366872 learned_addr learned my addr 172.21.15.40:0/3941366872 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5835996640 1 --2- 172.21.15.40:0/3941366872 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58300b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.755+0000 7f5836197640 1 --2- 172.21.15.40:0/3941366872 >> v2:172.21.15.69:3300/0 conn(0x7f5830144cd0 0x7f583014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5835195640 1 -- 172.21.15.40:0/3941366872 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 msgr2=0x7f58300b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5835195640 1 --2- 172.21.15.40:0/3941366872 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58300b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5835195640 1 -- 172.21.15.40:0/3941366872 >> v2:172.21.15.69:3300/0 conn(0x7f5830144cd0 msgr2=0x7f583014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5835195640 1 --2- 172.21.15.40:0/3941366872 >> v2:172.21.15.69:3300/0 conn(0x7f5830144cd0 0x7f583014e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5835195640 1 -- 172.21.15.40:0/3941366872 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300bc0a0 con 0x7f58300b64c0 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5835996640 1 --2- 172.21.15.40:0/3941366872 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58300b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5836197640 1 --2- 172.21.15.40:0/3941366872 >> v2:172.21.15.69:3300/0 conn(0x7f5830144cd0 0x7f583014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5835195640 1 --2- 172.21.15.40:0/3941366872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58300b64c0 0x7f5830144790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f58301486d0 tx=0x7f582402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d34efdb680d0456 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5834994640 1 -- 172.21.15.40:0/3941366872 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824030860 con 0x7f58300b64c0 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5834994640 1 -- 172.21.15.40:0/3941366872 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58240309c0 con 0x7f58300b64c0 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.756+0000 7f5834994640 1 -- 172.21.15.40:0/3941366872 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824030d50 con 0x7f58300b64c0 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 -- 172.21.15.40:0/3941366872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58300b64c0 msgr2=0x7f5830144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 --2- 172.21.15.40:0/3941366872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58300b64c0 0x7f5830144790 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f58301486d0 tx=0x7f582402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 -- 172.21.15.40:0/3941366872 shutdown_connections 2023-12-20T04:24:09.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 --2- 172.21.15.40:0/3941366872 >> v2:172.21.15.69:3300/0 conn(0x7f5830144cd0 0x7f583014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 --2- 172.21.15.40:0/3941366872 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58300b64c0 0x7f5830144790 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 --2- 172.21.15.40:0/3941366872 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58300b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 -- 172.21.15.40:0/3941366872 >> 172.21.15.40:0/3941366872 conn(0x7f5830071e60 msgr2=0x7f58300c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 -- 172.21.15.40:0/3941366872 shutdown_connections 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.757+0000 7f5837bfa640 1 -- 172.21.15.40:0/3941366872 wait complete. 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.758+0000 7f5837bfa640 1 Processor -- start 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.758+0000 7f5837bfa640 1 -- start start 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5837bfa640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58300b64c0 0x7f58301412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5837bfa640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58301df900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5837bfa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5830144cd0 0x7f583013e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5837bfa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58301417e0 con 0x7f5830144cd0 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5837bfa640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583014a360 con 0x7f58300b64c0 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5837bfa640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58301e2ed0 con 0x7f58300bcdd0 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5830144cd0 0x7f583013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5830144cd0 0x7f583013e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53220/0 (socket says 172.21.15.40:53220) 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 -- 172.21.15.40:0/1969571146 learned_addr learned my addr 172.21.15.40:0/1969571146 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5835195640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58301df900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5835996640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58300b64c0 0x7f58301412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 -- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 msgr2=0x7f58301df900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58301df900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 -- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58300b64c0 msgr2=0x7f58301412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58300b64c0 0x7f58301412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 -- 172.21.15.40:0/1969571146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240094d0 con 0x7f5830144cd0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.759+0000 7f5836197640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5830144cd0 0x7f583013e420 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f582000cd50 tx=0x7f582000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.760+0000 7f582e7fc640 1 -- 172.21.15.40:0/1969571146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000f680 con 0x7f5830144cd0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.760+0000 7f582e7fc640 1 -- 172.21.15.40:0/1969571146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582000f800 con 0x7f5830144cd0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.760+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58301e31b0 con 0x7f5830144cd0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.760+0000 7f582e7fc640 1 -- 172.21.15.40:0/1969571146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000fbb0 con 0x7f5830144cd0 2023-12-20T04:24:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.760+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58301e3770 con 0x7f5830144cd0 2023-12-20T04:24:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.761+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58301e3960 con 0x7f5830144cd0 2023-12-20T04:24:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.761+0000 7f582e7fc640 1 -- 172.21.15.40:0/1969571146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f582000b040 con 0x7f5830144cd0 2023-12-20T04:24:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.761+0000 7f582e7fc640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f581c06a430 0x7f581c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.762+0000 7f582e7fc640 1 -- 172.21.15.40:0/1969571146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5820089250 con 0x7f5830144cd0 2023-12-20T04:24:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.762+0000 7f5835996640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f581c06a430 0x7f581c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.762+0000 7f5835996640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f581c06a430 0x7f581c06c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f582800ab60 tx=0x7f5828008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.766+0000 7f582e7fc640 1 -- 172.21.15.40:0/1969571146 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5820054850 con 0x7f5830144cd0 2023-12-20T04:24:09.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.937+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58300b5500 con 0x7f581c06a430 2023-12-20T04:24:09.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.943+0000 7f582e7fc640 1 -- 172.21.15.40:0/1969571146 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249846 (secure 0 0 0) 0x7f582800c040 con 0x7f581c06a430 2023-12-20T04:24:09.947 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:09.948 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:24:09.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f581c06a430 msgr2=0x7f581c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f581c06a430 0x7f581c06c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f582800ab60 tx=0x7f5828008040 comp rx=0 tx=0).stop 2023-12-20T04:24:09.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5830144cd0 msgr2=0x7f583013e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:09.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5830144cd0 0x7f583013e420 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f582000cd50 tx=0x7f582000a650 comp rx=0 tx=0).stop 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 shutdown_connections 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f581c06a430 0x7f581c06c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5830144cd0 0x7f583013e420 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f58300bcdd0 0x7f58301df900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 --2- 172.21.15.40:0/1969571146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58300b64c0 0x7f58301412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 >> 172.21.15.40:0/1969571146 conn(0x7f5830071e60 msgr2=0x7f5830140730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 shutdown_connections 2023-12-20T04:24:09.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:09.946+0000 7f5837bfa640 1 -- 172.21.15.40:0/1969571146 wait complete. 2023-12-20T04:24:09.957 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-20T04:24:08.537082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219112,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":3579904,"data_stored":2053560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000895"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:05.550107+0000","last_change":"2023-12-20T04:24:05.550107+0000","last_active":"2023-12-20T04:24:05.550107+0000","last_peered":"2023-12-20T04:24:05.550107+0000","last_clean":"2023-12-20T04:24:05.550107+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:05.550107+0000","last_undegraded":"2023-12-20T04:24:05.550107+0000","last_fullsized":"2023-12-20T04:24:05.550107+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:24:04.545089+0000","last_change":"2023-12-20T04:24:04.545089+0000","last_active":"2023-12-20T04:24:04.545089+0000","last_peered":"2023-12-20T04:24:04.545089+0000","last_clean":"2023-12-20T04:24:04.545089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:24:04.545089+0000","last_undegraded":"2023-12-20T04:24:04.545089+0000","last_fullsized":"2023-12-20T04:24:04.545089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-20T04:23:59.256597+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:23:59.256597+0000","last_peered":"2023-12-20T04:23:59.256597+0000","last_clean":"2023-12-20T04:23:59.256597+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:23:59.256597+0000","last_undegraded":"2023-12-20T04:23:59.256597+0000","last_fullsized":"2023-12-20T04:23:59.256597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:24:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-20T04:24:09.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-20T04:24:09.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-12-20T04:24:09.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-20T04:24:09.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-12-20T04:24:09.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-12-20T04:24:09.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-20T04:24:09.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-20T04:24:09.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-20T04:24:09.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-20T04:24:09.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-20T04:24:09.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-20T04:24:09.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-12-20T04:24:09.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-12-20T04:24:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:05.550107+0000', 'last_change': '2023-12-20T04:24:05.550107+0000', 'last_active': '2023-12-20T04:24:05.550107+0000', 'last_peered': '2023-12-20T04:24:05.550107+0000', 'last_clean': '2023-12-20T04:24:05.550107+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:05.550107+0000', 'last_undegraded': '2023-12-20T04:24:05.550107+0000', 'last_fullsized': '2023-12-20T04:24:05.550107+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:05.550107+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-12-20T04:24:09.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:24:04.545089+0000', 'last_change': '2023-12-20T04:24:04.545089+0000', 'last_active': '2023-12-20T04:24:04.545089+0000', 'last_peered': '2023-12-20T04:24:04.545089+0000', 'last_clean': '2023-12-20T04:24:04.545089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:24:04.545089+0000', 'last_undegraded': '2023-12-20T04:24:04.545089+0000', 'last_fullsized': '2023-12-20T04:24:04.545089+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'last_clean_scrub_stamp': '2023-12-20T04:24:04.545089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:24:09.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-20T04:24:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.101+0000 7fb12f670640 1 Processor -- start 2023-12-20T04:24:10.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.101+0000 7fb12f670640 1 -- start start 2023-12-20T04:24:10.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12f670640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1280bab80 0x7fb12814b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12f670640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280b6da0 con 0x7fb1280b8b40 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12f670640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280b8090 con 0x7fb128144e30 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12f670640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12814afe0 con 0x7fb1280bab80 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12dc0d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb1280b8b40 0x7fb128155320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43110/0 (socket says 172.21.15.40:43110) 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12dc0d640 1 -- 172.21.15.40:0/388880952 learned_addr learned my addr 172.21.15.40:0/388880952 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12cc0b640 1 --2- 172.21.15.40:0/388880952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1280bab80 0x7fb12814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb11ffff640 1 -- 172.21.15.40:0/388880952 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294772545 0 0) 0x7fb124001490 con 0x7fb1280b8b40 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb11ffff640 1 -- 172.21.15.40:0/388880952 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb114003520 con 0x7fb1280b8b40 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb11ffff640 1 -- 172.21.15.40:0/388880952 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184966074 0 0) 0x7fb120001110 con 0x7fb128144e30 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb11ffff640 1 -- 172.21.15.40:0/388880952 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb124001490 con 0x7fb128144e30 2023-12-20T04:24:10.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12cc0b640 1 -- 172.21.15.40:0/388880952 >> v1:172.21.15.69:6789/0 conn(0x7fb128144e30 legacy=0x7fb1280b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12cc0b640 1 -- 172.21.15.40:0/388880952 >> v1:172.21.15.40:6789/0 conn(0x7fb1280b8b40 legacy=0x7fb128155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.102+0000 7fb12cc0b640 1 -- 172.21.15.40:0/388880952 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb128145210 con 0x7fb1280bab80 2023-12-20T04:24:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.103+0000 7fb12cc0b640 1 --2- 172.21.15.40:0/388880952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1280bab80 0x7fb12814b470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1180097c0 tx=0x7fb11802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a5f3525d7ba38e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.103+0000 7fb11ffff640 1 -- 172.21.15.40:0/388880952 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118030880 con 0x7fb1280bab80 2023-12-20T04:24:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.103+0000 7fb11ffff640 1 -- 172.21.15.40:0/388880952 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1180309e0 con 0x7fb1280bab80 2023-12-20T04:24:10.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb11ffff640 1 -- 172.21.15.40:0/388880952 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb118030d50 con 0x7fb1280bab80 2023-12-20T04:24:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb12f670640 1 -- 172.21.15.40:0/388880952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1280bab80 msgr2=0x7fb12814b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb12f670640 1 --2- 172.21.15.40:0/388880952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1280bab80 0x7fb12814b470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1180097c0 tx=0x7fb11802b9c0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb12f670640 1 -- 172.21.15.40:0/388880952 shutdown_connections 2023-12-20T04:24:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb12f670640 1 --2- 172.21.15.40:0/388880952 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb1280bab80 0x7fb12814b470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb12f670640 1 -- 172.21.15.40:0/388880952 >> 172.21.15.40:0/388880952 conn(0x7fb1280c0200 msgr2=0x7fb1280c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb12f670640 1 -- 172.21.15.40:0/388880952 shutdown_connections 2023-12-20T04:24:10.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.104+0000 7fb12f670640 1 -- 172.21.15.40:0/388880952 wait complete. 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.105+0000 7fb12f670640 1 Processor -- start 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.105+0000 7fb12f670640 1 -- start start 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12f670640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1280b8b40 0x7fb1280b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12f670640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1280bab80 0x7fb1280a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12f670640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb128144e30 0x7fb1280a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12f670640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b19c0 con 0x7fb1280bab80 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12f670640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280adf00 con 0x7fb1280b8b40 2023-12-20T04:24:10.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12f670640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280ae1e0 con 0x7fb128144e30 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1280bab80 0x7fb1280a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1280bab80 0x7fb1280a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53230/0 (socket says 172.21.15.40:53230) 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 -- 172.21.15.40:0/1593935383 learned_addr learned my addr 172.21.15.40:0/1593935383 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12d40c640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1280b8b40 0x7fb1280b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12dc0d640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb128144e30 0x7fb1280a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 -- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb128144e30 msgr2=0x7fb1280a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb128144e30 0x7fb1280a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 -- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1280b8b40 msgr2=0x7fb1280b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1280b8b40 0x7fb1280b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 -- 172.21.15.40:0/1593935383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1180093a0 con 0x7fb1280bab80 2023-12-20T04:24:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12d40c640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1280b8b40 0x7fb1280b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.106+0000 7fb12cc0b640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1280bab80 0x7fb1280a8ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb118000c00 tx=0x7fb118004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:10.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.107+0000 7fb11dffb640 1 -- 172.21.15.40:0/1593935383 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11803e040 con 0x7fb1280bab80 2023-12-20T04:24:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.107+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280ae4c0 con 0x7fb1280bab80 2023-12-20T04:24:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.107+0000 7fb11dffb640 1 -- 172.21.15.40:0/1593935383 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb118039c90 con 0x7fb1280bab80 2023-12-20T04:24:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.107+0000 7fb11dffb640 1 -- 172.21.15.40:0/1593935383 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180443f0 con 0x7fb1280bab80 2023-12-20T04:24:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.107+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1280aac90 con 0x7fb1280bab80 2023-12-20T04:24:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.108+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1280add60 con 0x7fb1280bab80 2023-12-20T04:24:10.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.108+0000 7fb11dffb640 1 -- 172.21.15.40:0/1593935383 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb11804d3f0 con 0x7fb1280bab80 2023-12-20T04:24:10.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.108+0000 7fb11dffb640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb10c06a430 0x7fb10c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.109+0000 7fb11dffb640 1 -- 172.21.15.40:0/1593935383 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1180aaea0 con 0x7fb1280bab80 2023-12-20T04:24:10.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.109+0000 7fb12d40c640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb10c06a430 0x7fb10c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.109+0000 7fb12d40c640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb10c06a430 0x7fb10c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb120001370 tx=0x7fb120009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:10.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.113+0000 7fb11dffb640 1 -- 172.21.15.40:0/1593935383 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb1280add60 con 0x7fb1280bab80 2023-12-20T04:24:10.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.357+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb1280add60 con 0x7fb1280bab80 2023-12-20T04:24:10.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.358+0000 7fb11dffb640 1 -- 172.21.15.40:0/1593935383 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2505 (secure 0 0 0) 0x7fb1180349e0 con 0x7fb1280bab80 2023-12-20T04:24:10.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:10.359 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":67,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1703046193,"num_in_osds":8,"osd_in_since":1703046184,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224370688,"bytes_avail":772869742592,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4932}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-12-20T04:24:08.537162+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-20T04:24:10.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb10c06a430 msgr2=0x7fb10c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb10c06a430 0x7fb10c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb120001370 tx=0x7fb120009040 comp rx=0 tx=0).stop 2023-12-20T04:24:10.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1280bab80 msgr2=0x7fb1280a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1280bab80 0x7fb1280a8ab0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb118000c00 tx=0x7fb118004730 comp rx=0 tx=0).stop 2023-12-20T04:24:10.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 shutdown_connections 2023-12-20T04:24:10.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb10c06a430 0x7fb10c06c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb128144e30 0x7fb1280a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1280bab80 0x7fb1280a8ab0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 --2- 172.21.15.40:0/1593935383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1280b8b40 0x7fb1280b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 >> 172.21.15.40:0/1593935383 conn(0x7fb1280c0200 msgr2=0x7fb1280b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:10.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 shutdown_connections 2023-12-20T04:24:10.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.360+0000 7fb12f670640 1 -- 172.21.15.40:0/1593935383 wait complete. 2023-12-20T04:24:10.371 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-20T04:24:10.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:24:10.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.476+0000 7f20ca28e640 1 Processor -- start 2023-12-20T04:24:10.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.476+0000 7f20ca28e640 1 -- start start 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20ca28e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20c40b6690 0x7f20c4144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20ca28e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c4144cd0 0x7f20c4155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20ca28e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c40bc6b0 con 0x7f20c40bcdd0 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20ca28e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20c40a59f0 con 0x7f20c40b6690 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20ca28e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c40bc0a0 con 0x7f20c4144cd0 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20c40b6690 0x7f20c4144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20c40b6690 0x7f20c4144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53242/0 (socket says 172.21.15.40:53242) 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c37fe640 1 -- 172.21.15.40:0/3662904179 learned_addr learned my addr 172.21.15.40:0/3662904179 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:10.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c882b640 1 --2- 172.21.15.40:0/3662904179 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c4144cd0 0x7f20c4155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c37fe640 1 -- 172.21.15.40:0/3662904179 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c4144cd0 msgr2=0x7f20c4155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c37fe640 1 --2- 172.21.15.40:0/3662904179 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c4144cd0 0x7f20c4155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c37fe640 1 -- 172.21.15.40:0/3662904179 >> v1:172.21.15.69:6789/0 conn(0x7f20c40bcdd0 legacy=0x7f20c40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c37fe640 1 -- 172.21.15.40:0/3662904179 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c40bc340 con 0x7f20c40b6690 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.477+0000 7f20c882b640 1 --2- 172.21.15.40:0/3662904179 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c4144cd0 0x7f20c4155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.478+0000 7f20c37fe640 1 --2- 172.21.15.40:0/3662904179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c40b6690 0x7f20c4144790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009870 tx=0x7f20b802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dd0f3166ad7255 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.478+0000 7f20c2ffd640 1 -- 172.21.15.40:0/3662904179 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8030840 con 0x7f20c40b6690 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.478+0000 7f20c2ffd640 1 -- 172.21.15.40:0/3662904179 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80309a0 con 0x7f20c40b6690 2023-12-20T04:24:10.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.478+0000 7f20c2ffd640 1 -- 172.21.15.40:0/3662904179 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8030d30 con 0x7f20c40b6690 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 -- 172.21.15.40:0/3662904179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c40b6690 msgr2=0x7f20c4144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 --2- 172.21.15.40:0/3662904179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c40b6690 0x7f20c4144790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009870 tx=0x7f20b802b980 comp rx=0 tx=0).stop 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 -- 172.21.15.40:0/3662904179 shutdown_connections 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 --2- 172.21.15.40:0/3662904179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c40b6690 0x7f20c4144790 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 --2- 172.21.15.40:0/3662904179 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c4144cd0 0x7f20c4155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 -- 172.21.15.40:0/3662904179 >> 172.21.15.40:0/3662904179 conn(0x7f20c4071e60 msgr2=0x7f20c40c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 -- 172.21.15.40:0/3662904179 shutdown_connections 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.479+0000 7f20ca28e640 1 -- 172.21.15.40:0/3662904179 wait complete. 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.480+0000 7f20ca28e640 1 Processor -- start 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.480+0000 7f20ca28e640 1 -- start start 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20ca28e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c40b6690 0x7f20c41d7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20ca28e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20c40bcdd0 0x7f20c414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20ca28e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4144cd0 0x7f20c4146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20ca28e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41d7a50 con 0x7f20c4144cd0 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20ca28e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c41497b0 con 0x7f20c40bcdd0 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20ca28e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c4140220 con 0x7f20c40b6690 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4144cd0 0x7f20c4146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4144cd0 0x7f20c4146730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53250/0 (socket says 172.21.15.40:53250) 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 -- 172.21.15.40:0/1737736746 learned_addr learned my addr 172.21.15.40:0/1737736746 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c3fff640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c40b6690 0x7f20c41d7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c37fe640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20c40bcdd0 0x7f20c414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 -- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c40b6690 msgr2=0x7f20c41d7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c40b6690 0x7f20c41d7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 -- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20c40bcdd0 msgr2=0x7f20c414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20c40bcdd0 0x7f20c414ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 -- 172.21.15.40:0/1737736746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80094d0 con 0x7f20c4144cd0 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c882b640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4144cd0 0x7f20c4146730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00cd50 tx=0x7f20bc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:10.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c0ff9640 1 -- 172.21.15.40:0/1737736746 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00f680 con 0x7f20c4144cd0 2023-12-20T04:24:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c0ff9640 1 -- 172.21.15.40:0/1737736746 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc00f800 con 0x7f20c4144cd0 2023-12-20T04:24:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c41491f0 con 0x7f20c4144cd0 2023-12-20T04:24:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.481+0000 7f20c0ff9640 1 -- 172.21.15.40:0/1737736746 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc00fbb0 con 0x7f20c4144cd0 2023-12-20T04:24:10.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.482+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c41df870 con 0x7f20c4144cd0 2023-12-20T04:24:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.483+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c40bbe70 con 0x7f20c4144cd0 2023-12-20T04:24:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.483+0000 7f20c0ff9640 1 -- 172.21.15.40:0/1737736746 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20bc00b040 con 0x7f20c4144cd0 2023-12-20T04:24:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.483+0000 7f20c0ff9640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f20b006a460 0x7f20b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.483+0000 7f20c0ff9640 1 -- 172.21.15.40:0/1737736746 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20bc089080 con 0x7f20c4144cd0 2023-12-20T04:24:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.484+0000 7f20c3fff640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f20b006a460 0x7f20b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:10.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.484+0000 7f20c3fff640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f20b006a460 0x7f20b006c920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20b4004f60 tx=0x7f20b4007e30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:10.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.488+0000 7f20c0ff9640 1 -- 172.21.15.40:0/1737736746 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f20bc0547b0 con 0x7f20c4144cd0 2023-12-20T04:24:10.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.658+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20c41df6f0 con 0x7f20b006a460 2023-12-20T04:24:10.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.665+0000 7f20c0ff9640 1 -- 172.21.15.40:0/1737736746 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264646 (secure 0 0 0) 0x7f20b4003940 con 0x7f20b006a460 2023-12-20T04:24:10.669 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:10.670 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:24:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f20b006a460 msgr2=0x7f20b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f20b006a460 0x7f20b006c920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20b4004f60 tx=0x7f20b4007e30 comp rx=0 tx=0).stop 2023-12-20T04:24:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4144cd0 msgr2=0x7f20c4146730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4144cd0 0x7f20c4146730 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00cd50 tx=0x7f20bc00a650 comp rx=0 tx=0).stop 2023-12-20T04:24:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 shutdown_connections 2023-12-20T04:24:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f20b006a460 0x7f20b006c920 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20c4144cd0 0x7f20c4146730 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20c40bcdd0 0x7f20c414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 --2- 172.21.15.40:0/1737736746 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f20c40b6690 0x7f20c41d7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:10.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 >> 172.21.15.40:0/1737736746 conn(0x7f20c4071e60 msgr2=0x7f20c40b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:10.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 shutdown_connections 2023-12-20T04:24:10.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:10.668+0000 7f20ca28e640 1 -- 172.21.15.40:0/1737736746 wait complete. 2023-12-20T04:24:10.680 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-12-20T04:24:10.537549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":4038656,"data_stored":2259556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.987043"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941073+0000","last_change":"2023-12-20T04:24:05.943744+0000","last_active":"2023-12-20T04:24:06.941073+0000","last_peered":"2023-12-20T04:24:06.941073+0000","last_clean":"2023-12-20T04:24:06.941073+0000","last_became_active":"2023-12-20T04:24:05.943462+0000","last_became_peered":"2023-12-20T04:24:05.943462+0000","last_unstale":"2023-12-20T04:24:06.941073+0000","last_undegraded":"2023-12-20T04:24:06.941073+0000","last_fullsized":"2023-12-20T04:24:06.941073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:03:08.432164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247529+0000","last_change":"2023-12-20T04:24:05.950597+0000","last_active":"2023-12-20T04:24:07.247529+0000","last_peered":"2023-12-20T04:24:07.247529+0000","last_clean":"2023-12-20T04:24:07.247529+0000","last_became_active":"2023-12-20T04:24:05.950267+0000","last_became_peered":"2023-12-20T04:24:05.950267+0000","last_unstale":"2023-12-20T04:24:07.247529+0000","last_undegraded":"2023-12-20T04:24:07.247529+0000","last_fullsized":"2023-12-20T04:24:07.247529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:03.033336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246836+0000","last_change":"2023-12-20T04:24:05.949471+0000","last_active":"2023-12-20T04:24:07.246836+0000","last_peered":"2023-12-20T04:24:07.246836+0000","last_clean":"2023-12-20T04:24:07.246836+0000","last_became_active":"2023-12-20T04:24:05.949205+0000","last_became_peered":"2023-12-20T04:24:05.949205+0000","last_unstale":"2023-12-20T04:24:07.246836+0000","last_undegraded":"2023-12-20T04:24:07.246836+0000","last_fullsized":"2023-12-20T04:24:07.246836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:03.633486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247469+0000","last_change":"2023-12-20T04:24:05.952003+0000","last_active":"2023-12-20T04:24:07.247469+0000","last_peered":"2023-12-20T04:24:07.247469+0000","last_clean":"2023-12-20T04:24:07.247469+0000","last_became_active":"2023-12-20T04:24:05.951724+0000","last_became_peered":"2023-12-20T04:24:05.951724+0000","last_unstale":"2023-12-20T04:24:07.247469+0000","last_undegraded":"2023-12-20T04:24:07.247469+0000","last_fullsized":"2023-12-20T04:24:07.247469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:24:52.250041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247437+0000","last_change":"2023-12-20T04:24:05.952187+0000","last_active":"2023-12-20T04:24:07.247437+0000","last_peered":"2023-12-20T04:24:07.247437+0000","last_clean":"2023-12-20T04:24:07.247437+0000","last_became_active":"2023-12-20T04:24:05.951920+0000","last_became_peered":"2023-12-20T04:24:05.951920+0000","last_unstale":"2023-12-20T04:24:07.247437+0000","last_undegraded":"2023-12-20T04:24:07.247437+0000","last_fullsized":"2023-12-20T04:24:07.247437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:33:27.878963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246790+0000","last_change":"2023-12-20T04:24:05.948542+0000","last_active":"2023-12-20T04:24:07.246790+0000","last_peered":"2023-12-20T04:24:07.246790+0000","last_clean":"2023-12-20T04:24:07.246790+0000","last_became_active":"2023-12-20T04:24:05.948298+0000","last_became_peered":"2023-12-20T04:24:05.948298+0000","last_unstale":"2023-12-20T04:24:07.246790+0000","last_undegraded":"2023-12-20T04:24:07.246790+0000","last_fullsized":"2023-12-20T04:24:07.246790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:27:47.704347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247219+0000","last_change":"2023-12-20T04:24:05.954913+0000","last_active":"2023-12-20T04:24:07.247219+0000","last_peered":"2023-12-20T04:24:07.247219+0000","last_clean":"2023-12-20T04:24:07.247219+0000","last_became_active":"2023-12-20T04:24:05.954462+0000","last_became_peered":"2023-12-20T04:24:05.954462+0000","last_unstale":"2023-12-20T04:24:07.247219+0000","last_undegraded":"2023-12-20T04:24:07.247219+0000","last_fullsized":"2023-12-20T04:24:07.247219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:43.654918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246557+0000","last_change":"2023-12-20T04:24:05.950578+0000","last_active":"2023-12-20T04:24:07.246557+0000","last_peered":"2023-12-20T04:24:07.246557+0000","last_clean":"2023-12-20T04:24:07.246557+0000","last_became_active":"2023-12-20T04:24:05.950217+0000","last_became_peered":"2023-12-20T04:24:05.950217+0000","last_unstale":"2023-12-20T04:24:07.246557+0000","last_undegraded":"2023-12-20T04:24:07.246557+0000","last_fullsized":"2023-12-20T04:24:07.246557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:56.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941512+0000","last_change":"2023-12-20T04:24:05.947988+0000","last_active":"2023-12-20T04:24:06.941512+0000","last_peered":"2023-12-20T04:24:06.941512+0000","last_clean":"2023-12-20T04:24:06.941512+0000","last_became_active":"2023-12-20T04:24:05.947510+0000","last_became_peered":"2023-12-20T04:24:05.947510+0000","last_unstale":"2023-12-20T04:24:06.941512+0000","last_undegraded":"2023-12-20T04:24:06.941512+0000","last_fullsized":"2023-12-20T04:24:06.941512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:42:04.007736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247300+0000","last_change":"2023-12-20T04:24:05.955723+0000","last_active":"2023-12-20T04:24:07.247300+0000","last_peered":"2023-12-20T04:24:07.247300+0000","last_clean":"2023-12-20T04:24:07.247300+0000","last_became_active":"2023-12-20T04:24:05.955443+0000","last_became_peered":"2023-12-20T04:24:05.955443+0000","last_unstale":"2023-12-20T04:24:07.247300+0000","last_undegraded":"2023-12-20T04:24:07.247300+0000","last_fullsized":"2023-12-20T04:24:07.247300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:56.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247397+0000","last_change":"2023-12-20T04:24:05.944985+0000","last_active":"2023-12-20T04:24:07.247397+0000","last_peered":"2023-12-20T04:24:07.247397+0000","last_clean":"2023-12-20T04:24:07.247397+0000","last_became_active":"2023-12-20T04:24:05.944744+0000","last_became_peered":"2023-12-20T04:24:05.944744+0000","last_unstale":"2023-12-20T04:24:07.247397+0000","last_undegraded":"2023-12-20T04:24:07.247397+0000","last_fullsized":"2023-12-20T04:24:07.247397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:03.633486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246715+0000","last_change":"2023-12-20T04:24:05.952010+0000","last_active":"2023-12-20T04:24:07.246715+0000","last_peered":"2023-12-20T04:24:07.246715+0000","last_clean":"2023-12-20T04:24:07.246715+0000","last_became_active":"2023-12-20T04:24:05.951736+0000","last_became_peered":"2023-12-20T04:24:05.951736+0000","last_unstale":"2023-12-20T04:24:07.246715+0000","last_undegraded":"2023-12-20T04:24:07.246715+0000","last_fullsized":"2023-12-20T04:24:07.246715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:56.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247520+0000","last_change":"2023-12-20T04:24:05.949867+0000","last_active":"2023-12-20T04:24:07.247520+0000","last_peered":"2023-12-20T04:24:07.247520+0000","last_clean":"2023-12-20T04:24:07.247520+0000","last_became_active":"2023-12-20T04:24:05.949075+0000","last_became_peered":"2023-12-20T04:24:05.949075+0000","last_unstale":"2023-12-20T04:24:07.247520+0000","last_undegraded":"2023-12-20T04:24:07.247520+0000","last_fullsized":"2023-12-20T04:24:07.247520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:26.840383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246884+0000","last_change":"2023-12-20T04:24:05.953008+0000","last_active":"2023-12-20T04:24:07.246884+0000","last_peered":"2023-12-20T04:24:07.246884+0000","last_clean":"2023-12-20T04:24:07.246884+0000","last_became_active":"2023-12-20T04:24:05.952619+0000","last_became_peered":"2023-12-20T04:24:05.952619+0000","last_unstale":"2023-12-20T04:24:07.246884+0000","last_undegraded":"2023-12-20T04:24:07.246884+0000","last_fullsized":"2023-12-20T04:24:07.246884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:54:21.841230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246745+0000","last_change":"2023-12-20T04:24:05.942827+0000","last_active":"2023-12-20T04:24:07.246745+0000","last_peered":"2023-12-20T04:24:07.246745+0000","last_clean":"2023-12-20T04:24:07.246745+0000","last_became_active":"2023-12-20T04:24:05.942523+0000","last_became_peered":"2023-12-20T04:24:05.942523+0000","last_unstale":"2023-12-20T04:24:07.246745+0000","last_undegraded":"2023-12-20T04:24:07.246745+0000","last_fullsized":"2023-12-20T04:24:07.246745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:09:00.273465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247124+0000","last_change":"2023-12-20T04:24:05.953173+0000","last_active":"2023-12-20T04:24:07.247124+0000","last_peered":"2023-12-20T04:24:07.247124+0000","last_clean":"2023-12-20T04:24:07.247124+0000","last_became_active":"2023-12-20T04:24:05.952910+0000","last_became_peered":"2023-12-20T04:24:05.952910+0000","last_unstale":"2023-12-20T04:24:07.247124+0000","last_undegraded":"2023-12-20T04:24:07.247124+0000","last_fullsized":"2023-12-20T04:24:07.247124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:54:21.841230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247451+0000","last_change":"2023-12-20T04:24:05.955140+0000","last_active":"2023-12-20T04:24:07.247451+0000","last_peered":"2023-12-20T04:24:07.247451+0000","last_clean":"2023-12-20T04:24:07.247451+0000","last_became_active":"2023-12-20T04:24:05.954516+0000","last_became_peered":"2023-12-20T04:24:05.954516+0000","last_unstale":"2023-12-20T04:24:07.247451+0000","last_undegraded":"2023-12-20T04:24:07.247451+0000","last_fullsized":"2023-12-20T04:24:07.247451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:04.945194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247557+0000","last_change":"2023-12-20T04:24:05.956100+0000","last_active":"2023-12-20T04:24:07.247557+0000","last_peered":"2023-12-20T04:24:07.247557+0000","last_clean":"2023-12-20T04:24:07.247557+0000","last_became_active":"2023-12-20T04:24:05.955740+0000","last_became_peered":"2023-12-20T04:24:05.955740+0000","last_unstale":"2023-12-20T04:24:07.247557+0000","last_undegraded":"2023-12-20T04:24:07.247557+0000","last_fullsized":"2023-12-20T04:24:07.247557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:30.303761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246909+0000","last_change":"2023-12-20T04:24:05.955954+0000","last_active":"2023-12-20T04:24:07.246909+0000","last_peered":"2023-12-20T04:24:07.246909+0000","last_clean":"2023-12-20T04:24:07.246909+0000","last_became_active":"2023-12-20T04:24:05.955329+0000","last_became_peered":"2023-12-20T04:24:05.955329+0000","last_unstale":"2023-12-20T04:24:07.246909+0000","last_undegraded":"2023-12-20T04:24:07.246909+0000","last_fullsized":"2023-12-20T04:24:07.246909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:04:51.540720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247240+0000","last_change":"2023-12-20T04:24:05.948835+0000","last_active":"2023-12-20T04:24:07.247240+0000","last_peered":"2023-12-20T04:24:07.247240+0000","last_clean":"2023-12-20T04:24:07.247240+0000","last_became_active":"2023-12-20T04:24:05.948586+0000","last_became_peered":"2023-12-20T04:24:05.948586+0000","last_unstale":"2023-12-20T04:24:07.247240+0000","last_undegraded":"2023-12-20T04:24:07.247240+0000","last_fullsized":"2023-12-20T04:24:07.247240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:02:51.786360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941621+0000","last_change":"2023-12-20T04:24:05.950008+0000","last_active":"2023-12-20T04:24:06.941621+0000","last_peered":"2023-12-20T04:24:06.941621+0000","last_clean":"2023-12-20T04:24:06.941621+0000","last_became_active":"2023-12-20T04:24:05.949727+0000","last_became_peered":"2023-12-20T04:24:05.949727+0000","last_unstale":"2023-12-20T04:24:06.941621+0000","last_undegraded":"2023-12-20T04:24:06.941621+0000","last_fullsized":"2023-12-20T04:24:06.941621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:50:05.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941495+0000","last_change":"2023-12-20T04:24:05.948202+0000","last_active":"2023-12-20T04:24:06.941495+0000","last_peered":"2023-12-20T04:24:06.941495+0000","last_clean":"2023-12-20T04:24:06.941495+0000","last_became_active":"2023-12-20T04:24:05.947930+0000","last_became_peered":"2023-12-20T04:24:05.947930+0000","last_unstale":"2023-12-20T04:24:06.941495+0000","last_undegraded":"2023-12-20T04:24:06.941495+0000","last_fullsized":"2023-12-20T04:24:06.941495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:56.432999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941792+0000","last_change":"2023-12-20T04:24:05.948036+0000","last_active":"2023-12-20T04:24:06.941792+0000","last_peered":"2023-12-20T04:24:06.941792+0000","last_clean":"2023-12-20T04:24:06.941792+0000","last_became_active":"2023-12-20T04:24:05.947769+0000","last_became_peered":"2023-12-20T04:24:05.947769+0000","last_unstale":"2023-12-20T04:24:06.941792+0000","last_undegraded":"2023-12-20T04:24:06.941792+0000","last_fullsized":"2023-12-20T04:24:06.941792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:56.432999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246497+0000","last_change":"2023-12-20T04:24:05.950309+0000","last_active":"2023-12-20T04:24:07.246497+0000","last_peered":"2023-12-20T04:24:07.246497+0000","last_clean":"2023-12-20T04:24:07.246497+0000","last_became_active":"2023-12-20T04:24:05.950038+0000","last_became_peered":"2023-12-20T04:24:05.950038+0000","last_unstale":"2023-12-20T04:24:07.246497+0000","last_undegraded":"2023-12-20T04:24:07.246497+0000","last_fullsized":"2023-12-20T04:24:07.246497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:43.654918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247369+0000","last_change":"2023-12-20T04:24:05.946298+0000","last_active":"2023-12-20T04:24:07.247369+0000","last_peered":"2023-12-20T04:24:07.247369+0000","last_clean":"2023-12-20T04:24:07.247369+0000","last_became_active":"2023-12-20T04:24:05.945917+0000","last_became_peered":"2023-12-20T04:24:05.945917+0000","last_unstale":"2023-12-20T04:24:07.247369+0000","last_undegraded":"2023-12-20T04:24:07.247369+0000","last_fullsized":"2023-12-20T04:24:07.247369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247645+0000","last_change":"2023-12-20T04:24:05.951741+0000","last_active":"2023-12-20T04:24:07.247645+0000","last_peered":"2023-12-20T04:24:07.247645+0000","last_clean":"2023-12-20T04:24:07.247645+0000","last_became_active":"2023-12-20T04:24:05.951485+0000","last_became_peered":"2023-12-20T04:24:05.951485+0000","last_unstale":"2023-12-20T04:24:07.247645+0000","last_undegraded":"2023-12-20T04:24:07.247645+0000","last_fullsized":"2023-12-20T04:24:07.247645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:53:35.066896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247900+0000","last_change":"2023-12-20T04:24:05.953311+0000","last_active":"2023-12-20T04:24:07.247900+0000","last_peered":"2023-12-20T04:24:07.247900+0000","last_clean":"2023-12-20T04:24:07.247900+0000","last_became_active":"2023-12-20T04:24:05.952914+0000","last_became_peered":"2023-12-20T04:24:05.952914+0000","last_unstale":"2023-12-20T04:24:07.247900+0000","last_undegraded":"2023-12-20T04:24:07.247900+0000","last_fullsized":"2023-12-20T04:24:07.247900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:22:10.103879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246759+0000","last_change":"2023-12-20T04:24:05.946301+0000","last_active":"2023-12-20T04:24:07.246759+0000","last_peered":"2023-12-20T04:24:07.246759+0000","last_clean":"2023-12-20T04:24:07.246759+0000","last_became_active":"2023-12-20T04:24:05.946047+0000","last_became_peered":"2023-12-20T04:24:05.946047+0000","last_unstale":"2023-12-20T04:24:07.246759+0000","last_undegraded":"2023-12-20T04:24:07.246759+0000","last_fullsized":"2023-12-20T04:24:07.246759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:16:13.409966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941531+0000","last_change":"2023-12-20T04:24:05.952034+0000","last_active":"2023-12-20T04:24:06.941531+0000","last_peered":"2023-12-20T04:24:06.941531+0000","last_clean":"2023-12-20T04:24:06.941531+0000","last_became_active":"2023-12-20T04:24:05.951765+0000","last_became_peered":"2023-12-20T04:24:05.951765+0000","last_unstale":"2023-12-20T04:24:06.941531+0000","last_undegraded":"2023-12-20T04:24:06.941531+0000","last_fullsized":"2023-12-20T04:24:06.941531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:14.344584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247230+0000","last_change":"2023-12-20T04:24:05.944487+0000","last_active":"2023-12-20T04:24:07.247230+0000","last_peered":"2023-12-20T04:24:07.247230+0000","last_clean":"2023-12-20T04:24:07.247230+0000","last_became_active":"2023-12-20T04:24:05.944209+0000","last_became_peered":"2023-12-20T04:24:05.944209+0000","last_unstale":"2023-12-20T04:24:07.247230+0000","last_undegraded":"2023-12-20T04:24:07.247230+0000","last_fullsized":"2023-12-20T04:24:07.247230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:16:13.409966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940747+0000","last_change":"2023-12-20T04:24:05.949313+0000","last_active":"2023-12-20T04:24:06.940747+0000","last_peered":"2023-12-20T04:24:06.940747+0000","last_clean":"2023-12-20T04:24:06.940747+0000","last_became_active":"2023-12-20T04:24:05.949065+0000","last_became_peered":"2023-12-20T04:24:05.949065+0000","last_unstale":"2023-12-20T04:24:06.940747+0000","last_undegraded":"2023-12-20T04:24:06.940747+0000","last_fullsized":"2023-12-20T04:24:06.940747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:18.197708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246723+0000","last_change":"2023-12-20T04:24:05.952517+0000","last_active":"2023-12-20T04:24:07.246723+0000","last_peered":"2023-12-20T04:24:07.246723+0000","last_clean":"2023-12-20T04:24:07.246723+0000","last_became_active":"2023-12-20T04:24:05.952166+0000","last_became_peered":"2023-12-20T04:24:05.952166+0000","last_unstale":"2023-12-20T04:24:07.246723+0000","last_undegraded":"2023-12-20T04:24:07.246723+0000","last_fullsized":"2023-12-20T04:24:07.246723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:27:47.704347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942013+0000","last_change":"2023-12-20T04:24:05.946482+0000","last_active":"2023-12-20T04:24:06.942013+0000","last_peered":"2023-12-20T04:24:06.942013+0000","last_clean":"2023-12-20T04:24:06.942013+0000","last_became_active":"2023-12-20T04:24:05.946237+0000","last_became_peered":"2023-12-20T04:24:05.946237+0000","last_unstale":"2023-12-20T04:24:06.942013+0000","last_undegraded":"2023-12-20T04:24:06.942013+0000","last_fullsized":"2023-12-20T04:24:06.942013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:18.197708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941264+0000","last_change":"2023-12-20T04:24:05.570802+0000","last_active":"2023-12-20T04:24:06.941264+0000","last_peered":"2023-12-20T04:24:06.941264+0000","last_clean":"2023-12-20T04:24:06.941264+0000","last_became_active":"2023-12-20T04:24:05.570500+0000","last_became_peered":"2023-12-20T04:24:05.570500+0000","last_unstale":"2023-12-20T04:24:06.941264+0000","last_undegraded":"2023-12-20T04:24:06.941264+0000","last_fullsized":"2023-12-20T04:24:06.941264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:47.304242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941177+0000","last_change":"2023-12-20T04:24:05.941390+0000","last_active":"2023-12-20T04:24:06.941177+0000","last_peered":"2023-12-20T04:24:06.941177+0000","last_clean":"2023-12-20T04:24:06.941177+0000","last_became_active":"2023-12-20T04:24:05.941096+0000","last_became_peered":"2023-12-20T04:24:05.941096+0000","last_unstale":"2023-12-20T04:24:06.941177+0000","last_undegraded":"2023-12-20T04:24:06.941177+0000","last_fullsized":"2023-12-20T04:24:06.941177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:42:04.007736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941976+0000","last_change":"2023-12-20T04:24:05.574867+0000","last_active":"2023-12-20T04:24:06.941976+0000","last_peered":"2023-12-20T04:24:06.941976+0000","last_clean":"2023-12-20T04:24:06.941976+0000","last_became_active":"2023-12-20T04:24:05.574612+0000","last_became_peered":"2023-12-20T04:24:05.574612+0000","last_unstale":"2023-12-20T04:24:06.941976+0000","last_undegraded":"2023-12-20T04:24:06.941976+0000","last_fullsized":"2023-12-20T04:24:06.941976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:22.752853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941764+0000","last_change":"2023-12-20T04:24:05.951999+0000","last_active":"2023-12-20T04:24:06.941764+0000","last_peered":"2023-12-20T04:24:06.941764+0000","last_clean":"2023-12-20T04:24:06.941764+0000","last_became_active":"2023-12-20T04:24:05.951732+0000","last_became_peered":"2023-12-20T04:24:05.951732+0000","last_unstale":"2023-12-20T04:24:06.941764+0000","last_undegraded":"2023-12-20T04:24:06.941764+0000","last_fullsized":"2023-12-20T04:24:06.941764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:18.197708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247004+0000","last_change":"2023-12-20T04:24:05.571494+0000","last_active":"2023-12-20T04:24:07.247004+0000","last_peered":"2023-12-20T04:24:07.247004+0000","last_clean":"2023-12-20T04:24:07.247004+0000","last_became_active":"2023-12-20T04:24:05.571210+0000","last_became_peered":"2023-12-20T04:24:05.571210+0000","last_unstale":"2023-12-20T04:24:07.247004+0000","last_undegraded":"2023-12-20T04:24:07.247004+0000","last_fullsized":"2023-12-20T04:24:07.247004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:13.339567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247961+0000","last_change":"2023-12-20T04:24:05.953145+0000","last_active":"2023-12-20T04:24:07.247961+0000","last_peered":"2023-12-20T04:24:07.247961+0000","last_clean":"2023-12-20T04:24:07.247961+0000","last_became_active":"2023-12-20T04:24:05.952603+0000","last_became_peered":"2023-12-20T04:24:05.952603+0000","last_unstale":"2023-12-20T04:24:07.247961+0000","last_undegraded":"2023-12-20T04:24:07.247961+0000","last_fullsized":"2023-12-20T04:24:07.247961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:09:00.273465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247322+0000","last_change":"2023-12-20T04:24:05.577787+0000","last_active":"2023-12-20T04:24:07.247322+0000","last_peered":"2023-12-20T04:24:07.247322+0000","last_clean":"2023-12-20T04:24:07.247322+0000","last_became_active":"2023-12-20T04:24:05.577455+0000","last_became_peered":"2023-12-20T04:24:05.577455+0000","last_unstale":"2023-12-20T04:24:07.247322+0000","last_undegraded":"2023-12-20T04:24:07.247322+0000","last_fullsized":"2023-12-20T04:24:07.247322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:10.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247319+0000","last_change":"2023-12-20T04:24:05.948230+0000","last_active":"2023-12-20T04:24:07.247319+0000","last_peered":"2023-12-20T04:24:07.247319+0000","last_clean":"2023-12-20T04:24:07.247319+0000","last_became_active":"2023-12-20T04:24:05.947759+0000","last_became_peered":"2023-12-20T04:24:05.947759+0000","last_unstale":"2023-12-20T04:24:07.247319+0000","last_undegraded":"2023-12-20T04:24:07.247319+0000","last_fullsized":"2023-12-20T04:24:07.247319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:24:52.250041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941730+0000","last_change":"2023-12-20T04:24:05.572598+0000","last_active":"2023-12-20T04:24:06.941730+0000","last_peered":"2023-12-20T04:24:06.941730+0000","last_clean":"2023-12-20T04:24:06.941730+0000","last_became_active":"2023-12-20T04:24:05.572244+0000","last_became_peered":"2023-12-20T04:24:05.572244+0000","last_unstale":"2023-12-20T04:24:06.941730+0000","last_undegraded":"2023-12-20T04:24:06.941730+0000","last_fullsized":"2023-12-20T04:24:06.941730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:44:54.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246634+0000","last_change":"2023-12-20T04:24:05.946914+0000","last_active":"2023-12-20T04:24:07.246634+0000","last_peered":"2023-12-20T04:24:07.246634+0000","last_clean":"2023-12-20T04:24:07.246634+0000","last_became_active":"2023-12-20T04:24:05.946636+0000","last_became_peered":"2023-12-20T04:24:05.946636+0000","last_unstale":"2023-12-20T04:24:07.246634+0000","last_undegraded":"2023-12-20T04:24:07.246634+0000","last_fullsized":"2023-12-20T04:24:07.246634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:21:45.902052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941553+0000","last_change":"2023-12-20T04:24:05.569682+0000","last_active":"2023-12-20T04:24:06.941553+0000","last_peered":"2023-12-20T04:24:06.941553+0000","last_clean":"2023-12-20T04:24:06.941553+0000","last_became_active":"2023-12-20T04:24:05.569434+0000","last_became_peered":"2023-12-20T04:24:05.569434+0000","last_unstale":"2023-12-20T04:24:06.941553+0000","last_undegraded":"2023-12-20T04:24:06.941553+0000","last_fullsized":"2023-12-20T04:24:06.941553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:33:26.873946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941124+0000","last_change":"2023-12-20T04:24:05.939236+0000","last_active":"2023-12-20T04:24:06.941124+0000","last_peered":"2023-12-20T04:24:06.941124+0000","last_clean":"2023-12-20T04:24:06.941124+0000","last_became_active":"2023-12-20T04:24:05.937076+0000","last_became_peered":"2023-12-20T04:24:05.937076+0000","last_unstale":"2023-12-20T04:24:06.941124+0000","last_undegraded":"2023-12-20T04:24:06.941124+0000","last_fullsized":"2023-12-20T04:24:06.941124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:54.057510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247336+0000","last_change":"2023-12-20T04:24:05.568411+0000","last_active":"2023-12-20T04:24:07.247336+0000","last_peered":"2023-12-20T04:24:07.247336+0000","last_clean":"2023-12-20T04:24:07.247336+0000","last_became_active":"2023-12-20T04:24:05.568082+0000","last_became_peered":"2023-12-20T04:24:05.568082+0000","last_unstale":"2023-12-20T04:24:07.247336+0000","last_undegraded":"2023-12-20T04:24:07.247336+0000","last_fullsized":"2023-12-20T04:24:07.247336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:17.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246522+0000","last_change":"2023-12-20T04:24:05.943163+0000","last_active":"2023-12-20T04:24:07.246522+0000","last_peered":"2023-12-20T04:24:07.246522+0000","last_clean":"2023-12-20T04:24:07.246522+0000","last_became_active":"2023-12-20T04:24:05.942879+0000","last_became_peered":"2023-12-20T04:24:05.942879+0000","last_unstale":"2023-12-20T04:24:07.246522+0000","last_undegraded":"2023-12-20T04:24:07.246522+0000","last_fullsized":"2023-12-20T04:24:07.246522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:14.344584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941524+0000","last_change":"2023-12-20T04:24:05.566884+0000","last_active":"2023-12-20T04:24:06.941524+0000","last_peered":"2023-12-20T04:24:06.941524+0000","last_clean":"2023-12-20T04:24:06.941524+0000","last_became_active":"2023-12-20T04:24:05.566609+0000","last_became_peered":"2023-12-20T04:24:05.566609+0000","last_unstale":"2023-12-20T04:24:06.941524+0000","last_undegraded":"2023-12-20T04:24:06.941524+0000","last_fullsized":"2023-12-20T04:24:06.941524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:02.782164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247003+0000","last_change":"2023-12-20T04:24:05.952616+0000","last_active":"2023-12-20T04:24:07.247003+0000","last_peered":"2023-12-20T04:24:07.247003+0000","last_clean":"2023-12-20T04:24:07.247003+0000","last_became_active":"2023-12-20T04:24:05.952350+0000","last_became_peered":"2023-12-20T04:24:05.952350+0000","last_unstale":"2023-12-20T04:24:07.247003+0000","last_undegraded":"2023-12-20T04:24:07.247003+0000","last_fullsized":"2023-12-20T04:24:07.247003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246836+0000","last_change":"2023-12-20T04:24:05.575704+0000","last_active":"2023-12-20T04:24:07.246836+0000","last_peered":"2023-12-20T04:24:07.246836+0000","last_clean":"2023-12-20T04:24:07.246836+0000","last_became_active":"2023-12-20T04:24:05.575453+0000","last_became_peered":"2023-12-20T04:24:05.575453+0000","last_unstale":"2023-12-20T04:24:07.246836+0000","last_undegraded":"2023-12-20T04:24:07.246836+0000","last_fullsized":"2023-12-20T04:24:07.246836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:55.427981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246756+0000","last_change":"2023-12-20T04:24:05.957017+0000","last_active":"2023-12-20T04:24:07.246756+0000","last_peered":"2023-12-20T04:24:07.246756+0000","last_clean":"2023-12-20T04:24:07.246756+0000","last_became_active":"2023-12-20T04:24:05.956765+0000","last_became_peered":"2023-12-20T04:24:05.956765+0000","last_unstale":"2023-12-20T04:24:07.246756+0000","last_undegraded":"2023-12-20T04:24:07.246756+0000","last_fullsized":"2023-12-20T04:24:07.246756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942057+0000","last_change":"2023-12-20T04:24:05.572557+0000","last_active":"2023-12-20T04:24:06.942057+0000","last_peered":"2023-12-20T04:24:06.942057+0000","last_clean":"2023-12-20T04:24:06.942057+0000","last_became_active":"2023-12-20T04:24:05.572245+0000","last_became_peered":"2023-12-20T04:24:05.572245+0000","last_unstale":"2023-12-20T04:24:06.942057+0000","last_undegraded":"2023-12-20T04:24:06.942057+0000","last_fullsized":"2023-12-20T04:24:06.942057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:47.304242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247294+0000","last_change":"2023-12-20T04:24:05.952489+0000","last_active":"2023-12-20T04:24:07.247294+0000","last_peered":"2023-12-20T04:24:07.247294+0000","last_clean":"2023-12-20T04:24:07.247294+0000","last_became_active":"2023-12-20T04:24:05.952141+0000","last_became_peered":"2023-12-20T04:24:05.952141+0000","last_unstale":"2023-12-20T04:24:07.247294+0000","last_undegraded":"2023-12-20T04:24:07.247294+0000","last_fullsized":"2023-12-20T04:24:07.247294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:31:46.773495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246894+0000","last_change":"2023-12-20T04:24:05.575208+0000","last_active":"2023-12-20T04:24:07.246894+0000","last_peered":"2023-12-20T04:24:07.246894+0000","last_clean":"2023-12-20T04:24:07.246894+0000","last_became_active":"2023-12-20T04:24:05.573791+0000","last_became_peered":"2023-12-20T04:24:05.573791+0000","last_unstale":"2023-12-20T04:24:07.246894+0000","last_undegraded":"2023-12-20T04:24:07.246894+0000","last_fullsized":"2023-12-20T04:24:07.246894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:55.427981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246798+0000","last_change":"2023-12-20T04:24:05.950365+0000","last_active":"2023-12-20T04:24:07.246798+0000","last_peered":"2023-12-20T04:24:07.246798+0000","last_clean":"2023-12-20T04:24:07.246798+0000","last_became_active":"2023-12-20T04:24:05.950108+0000","last_became_peered":"2023-12-20T04:24:05.950108+0000","last_unstale":"2023-12-20T04:24:07.246798+0000","last_undegraded":"2023-12-20T04:24:07.246798+0000","last_fullsized":"2023-12-20T04:24:07.246798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:27:47.704347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247381+0000","last_change":"2023-12-20T04:24:05.572507+0000","last_active":"2023-12-20T04:24:07.247381+0000","last_peered":"2023-12-20T04:24:07.247381+0000","last_clean":"2023-12-20T04:24:07.247381+0000","last_became_active":"2023-12-20T04:24:05.571607+0000","last_became_peered":"2023-12-20T04:24:05.571607+0000","last_unstale":"2023-12-20T04:24:07.247381+0000","last_undegraded":"2023-12-20T04:24:07.247381+0000","last_fullsized":"2023-12-20T04:24:07.247381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:11.239866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246517+0000","last_change":"2023-12-20T04:24:05.943277+0000","last_active":"2023-12-20T04:24:07.246517+0000","last_peered":"2023-12-20T04:24:07.246517+0000","last_clean":"2023-12-20T04:24:07.246517+0000","last_became_active":"2023-12-20T04:24:05.943026+0000","last_became_peered":"2023-12-20T04:24:05.943026+0000","last_unstale":"2023-12-20T04:24:07.246517+0000","last_undegraded":"2023-12-20T04:24:07.246517+0000","last_fullsized":"2023-12-20T04:24:07.246517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:57:19.326122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941703+0000","last_change":"2023-12-20T04:24:05.567962+0000","last_active":"2023-12-20T04:24:06.941703+0000","last_peered":"2023-12-20T04:24:06.941703+0000","last_clean":"2023-12-20T04:24:06.941703+0000","last_became_active":"2023-12-20T04:24:05.567606+0000","last_became_peered":"2023-12-20T04:24:05.567606+0000","last_unstale":"2023-12-20T04:24:06.941703+0000","last_undegraded":"2023-12-20T04:24:06.941703+0000","last_fullsized":"2023-12-20T04:24:06.941703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:48:55.322826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247087+0000","last_change":"2023-12-20T04:24:05.947342+0000","last_active":"2023-12-20T04:24:07.247087+0000","last_peered":"2023-12-20T04:24:07.247087+0000","last_clean":"2023-12-20T04:24:07.247087+0000","last_became_active":"2023-12-20T04:24:05.947091+0000","last_became_peered":"2023-12-20T04:24:05.947091+0000","last_unstale":"2023-12-20T04:24:07.247087+0000","last_undegraded":"2023-12-20T04:24:07.247087+0000","last_fullsized":"2023-12-20T04:24:07.247087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:16:13.409966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246593+0000","last_change":"2023-12-20T04:24:05.573782+0000","last_active":"2023-12-20T04:24:07.246593+0000","last_peered":"2023-12-20T04:24:07.246593+0000","last_clean":"2023-12-20T04:24:07.246593+0000","last_became_active":"2023-12-20T04:24:05.573514+0000","last_became_peered":"2023-12-20T04:24:05.573514+0000","last_unstale":"2023-12-20T04:24:07.246593+0000","last_undegraded":"2023-12-20T04:24:07.246593+0000","last_fullsized":"2023-12-20T04:24:07.246593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:31:46.635483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246890+0000","last_change":"2023-12-20T04:24:05.952252+0000","last_active":"2023-12-20T04:24:07.246890+0000","last_peered":"2023-12-20T04:24:07.246890+0000","last_clean":"2023-12-20T04:24:07.246890+0000","last_became_active":"2023-12-20T04:24:05.952008+0000","last_became_peered":"2023-12-20T04:24:05.952008+0000","last_unstale":"2023-12-20T04:24:07.246890+0000","last_undegraded":"2023-12-20T04:24:07.246890+0000","last_fullsized":"2023-12-20T04:24:07.246890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:03.033336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247411+0000","last_change":"2023-12-20T04:24:05.574526+0000","last_active":"2023-12-20T04:24:07.247411+0000","last_peered":"2023-12-20T04:24:07.247411+0000","last_clean":"2023-12-20T04:24:07.247411+0000","last_became_active":"2023-12-20T04:24:05.574025+0000","last_became_peered":"2023-12-20T04:24:05.574025+0000","last_unstale":"2023-12-20T04:24:07.247411+0000","last_undegraded":"2023-12-20T04:24:07.247411+0000","last_fullsized":"2023-12-20T04:24:07.247411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:50:04.824071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940843+0000","last_change":"2023-12-20T04:24:05.938739+0000","last_active":"2023-12-20T04:24:06.940843+0000","last_peered":"2023-12-20T04:24:06.940843+0000","last_clean":"2023-12-20T04:24:06.940843+0000","last_became_active":"2023-12-20T04:24:05.938480+0000","last_became_peered":"2023-12-20T04:24:05.938480+0000","last_unstale":"2023-12-20T04:24:06.940843+0000","last_undegraded":"2023-12-20T04:24:06.940843+0000","last_fullsized":"2023-12-20T04:24:06.940843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:14.344584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247013+0000","last_change":"2023-12-20T04:24:05.570961+0000","last_active":"2023-12-20T04:24:07.247013+0000","last_peered":"2023-12-20T04:24:07.247013+0000","last_clean":"2023-12-20T04:24:07.247013+0000","last_became_active":"2023-12-20T04:24:05.570548+0000","last_became_peered":"2023-12-20T04:24:05.570548+0000","last_unstale":"2023-12-20T04:24:07.247013+0000","last_undegraded":"2023-12-20T04:24:07.247013+0000","last_fullsized":"2023-12-20T04:24:07.247013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:03:07.427147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941493+0000","last_change":"2023-12-20T04:24:05.944764+0000","last_active":"2023-12-20T04:24:06.941493+0000","last_peered":"2023-12-20T04:24:06.941493+0000","last_clean":"2023-12-20T04:24:06.941493+0000","last_became_active":"2023-12-20T04:24:05.944513+0000","last_became_peered":"2023-12-20T04:24:05.944513+0000","last_unstale":"2023-12-20T04:24:06.941493+0000","last_undegraded":"2023-12-20T04:24:06.941493+0000","last_fullsized":"2023-12-20T04:24:06.941493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:03:08.432164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247523+0000","last_change":"2023-12-20T04:24:05.575660+0000","last_active":"2023-12-20T04:24:07.247523+0000","last_peered":"2023-12-20T04:24:07.247523+0000","last_clean":"2023-12-20T04:24:07.247523+0000","last_became_active":"2023-12-20T04:24:05.575390+0000","last_became_peered":"2023-12-20T04:24:05.575390+0000","last_unstale":"2023-12-20T04:24:07.247523+0000","last_undegraded":"2023-12-20T04:24:07.247523+0000","last_fullsized":"2023-12-20T04:24:07.247523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:06.440566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246996+0000","last_change":"2023-12-20T04:24:05.955630+0000","last_active":"2023-12-20T04:24:07.246996+0000","last_peered":"2023-12-20T04:24:07.246996+0000","last_clean":"2023-12-20T04:24:07.246996+0000","last_became_active":"2023-12-20T04:24:05.955360+0000","last_became_peered":"2023-12-20T04:24:05.955360+0000","last_unstale":"2023-12-20T04:24:07.246996+0000","last_undegraded":"2023-12-20T04:24:07.246996+0000","last_fullsized":"2023-12-20T04:24:07.246996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:03.033336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941474+0000","last_change":"2023-12-20T04:24:05.574296+0000","last_active":"2023-12-20T04:24:06.941474+0000","last_peered":"2023-12-20T04:24:06.941474+0000","last_clean":"2023-12-20T04:24:06.941474+0000","last_became_active":"2023-12-20T04:24:05.573840+0000","last_became_peered":"2023-12-20T04:24:05.573840+0000","last_unstale":"2023-12-20T04:24:06.941474+0000","last_undegraded":"2023-12-20T04:24:06.941474+0000","last_fullsized":"2023-12-20T04:24:06.941474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:02:52.300898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247561+0000","last_change":"2023-12-20T04:24:05.946303+0000","last_active":"2023-12-20T04:24:07.247561+0000","last_peered":"2023-12-20T04:24:07.247561+0000","last_clean":"2023-12-20T04:24:07.247561+0000","last_became_active":"2023-12-20T04:24:05.946038+0000","last_became_peered":"2023-12-20T04:24:05.946038+0000","last_unstale":"2023-12-20T04:24:07.247561+0000","last_undegraded":"2023-12-20T04:24:07.247561+0000","last_fullsized":"2023-12-20T04:24:07.247561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:28:03.325280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941552+0000","last_change":"2023-12-20T04:24:05.572704+0000","last_active":"2023-12-20T04:24:06.941552+0000","last_peered":"2023-12-20T04:24:06.941552+0000","last_clean":"2023-12-20T04:24:06.941552+0000","last_became_active":"2023-12-20T04:24:05.572069+0000","last_became_peered":"2023-12-20T04:24:05.572069+0000","last_unstale":"2023-12-20T04:24:06.941552+0000","last_undegraded":"2023-12-20T04:24:06.941552+0000","last_fullsized":"2023-12-20T04:24:06.941552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:55.949966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246690+0000","last_change":"2023-12-20T04:24:05.950238+0000","last_active":"2023-12-20T04:24:07.246690+0000","last_peered":"2023-12-20T04:24:07.246690+0000","last_clean":"2023-12-20T04:24:07.246690+0000","last_became_active":"2023-12-20T04:24:05.950012+0000","last_became_peered":"2023-12-20T04:24:05.950012+0000","last_unstale":"2023-12-20T04:24:07.246690+0000","last_undegraded":"2023-12-20T04:24:07.246690+0000","last_fullsized":"2023-12-20T04:24:07.246690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:44:55.112046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941819+0000","last_change":"2023-12-20T04:24:05.580183+0000","last_active":"2023-12-20T04:24:06.941819+0000","last_peered":"2023-12-20T04:24:06.941819+0000","last_clean":"2023-12-20T04:24:06.941819+0000","last_became_active":"2023-12-20T04:24:05.579888+0000","last_became_peered":"2023-12-20T04:24:05.579888+0000","last_unstale":"2023-12-20T04:24:06.941819+0000","last_undegraded":"2023-12-20T04:24:06.941819+0000","last_fullsized":"2023-12-20T04:24:06.941819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:25.835365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246890+0000","last_change":"2023-12-20T04:24:05.952689+0000","last_active":"2023-12-20T04:24:07.246890+0000","last_peered":"2023-12-20T04:24:07.246890+0000","last_clean":"2023-12-20T04:24:07.246890+0000","last_became_active":"2023-12-20T04:24:05.952445+0000","last_became_peered":"2023-12-20T04:24:05.952445+0000","last_unstale":"2023-12-20T04:24:07.246890+0000","last_undegraded":"2023-12-20T04:24:07.246890+0000","last_fullsized":"2023-12-20T04:24:07.246890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:57.526682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942047+0000","last_change":"2023-12-20T04:24:05.573111+0000","last_active":"2023-12-20T04:24:06.942047+0000","last_peered":"2023-12-20T04:24:06.942047+0000","last_clean":"2023-12-20T04:24:06.942047+0000","last_became_active":"2023-12-20T04:24:05.572810+0000","last_became_peered":"2023-12-20T04:24:05.572810+0000","last_unstale":"2023-12-20T04:24:06.942047+0000","last_undegraded":"2023-12-20T04:24:06.942047+0000","last_fullsized":"2023-12-20T04:24:06.942047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:50:21.676373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247610+0000","last_change":"2023-12-20T04:24:05.949703+0000","last_active":"2023-12-20T04:24:07.247610+0000","last_peered":"2023-12-20T04:24:07.247610+0000","last_clean":"2023-12-20T04:24:07.247610+0000","last_became_active":"2023-12-20T04:24:05.948666+0000","last_became_peered":"2023-12-20T04:24:05.948666+0000","last_unstale":"2023-12-20T04:24:07.247610+0000","last_undegraded":"2023-12-20T04:24:07.247610+0000","last_fullsized":"2023-12-20T04:24:07.247610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:56.954983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941017+0000","last_change":"2023-12-20T04:24:05.571924+0000","last_active":"2023-12-20T04:24:06.941017+0000","last_peered":"2023-12-20T04:24:06.941017+0000","last_clean":"2023-12-20T04:24:06.941017+0000","last_became_active":"2023-12-20T04:24:05.571649+0000","last_became_peered":"2023-12-20T04:24:05.571649+0000","last_unstale":"2023-12-20T04:24:06.941017+0000","last_undegraded":"2023-12-20T04:24:06.941017+0000","last_fullsized":"2023-12-20T04:24:06.941017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:53.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247159+0000","last_change":"2023-12-20T04:24:05.949535+0000","last_active":"2023-12-20T04:24:07.247159+0000","last_peered":"2023-12-20T04:24:07.247159+0000","last_clean":"2023-12-20T04:24:07.247159+0000","last_became_active":"2023-12-20T04:24:05.949280+0000","last_became_peered":"2023-12-20T04:24:05.949280+0000","last_unstale":"2023-12-20T04:24:07.247159+0000","last_undegraded":"2023-12-20T04:24:07.247159+0000","last_fullsized":"2023-12-20T04:24:07.247159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:48:56.327844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941508+0000","last_change":"2023-12-20T04:24:05.573416+0000","last_active":"2023-12-20T04:24:06.941508+0000","last_peered":"2023-12-20T04:24:06.941508+0000","last_clean":"2023-12-20T04:24:06.941508+0000","last_became_active":"2023-12-20T04:24:05.573159+0000","last_became_peered":"2023-12-20T04:24:05.573159+0000","last_unstale":"2023-12-20T04:24:06.941508+0000","last_undegraded":"2023-12-20T04:24:06.941508+0000","last_fullsized":"2023-12-20T04:24:06.941508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:02:50.781343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247212+0000","last_change":"2023-12-20T04:24:05.949749+0000","last_active":"2023-12-20T04:24:07.247212+0000","last_peered":"2023-12-20T04:24:07.247212+0000","last_clean":"2023-12-20T04:24:07.247212+0000","last_became_active":"2023-12-20T04:24:05.949500+0000","last_became_peered":"2023-12-20T04:24:05.949500+0000","last_unstale":"2023-12-20T04:24:07.247212+0000","last_undegraded":"2023-12-20T04:24:07.247212+0000","last_fullsized":"2023-12-20T04:24:07.247212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:21:45.902052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246484+0000","last_change":"2023-12-20T04:24:05.574202+0000","last_active":"2023-12-20T04:24:07.246484+0000","last_peered":"2023-12-20T04:24:07.246484+0000","last_clean":"2023-12-20T04:24:07.246484+0000","last_became_active":"2023-12-20T04:24:05.573917+0000","last_became_peered":"2023-12-20T04:24:05.573917+0000","last_unstale":"2023-12-20T04:24:07.246484+0000","last_undegraded":"2023-12-20T04:24:07.246484+0000","last_fullsized":"2023-12-20T04:24:07.246484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:17.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246638+0000","last_change":"2023-12-20T04:24:05.949356+0000","last_active":"2023-12-20T04:24:07.246638+0000","last_peered":"2023-12-20T04:24:07.246638+0000","last_clean":"2023-12-20T04:24:07.246638+0000","last_became_active":"2023-12-20T04:24:05.949066+0000","last_became_peered":"2023-12-20T04:24:05.949066+0000","last_unstale":"2023-12-20T04:24:07.246638+0000","last_undegraded":"2023-12-20T04:24:07.246638+0000","last_fullsized":"2023-12-20T04:24:07.246638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:02:53.305915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247729+0000","last_change":"2023-12-20T04:24:05.571055+0000","last_active":"2023-12-20T04:24:07.247729+0000","last_peered":"2023-12-20T04:24:07.247729+0000","last_clean":"2023-12-20T04:24:07.247729+0000","last_became_active":"2023-12-20T04:24:05.570354+0000","last_became_peered":"2023-12-20T04:24:05.570354+0000","last_unstale":"2023-12-20T04:24:07.247729+0000","last_undegraded":"2023-12-20T04:24:07.247729+0000","last_fullsized":"2023-12-20T04:24:07.247729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:12:48.071265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247064+0000","last_change":"2023-12-20T04:24:05.945580+0000","last_active":"2023-12-20T04:24:07.247064+0000","last_peered":"2023-12-20T04:24:07.247064+0000","last_clean":"2023-12-20T04:24:07.247064+0000","last_became_active":"2023-12-20T04:24:05.944382+0000","last_became_peered":"2023-12-20T04:24:05.944382+0000","last_unstale":"2023-12-20T04:24:07.247064+0000","last_undegraded":"2023-12-20T04:24:07.247064+0000","last_fullsized":"2023-12-20T04:24:07.247064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:04.945194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:08.711079+0000","last_change":"2023-12-20T04:24:05.569981+0000","last_active":"2023-12-20T04:24:08.711079+0000","last_peered":"2023-12-20T04:24:08.711079+0000","last_clean":"2023-12-20T04:24:08.711079+0000","last_became_active":"2023-12-20T04:24:05.569725+0000","last_became_peered":"2023-12-20T04:24:05.569725+0000","last_unstale":"2023-12-20T04:24:08.711079+0000","last_undegraded":"2023-12-20T04:24:08.711079+0000","last_fullsized":"2023-12-20T04:24:08.711079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:39:54.768628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941879+0000","last_change":"2023-12-20T04:24:05.945284+0000","last_active":"2023-12-20T04:24:06.941879+0000","last_peered":"2023-12-20T04:24:06.941879+0000","last_clean":"2023-12-20T04:24:06.941879+0000","last_became_active":"2023-12-20T04:24:05.945023+0000","last_became_peered":"2023-12-20T04:24:05.945023+0000","last_unstale":"2023-12-20T04:24:06.941879+0000","last_undegraded":"2023-12-20T04:24:06.941879+0000","last_fullsized":"2023-12-20T04:24:06.941879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:50:05.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247635+0000","last_change":"2023-12-20T04:24:05.577095+0000","last_active":"2023-12-20T04:24:07.247635+0000","last_peered":"2023-12-20T04:24:07.247635+0000","last_clean":"2023-12-20T04:24:07.247635+0000","last_became_active":"2023-12-20T04:24:05.576820+0000","last_became_peered":"2023-12-20T04:24:05.576820+0000","last_unstale":"2023-12-20T04:24:07.247635+0000","last_undegraded":"2023-12-20T04:24:07.247635+0000","last_fullsized":"2023-12-20T04:24:07.247635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:53.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940965+0000","last_change":"2023-12-20T04:24:05.936523+0000","last_active":"2023-12-20T04:24:06.940965+0000","last_peered":"2023-12-20T04:24:06.940965+0000","last_clean":"2023-12-20T04:24:06.940965+0000","last_became_active":"2023-12-20T04:24:05.936231+0000","last_became_peered":"2023-12-20T04:24:05.936231+0000","last_unstale":"2023-12-20T04:24:06.940965+0000","last_undegraded":"2023-12-20T04:24:06.940965+0000","last_fullsized":"2023-12-20T04:24:06.940965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:12.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942127+0000","last_change":"2023-12-20T04:24:05.569569+0000","last_active":"2023-12-20T04:24:06.942127+0000","last_peered":"2023-12-20T04:24:06.942127+0000","last_clean":"2023-12-20T04:24:06.942127+0000","last_became_active":"2023-12-20T04:24:05.569279+0000","last_became_peered":"2023-12-20T04:24:05.569279+0000","last_unstale":"2023-12-20T04:24:06.942127+0000","last_undegraded":"2023-12-20T04:24:06.942127+0000","last_fullsized":"2023-12-20T04:24:06.942127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:25.835365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942027+0000","last_change":"2023-12-20T04:24:05.937392+0000","last_active":"2023-12-20T04:24:06.942027+0000","last_peered":"2023-12-20T04:24:06.942027+0000","last_clean":"2023-12-20T04:24:06.942027+0000","last_became_active":"2023-12-20T04:24:05.936741+0000","last_became_peered":"2023-12-20T04:24:05.936741+0000","last_unstale":"2023-12-20T04:24:06.942027+0000","last_undegraded":"2023-12-20T04:24:06.942027+0000","last_fullsized":"2023-12-20T04:24:06.942027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:07.445583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246666+0000","last_change":"2023-12-20T04:24:05.576415+0000","last_active":"2023-12-20T04:24:07.246666+0000","last_peered":"2023-12-20T04:24:07.246666+0000","last_clean":"2023-12-20T04:24:07.246666+0000","last_became_active":"2023-12-20T04:24:05.576084+0000","last_became_peered":"2023-12-20T04:24:05.576084+0000","last_unstale":"2023-12-20T04:24:07.246666+0000","last_undegraded":"2023-12-20T04:24:07.246666+0000","last_fullsized":"2023-12-20T04:24:07.246666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:01:29.477375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246902+0000","last_change":"2023-12-20T04:24:05.956634+0000","last_active":"2023-12-20T04:24:07.246902+0000","last_peered":"2023-12-20T04:24:07.246902+0000","last_clean":"2023-12-20T04:24:07.246902+0000","last_became_active":"2023-12-20T04:24:05.956373+0000","last_became_peered":"2023-12-20T04:24:05.956373+0000","last_unstale":"2023-12-20T04:24:07.246902+0000","last_undegraded":"2023-12-20T04:24:07.246902+0000","last_fullsized":"2023-12-20T04:24:07.246902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:03.633486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941642+0000","last_change":"2023-12-20T04:24:05.575072+0000","last_active":"2023-12-20T04:24:06.941642+0000","last_peered":"2023-12-20T04:24:06.941642+0000","last_clean":"2023-12-20T04:24:06.941642+0000","last_became_active":"2023-12-20T04:24:05.574821+0000","last_became_peered":"2023-12-20T04:24:05.574821+0000","last_unstale":"2023-12-20T04:24:06.941642+0000","last_undegraded":"2023-12-20T04:24:06.941642+0000","last_fullsized":"2023-12-20T04:24:06.941642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:56.521665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941472+0000","last_change":"2023-12-20T04:24:05.948619+0000","last_active":"2023-12-20T04:24:06.941472+0000","last_peered":"2023-12-20T04:24:06.941472+0000","last_clean":"2023-12-20T04:24:06.941472+0000","last_became_active":"2023-12-20T04:24:05.947629+0000","last_became_peered":"2023-12-20T04:24:05.947629+0000","last_unstale":"2023-12-20T04:24:06.941472+0000","last_undegraded":"2023-12-20T04:24:06.941472+0000","last_fullsized":"2023-12-20T04:24:06.941472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:12.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247094+0000","last_change":"2023-12-20T04:24:05.575220+0000","last_active":"2023-12-20T04:24:07.247094+0000","last_peered":"2023-12-20T04:24:07.247094+0000","last_clean":"2023-12-20T04:24:07.247094+0000","last_became_active":"2023-12-20T04:24:05.574953+0000","last_became_peered":"2023-12-20T04:24:05.574953+0000","last_unstale":"2023-12-20T04:24:07.247094+0000","last_undegraded":"2023-12-20T04:24:07.247094+0000","last_fullsized":"2023-12-20T04:24:07.247094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:42:03.002718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247418+0000","last_change":"2023-12-20T04:24:05.949843+0000","last_active":"2023-12-20T04:24:07.247418+0000","last_peered":"2023-12-20T04:24:07.247418+0000","last_clean":"2023-12-20T04:24:07.247418+0000","last_became_active":"2023-12-20T04:24:05.949559+0000","last_became_peered":"2023-12-20T04:24:05.949559+0000","last_unstale":"2023-12-20T04:24:07.247418+0000","last_undegraded":"2023-12-20T04:24:07.247418+0000","last_fullsized":"2023-12-20T04:24:07.247418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940804+0000","last_change":"2023-12-20T04:24:05.569452+0000","last_active":"2023-12-20T04:24:06.940804+0000","last_peered":"2023-12-20T04:24:06.940804+0000","last_clean":"2023-12-20T04:24:06.940804+0000","last_became_active":"2023-12-20T04:24:05.569110+0000","last_became_peered":"2023-12-20T04:24:05.569110+0000","last_unstale":"2023-12-20T04:24:06.940804+0000","last_undegraded":"2023-12-20T04:24:06.940804+0000","last_fullsized":"2023-12-20T04:24:06.940804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:22.752853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-20T04:24:05.940311+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:24:05.940311+0000","last_peered":"2023-12-20T04:24:05.940311+0000","last_clean":"2023-12-20T04:24:05.940311+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:24:05.940311+0000","last_undegraded":"2023-12-20T04:24:05.940311+0000","last_fullsized":"2023-12-20T04:24:05.940311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:24:13.685 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:24:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.802+0000 7fe7165fa640 1 Processor -- start 2023-12-20T04:24:13.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.802+0000 7fe7165fa640 1 -- start start 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe7165fa640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe71014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe7165fa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7100ba700 0x7fe710155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe7165fa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe71014af90 con 0x7fe7100ba0e0 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe7165fa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7100b8630 con 0x7fe7100ba700 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe7165fa640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71006b090 con 0x7fe710070ff0 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe714b97640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7100ba700 0x7fe710155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe70f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7100ba0e0 0x7fe7100b7820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43126/0 (socket says 172.21.15.40:43126) 2023-12-20T04:24:13.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe70f7fe640 1 -- 172.21.15.40:0/1180866215 learned_addr learned my addr 172.21.15.40:0/1180866215 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe714b97640 1 --2- 172.21.15.40:0/1180866215 >> v2:172.21.15.40:3300/0 conn(0x7fe7100ba700 0x7fe710155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53264/0 (socket says 172.21.15.40:53264) 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe70ffff640 1 --2- 172.21.15.40:0/1180866215 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe71014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe714b97640 1 -- 172.21.15.40:0/1180866215 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 msgr2=0x7fe71014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe714b97640 1 --2- 172.21.15.40:0/1180866215 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe71014aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe714b97640 1 -- 172.21.15.40:0/1180866215 >> v1:172.21.15.40:6789/0 conn(0x7fe7100ba0e0 legacy=0x7fe7100b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe714b97640 1 -- 172.21.15.40:0/1180866215 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710071d10 con 0x7fe7100ba700 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.803+0000 7fe70effd640 1 -- 172.21.15.40:0/1180866215 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247722730 0 0) 0x7fe71014af90 con 0x7fe7100ba0e0 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.804+0000 7fe714b97640 1 --2- 172.21.15.40:0/1180866215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe710155390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe708009dc0 tx=0x7fe70802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a2525e79159a8b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.804+0000 7fe70effd640 1 -- 172.21.15.40:0/1180866215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70802cc40 con 0x7fe7100ba700 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.804+0000 7fe70effd640 1 -- 172.21.15.40:0/1180866215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70802cda0 con 0x7fe7100ba700 2023-12-20T04:24:13.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.804+0000 7fe70effd640 1 -- 172.21.15.40:0/1180866215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708034660 con 0x7fe7100ba700 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 -- 172.21.15.40:0/1180866215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 msgr2=0x7fe710155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 --2- 172.21.15.40:0/1180866215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe710155390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe708009dc0 tx=0x7fe70802be90 comp rx=0 tx=0).stop 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 -- 172.21.15.40:0/1180866215 shutdown_connections 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 --2- 172.21.15.40:0/1180866215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe710155390 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 --2- 172.21.15.40:0/1180866215 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe71014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 -- 172.21.15.40:0/1180866215 >> 172.21.15.40:0/1180866215 conn(0x7fe7100be120 msgr2=0x7fe7100be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 -- 172.21.15.40:0/1180866215 shutdown_connections 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.805+0000 7fe7165fa640 1 -- 172.21.15.40:0/1180866215 wait complete. 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.806+0000 7fe7165fa640 1 Processor -- start 2023-12-20T04:24:13.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.806+0000 7fe7165fa640 1 -- start start 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe7165fa640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe7100bd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe7165fa640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7100ba0e0 0x7fe71014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe7165fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe7101e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe7165fa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71014ed40 con 0x7fe7100ba700 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe7165fa640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7100bdb40 con 0x7fe7100ba0e0 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe7165fa640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe71014ce90 con 0x7fe710070ff0 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe7101e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe7101e39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53270/0 (socket says 172.21.15.40:53270) 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 -- 172.21.15.40:0/640489495 learned_addr learned my addr 172.21.15.40:0/640489495 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe70ffff640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe7100bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe70f7fe640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7100ba0e0 0x7fe71014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 -- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 msgr2=0x7fe7100bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe7100bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 -- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7100ba0e0 msgr2=0x7fe71014c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:13.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7100ba0e0 0x7fe71014c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:13.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.807+0000 7fe714b97640 1 -- 172.21.15.40:0/640489495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708009a70 con 0x7fe7100ba700 2023-12-20T04:24:13.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.808+0000 7fe714b97640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe7101e39c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe708037040 tx=0x7fe708004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:13.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.808+0000 7fe70cff9640 1 -- 172.21.15.40:0/640489495 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708040650 con 0x7fe7100ba700 2023-12-20T04:24:13.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.808+0000 7fe70cff9640 1 -- 172.21.15.40:0/640489495 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7080407b0 con 0x7fe7100ba700 2023-12-20T04:24:13.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.808+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71014db70 con 0x7fe7100ba700 2023-12-20T04:24:13.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.808+0000 7fe70cff9640 1 -- 172.21.15.40:0/640489495 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708040b40 con 0x7fe7100ba700 2023-12-20T04:24:13.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.808+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71014e960 con 0x7fe7100ba700 2023-12-20T04:24:13.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.809+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7101e36e0 con 0x7fe7100ba700 2023-12-20T04:24:13.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.809+0000 7fe70cff9640 1 -- 172.21.15.40:0/640489495 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe708040ca0 con 0x7fe7100ba700 2023-12-20T04:24:13.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.810+0000 7fe70cff9640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe6f006a430 0x7fe6f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:13.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.810+0000 7fe70cff9640 1 -- 172.21.15.40:0/640489495 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7080ab660 con 0x7fe7100ba700 2023-12-20T04:24:13.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.810+0000 7fe70ffff640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe6f006a430 0x7fe6f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:13.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.810+0000 7fe70ffff640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe6f006a430 0x7fe6f006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8006fd0 tx=0x7fe6f8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:13.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.814+0000 7fe70cff9640 1 -- 172.21.15.40:0/640489495 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe7101e36e0 con 0x7fe7100ba700 2023-12-20T04:24:13.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.988+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe710071a30 con 0x7fe6f006a430 2023-12-20T04:24:13.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.995+0000 7fe70cff9640 1 -- 172.21.15.40:0/640489495 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264646 (secure 0 0 0) 0x7fe6f8010990 con 0x7fe6f006a430 2023-12-20T04:24:13.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:14.001 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe6f006a430 msgr2=0x7fe6f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe6f006a430 0x7fe6f006c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8006fd0 tx=0x7fe6f8008040 comp rx=0 tx=0).stop 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 msgr2=0x7fe7101e39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe7101e39c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe708037040 tx=0x7fe708004a40 comp rx=0 tx=0).stop 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 shutdown_connections 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe6f006a430 0x7fe6f006c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7100ba700 0x7fe7101e39c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe7100ba0e0 0x7fe71014c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 --2- 172.21.15.40:0/640489495 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe710070ff0 0x7fe7100bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 >> 172.21.15.40:0/640489495 conn(0x7fe7100be120 msgr2=0x7fe7101431d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:14.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.998+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 shutdown_connections 2023-12-20T04:24:14.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:13.999+0000 7fe7165fa640 1 -- 172.21.15.40:0/640489495 wait complete. 2023-12-20T04:24:14.010 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-12-20T04:24:12.538137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3944,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":4038656,"data_stored":2259556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.981247"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941073+0000","last_change":"2023-12-20T04:24:05.943744+0000","last_active":"2023-12-20T04:24:06.941073+0000","last_peered":"2023-12-20T04:24:06.941073+0000","last_clean":"2023-12-20T04:24:06.941073+0000","last_became_active":"2023-12-20T04:24:05.943462+0000","last_became_peered":"2023-12-20T04:24:05.943462+0000","last_unstale":"2023-12-20T04:24:06.941073+0000","last_undegraded":"2023-12-20T04:24:06.941073+0000","last_fullsized":"2023-12-20T04:24:06.941073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:03:08.432164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247529+0000","last_change":"2023-12-20T04:24:05.950597+0000","last_active":"2023-12-20T04:24:07.247529+0000","last_peered":"2023-12-20T04:24:07.247529+0000","last_clean":"2023-12-20T04:24:07.247529+0000","last_became_active":"2023-12-20T04:24:05.950267+0000","last_became_peered":"2023-12-20T04:24:05.950267+0000","last_unstale":"2023-12-20T04:24:07.247529+0000","last_undegraded":"2023-12-20T04:24:07.247529+0000","last_fullsized":"2023-12-20T04:24:07.247529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:03.033336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246836+0000","last_change":"2023-12-20T04:24:05.949471+0000","last_active":"2023-12-20T04:24:07.246836+0000","last_peered":"2023-12-20T04:24:07.246836+0000","last_clean":"2023-12-20T04:24:07.246836+0000","last_became_active":"2023-12-20T04:24:05.949205+0000","last_became_peered":"2023-12-20T04:24:05.949205+0000","last_unstale":"2023-12-20T04:24:07.246836+0000","last_undegraded":"2023-12-20T04:24:07.246836+0000","last_fullsized":"2023-12-20T04:24:07.246836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:03.633486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247469+0000","last_change":"2023-12-20T04:24:05.952003+0000","last_active":"2023-12-20T04:24:07.247469+0000","last_peered":"2023-12-20T04:24:07.247469+0000","last_clean":"2023-12-20T04:24:07.247469+0000","last_became_active":"2023-12-20T04:24:05.951724+0000","last_became_peered":"2023-12-20T04:24:05.951724+0000","last_unstale":"2023-12-20T04:24:07.247469+0000","last_undegraded":"2023-12-20T04:24:07.247469+0000","last_fullsized":"2023-12-20T04:24:07.247469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:24:52.250041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247437+0000","last_change":"2023-12-20T04:24:05.952187+0000","last_active":"2023-12-20T04:24:07.247437+0000","last_peered":"2023-12-20T04:24:07.247437+0000","last_clean":"2023-12-20T04:24:07.247437+0000","last_became_active":"2023-12-20T04:24:05.951920+0000","last_became_peered":"2023-12-20T04:24:05.951920+0000","last_unstale":"2023-12-20T04:24:07.247437+0000","last_undegraded":"2023-12-20T04:24:07.247437+0000","last_fullsized":"2023-12-20T04:24:07.247437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:33:27.878963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246790+0000","last_change":"2023-12-20T04:24:05.948542+0000","last_active":"2023-12-20T04:24:07.246790+0000","last_peered":"2023-12-20T04:24:07.246790+0000","last_clean":"2023-12-20T04:24:07.246790+0000","last_became_active":"2023-12-20T04:24:05.948298+0000","last_became_peered":"2023-12-20T04:24:05.948298+0000","last_unstale":"2023-12-20T04:24:07.246790+0000","last_undegraded":"2023-12-20T04:24:07.246790+0000","last_fullsized":"2023-12-20T04:24:07.246790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:27:47.704347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247219+0000","last_change":"2023-12-20T04:24:05.954913+0000","last_active":"2023-12-20T04:24:07.247219+0000","last_peered":"2023-12-20T04:24:07.247219+0000","last_clean":"2023-12-20T04:24:07.247219+0000","last_became_active":"2023-12-20T04:24:05.954462+0000","last_became_peered":"2023-12-20T04:24:05.954462+0000","last_unstale":"2023-12-20T04:24:07.247219+0000","last_undegraded":"2023-12-20T04:24:07.247219+0000","last_fullsized":"2023-12-20T04:24:07.247219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:43.654918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246557+0000","last_change":"2023-12-20T04:24:05.950578+0000","last_active":"2023-12-20T04:24:07.246557+0000","last_peered":"2023-12-20T04:24:07.246557+0000","last_clean":"2023-12-20T04:24:07.246557+0000","last_became_active":"2023-12-20T04:24:05.950217+0000","last_became_peered":"2023-12-20T04:24:05.950217+0000","last_unstale":"2023-12-20T04:24:07.246557+0000","last_undegraded":"2023-12-20T04:24:07.246557+0000","last_fullsized":"2023-12-20T04:24:07.246557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:56.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941512+0000","last_change":"2023-12-20T04:24:05.947988+0000","last_active":"2023-12-20T04:24:06.941512+0000","last_peered":"2023-12-20T04:24:06.941512+0000","last_clean":"2023-12-20T04:24:06.941512+0000","last_became_active":"2023-12-20T04:24:05.947510+0000","last_became_peered":"2023-12-20T04:24:05.947510+0000","last_unstale":"2023-12-20T04:24:06.941512+0000","last_undegraded":"2023-12-20T04:24:06.941512+0000","last_fullsized":"2023-12-20T04:24:06.941512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:42:04.007736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247300+0000","last_change":"2023-12-20T04:24:05.955723+0000","last_active":"2023-12-20T04:24:07.247300+0000","last_peered":"2023-12-20T04:24:07.247300+0000","last_clean":"2023-12-20T04:24:07.247300+0000","last_became_active":"2023-12-20T04:24:05.955443+0000","last_became_peered":"2023-12-20T04:24:05.955443+0000","last_unstale":"2023-12-20T04:24:07.247300+0000","last_undegraded":"2023-12-20T04:24:07.247300+0000","last_fullsized":"2023-12-20T04:24:07.247300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:56.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247397+0000","last_change":"2023-12-20T04:24:05.944985+0000","last_active":"2023-12-20T04:24:07.247397+0000","last_peered":"2023-12-20T04:24:07.247397+0000","last_clean":"2023-12-20T04:24:07.247397+0000","last_became_active":"2023-12-20T04:24:05.944744+0000","last_became_peered":"2023-12-20T04:24:05.944744+0000","last_unstale":"2023-12-20T04:24:07.247397+0000","last_undegraded":"2023-12-20T04:24:07.247397+0000","last_fullsized":"2023-12-20T04:24:07.247397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:03.633486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246715+0000","last_change":"2023-12-20T04:24:05.952010+0000","last_active":"2023-12-20T04:24:07.246715+0000","last_peered":"2023-12-20T04:24:07.246715+0000","last_clean":"2023-12-20T04:24:07.246715+0000","last_became_active":"2023-12-20T04:24:05.951736+0000","last_became_peered":"2023-12-20T04:24:05.951736+0000","last_unstale":"2023-12-20T04:24:07.246715+0000","last_undegraded":"2023-12-20T04:24:07.246715+0000","last_fullsized":"2023-12-20T04:24:07.246715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:56.340113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247520+0000","last_change":"2023-12-20T04:24:05.949867+0000","last_active":"2023-12-20T04:24:07.247520+0000","last_peered":"2023-12-20T04:24:07.247520+0000","last_clean":"2023-12-20T04:24:07.247520+0000","last_became_active":"2023-12-20T04:24:05.949075+0000","last_became_peered":"2023-12-20T04:24:05.949075+0000","last_unstale":"2023-12-20T04:24:07.247520+0000","last_undegraded":"2023-12-20T04:24:07.247520+0000","last_fullsized":"2023-12-20T04:24:07.247520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:26.840383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246884+0000","last_change":"2023-12-20T04:24:05.953008+0000","last_active":"2023-12-20T04:24:07.246884+0000","last_peered":"2023-12-20T04:24:07.246884+0000","last_clean":"2023-12-20T04:24:07.246884+0000","last_became_active":"2023-12-20T04:24:05.952619+0000","last_became_peered":"2023-12-20T04:24:05.952619+0000","last_unstale":"2023-12-20T04:24:07.246884+0000","last_undegraded":"2023-12-20T04:24:07.246884+0000","last_fullsized":"2023-12-20T04:24:07.246884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:54:21.841230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246745+0000","last_change":"2023-12-20T04:24:05.942827+0000","last_active":"2023-12-20T04:24:07.246745+0000","last_peered":"2023-12-20T04:24:07.246745+0000","last_clean":"2023-12-20T04:24:07.246745+0000","last_became_active":"2023-12-20T04:24:05.942523+0000","last_became_peered":"2023-12-20T04:24:05.942523+0000","last_unstale":"2023-12-20T04:24:07.246745+0000","last_undegraded":"2023-12-20T04:24:07.246745+0000","last_fullsized":"2023-12-20T04:24:07.246745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:09:00.273465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247124+0000","last_change":"2023-12-20T04:24:05.953173+0000","last_active":"2023-12-20T04:24:07.247124+0000","last_peered":"2023-12-20T04:24:07.247124+0000","last_clean":"2023-12-20T04:24:07.247124+0000","last_became_active":"2023-12-20T04:24:05.952910+0000","last_became_peered":"2023-12-20T04:24:05.952910+0000","last_unstale":"2023-12-20T04:24:07.247124+0000","last_undegraded":"2023-12-20T04:24:07.247124+0000","last_fullsized":"2023-12-20T04:24:07.247124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:54:21.841230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247451+0000","last_change":"2023-12-20T04:24:05.955140+0000","last_active":"2023-12-20T04:24:07.247451+0000","last_peered":"2023-12-20T04:24:07.247451+0000","last_clean":"2023-12-20T04:24:07.247451+0000","last_became_active":"2023-12-20T04:24:05.954516+0000","last_became_peered":"2023-12-20T04:24:05.954516+0000","last_unstale":"2023-12-20T04:24:07.247451+0000","last_undegraded":"2023-12-20T04:24:07.247451+0000","last_fullsized":"2023-12-20T04:24:07.247451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:04.945194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247557+0000","last_change":"2023-12-20T04:24:05.956100+0000","last_active":"2023-12-20T04:24:07.247557+0000","last_peered":"2023-12-20T04:24:07.247557+0000","last_clean":"2023-12-20T04:24:07.247557+0000","last_became_active":"2023-12-20T04:24:05.955740+0000","last_became_peered":"2023-12-20T04:24:05.955740+0000","last_unstale":"2023-12-20T04:24:07.247557+0000","last_undegraded":"2023-12-20T04:24:07.247557+0000","last_fullsized":"2023-12-20T04:24:07.247557+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:30.303761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246909+0000","last_change":"2023-12-20T04:24:05.955954+0000","last_active":"2023-12-20T04:24:07.246909+0000","last_peered":"2023-12-20T04:24:07.246909+0000","last_clean":"2023-12-20T04:24:07.246909+0000","last_became_active":"2023-12-20T04:24:05.955329+0000","last_became_peered":"2023-12-20T04:24:05.955329+0000","last_unstale":"2023-12-20T04:24:07.246909+0000","last_undegraded":"2023-12-20T04:24:07.246909+0000","last_fullsized":"2023-12-20T04:24:07.246909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:04:51.540720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247240+0000","last_change":"2023-12-20T04:24:05.948835+0000","last_active":"2023-12-20T04:24:07.247240+0000","last_peered":"2023-12-20T04:24:07.247240+0000","last_clean":"2023-12-20T04:24:07.247240+0000","last_became_active":"2023-12-20T04:24:05.948586+0000","last_became_peered":"2023-12-20T04:24:05.948586+0000","last_unstale":"2023-12-20T04:24:07.247240+0000","last_undegraded":"2023-12-20T04:24:07.247240+0000","last_fullsized":"2023-12-20T04:24:07.247240+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:02:51.786360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941621+0000","last_change":"2023-12-20T04:24:05.950008+0000","last_active":"2023-12-20T04:24:06.941621+0000","last_peered":"2023-12-20T04:24:06.941621+0000","last_clean":"2023-12-20T04:24:06.941621+0000","last_became_active":"2023-12-20T04:24:05.949727+0000","last_became_peered":"2023-12-20T04:24:05.949727+0000","last_unstale":"2023-12-20T04:24:06.941621+0000","last_undegraded":"2023-12-20T04:24:06.941621+0000","last_fullsized":"2023-12-20T04:24:06.941621+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:50:05.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941495+0000","last_change":"2023-12-20T04:24:05.948202+0000","last_active":"2023-12-20T04:24:06.941495+0000","last_peered":"2023-12-20T04:24:06.941495+0000","last_clean":"2023-12-20T04:24:06.941495+0000","last_became_active":"2023-12-20T04:24:05.947930+0000","last_became_peered":"2023-12-20T04:24:05.947930+0000","last_unstale":"2023-12-20T04:24:06.941495+0000","last_undegraded":"2023-12-20T04:24:06.941495+0000","last_fullsized":"2023-12-20T04:24:06.941495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:56.432999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941792+0000","last_change":"2023-12-20T04:24:05.948036+0000","last_active":"2023-12-20T04:24:06.941792+0000","last_peered":"2023-12-20T04:24:06.941792+0000","last_clean":"2023-12-20T04:24:06.941792+0000","last_became_active":"2023-12-20T04:24:05.947769+0000","last_became_peered":"2023-12-20T04:24:05.947769+0000","last_unstale":"2023-12-20T04:24:06.941792+0000","last_undegraded":"2023-12-20T04:24:06.941792+0000","last_fullsized":"2023-12-20T04:24:06.941792+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:56.432999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246497+0000","last_change":"2023-12-20T04:24:05.950309+0000","last_active":"2023-12-20T04:24:07.246497+0000","last_peered":"2023-12-20T04:24:07.246497+0000","last_clean":"2023-12-20T04:24:07.246497+0000","last_became_active":"2023-12-20T04:24:05.950038+0000","last_became_peered":"2023-12-20T04:24:05.950038+0000","last_unstale":"2023-12-20T04:24:07.246497+0000","last_undegraded":"2023-12-20T04:24:07.246497+0000","last_fullsized":"2023-12-20T04:24:07.246497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:43.654918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247369+0000","last_change":"2023-12-20T04:24:05.946298+0000","last_active":"2023-12-20T04:24:07.247369+0000","last_peered":"2023-12-20T04:24:07.247369+0000","last_clean":"2023-12-20T04:24:07.247369+0000","last_became_active":"2023-12-20T04:24:05.945917+0000","last_became_peered":"2023-12-20T04:24:05.945917+0000","last_unstale":"2023-12-20T04:24:07.247369+0000","last_undegraded":"2023-12-20T04:24:07.247369+0000","last_fullsized":"2023-12-20T04:24:07.247369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247645+0000","last_change":"2023-12-20T04:24:05.951741+0000","last_active":"2023-12-20T04:24:07.247645+0000","last_peered":"2023-12-20T04:24:07.247645+0000","last_clean":"2023-12-20T04:24:07.247645+0000","last_became_active":"2023-12-20T04:24:05.951485+0000","last_became_peered":"2023-12-20T04:24:05.951485+0000","last_unstale":"2023-12-20T04:24:07.247645+0000","last_undegraded":"2023-12-20T04:24:07.247645+0000","last_fullsized":"2023-12-20T04:24:07.247645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:53:35.066896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247900+0000","last_change":"2023-12-20T04:24:05.953311+0000","last_active":"2023-12-20T04:24:07.247900+0000","last_peered":"2023-12-20T04:24:07.247900+0000","last_clean":"2023-12-20T04:24:07.247900+0000","last_became_active":"2023-12-20T04:24:05.952914+0000","last_became_peered":"2023-12-20T04:24:05.952914+0000","last_unstale":"2023-12-20T04:24:07.247900+0000","last_undegraded":"2023-12-20T04:24:07.247900+0000","last_fullsized":"2023-12-20T04:24:07.247900+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:22:10.103879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246759+0000","last_change":"2023-12-20T04:24:05.946301+0000","last_active":"2023-12-20T04:24:07.246759+0000","last_peered":"2023-12-20T04:24:07.246759+0000","last_clean":"2023-12-20T04:24:07.246759+0000","last_became_active":"2023-12-20T04:24:05.946047+0000","last_became_peered":"2023-12-20T04:24:05.946047+0000","last_unstale":"2023-12-20T04:24:07.246759+0000","last_undegraded":"2023-12-20T04:24:07.246759+0000","last_fullsized":"2023-12-20T04:24:07.246759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:16:13.409966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941531+0000","last_change":"2023-12-20T04:24:05.952034+0000","last_active":"2023-12-20T04:24:06.941531+0000","last_peered":"2023-12-20T04:24:06.941531+0000","last_clean":"2023-12-20T04:24:06.941531+0000","last_became_active":"2023-12-20T04:24:05.951765+0000","last_became_peered":"2023-12-20T04:24:05.951765+0000","last_unstale":"2023-12-20T04:24:06.941531+0000","last_undegraded":"2023-12-20T04:24:06.941531+0000","last_fullsized":"2023-12-20T04:24:06.941531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:14.344584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247230+0000","last_change":"2023-12-20T04:24:05.944487+0000","last_active":"2023-12-20T04:24:07.247230+0000","last_peered":"2023-12-20T04:24:07.247230+0000","last_clean":"2023-12-20T04:24:07.247230+0000","last_became_active":"2023-12-20T04:24:05.944209+0000","last_became_peered":"2023-12-20T04:24:05.944209+0000","last_unstale":"2023-12-20T04:24:07.247230+0000","last_undegraded":"2023-12-20T04:24:07.247230+0000","last_fullsized":"2023-12-20T04:24:07.247230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:16:13.409966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940747+0000","last_change":"2023-12-20T04:24:05.949313+0000","last_active":"2023-12-20T04:24:06.940747+0000","last_peered":"2023-12-20T04:24:06.940747+0000","last_clean":"2023-12-20T04:24:06.940747+0000","last_became_active":"2023-12-20T04:24:05.949065+0000","last_became_peered":"2023-12-20T04:24:05.949065+0000","last_unstale":"2023-12-20T04:24:06.940747+0000","last_undegraded":"2023-12-20T04:24:06.940747+0000","last_fullsized":"2023-12-20T04:24:06.940747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:18.197708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246723+0000","last_change":"2023-12-20T04:24:05.952517+0000","last_active":"2023-12-20T04:24:07.246723+0000","last_peered":"2023-12-20T04:24:07.246723+0000","last_clean":"2023-12-20T04:24:07.246723+0000","last_became_active":"2023-12-20T04:24:05.952166+0000","last_became_peered":"2023-12-20T04:24:05.952166+0000","last_unstale":"2023-12-20T04:24:07.246723+0000","last_undegraded":"2023-12-20T04:24:07.246723+0000","last_fullsized":"2023-12-20T04:24:07.246723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:27:47.704347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942013+0000","last_change":"2023-12-20T04:24:05.946482+0000","last_active":"2023-12-20T04:24:06.942013+0000","last_peered":"2023-12-20T04:24:06.942013+0000","last_clean":"2023-12-20T04:24:06.942013+0000","last_became_active":"2023-12-20T04:24:05.946237+0000","last_became_peered":"2023-12-20T04:24:05.946237+0000","last_unstale":"2023-12-20T04:24:06.942013+0000","last_undegraded":"2023-12-20T04:24:06.942013+0000","last_fullsized":"2023-12-20T04:24:06.942013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:18.197708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941264+0000","last_change":"2023-12-20T04:24:05.570802+0000","last_active":"2023-12-20T04:24:06.941264+0000","last_peered":"2023-12-20T04:24:06.941264+0000","last_clean":"2023-12-20T04:24:06.941264+0000","last_became_active":"2023-12-20T04:24:05.570500+0000","last_became_peered":"2023-12-20T04:24:05.570500+0000","last_unstale":"2023-12-20T04:24:06.941264+0000","last_undegraded":"2023-12-20T04:24:06.941264+0000","last_fullsized":"2023-12-20T04:24:06.941264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:47.304242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941177+0000","last_change":"2023-12-20T04:24:05.941390+0000","last_active":"2023-12-20T04:24:06.941177+0000","last_peered":"2023-12-20T04:24:06.941177+0000","last_clean":"2023-12-20T04:24:06.941177+0000","last_became_active":"2023-12-20T04:24:05.941096+0000","last_became_peered":"2023-12-20T04:24:05.941096+0000","last_unstale":"2023-12-20T04:24:06.941177+0000","last_undegraded":"2023-12-20T04:24:06.941177+0000","last_fullsized":"2023-12-20T04:24:06.941177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:42:04.007736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941976+0000","last_change":"2023-12-20T04:24:05.574867+0000","last_active":"2023-12-20T04:24:06.941976+0000","last_peered":"2023-12-20T04:24:06.941976+0000","last_clean":"2023-12-20T04:24:06.941976+0000","last_became_active":"2023-12-20T04:24:05.574612+0000","last_became_peered":"2023-12-20T04:24:05.574612+0000","last_unstale":"2023-12-20T04:24:06.941976+0000","last_undegraded":"2023-12-20T04:24:06.941976+0000","last_fullsized":"2023-12-20T04:24:06.941976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:22.752853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941764+0000","last_change":"2023-12-20T04:24:05.951999+0000","last_active":"2023-12-20T04:24:06.941764+0000","last_peered":"2023-12-20T04:24:06.941764+0000","last_clean":"2023-12-20T04:24:06.941764+0000","last_became_active":"2023-12-20T04:24:05.951732+0000","last_became_peered":"2023-12-20T04:24:05.951732+0000","last_unstale":"2023-12-20T04:24:06.941764+0000","last_undegraded":"2023-12-20T04:24:06.941764+0000","last_fullsized":"2023-12-20T04:24:06.941764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:18.197708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247004+0000","last_change":"2023-12-20T04:24:05.571494+0000","last_active":"2023-12-20T04:24:07.247004+0000","last_peered":"2023-12-20T04:24:07.247004+0000","last_clean":"2023-12-20T04:24:07.247004+0000","last_became_active":"2023-12-20T04:24:05.571210+0000","last_became_peered":"2023-12-20T04:24:05.571210+0000","last_unstale":"2023-12-20T04:24:07.247004+0000","last_undegraded":"2023-12-20T04:24:07.247004+0000","last_fullsized":"2023-12-20T04:24:07.247004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:13.339567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247961+0000","last_change":"2023-12-20T04:24:05.953145+0000","last_active":"2023-12-20T04:24:07.247961+0000","last_peered":"2023-12-20T04:24:07.247961+0000","last_clean":"2023-12-20T04:24:07.247961+0000","last_became_active":"2023-12-20T04:24:05.952603+0000","last_became_peered":"2023-12-20T04:24:05.952603+0000","last_unstale":"2023-12-20T04:24:07.247961+0000","last_undegraded":"2023-12-20T04:24:07.247961+0000","last_fullsized":"2023-12-20T04:24:07.247961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:09:00.273465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247322+0000","last_change":"2023-12-20T04:24:05.577787+0000","last_active":"2023-12-20T04:24:07.247322+0000","last_peered":"2023-12-20T04:24:07.247322+0000","last_clean":"2023-12-20T04:24:07.247322+0000","last_became_active":"2023-12-20T04:24:05.577455+0000","last_became_peered":"2023-12-20T04:24:05.577455+0000","last_unstale":"2023-12-20T04:24:07.247322+0000","last_undegraded":"2023-12-20T04:24:07.247322+0000","last_fullsized":"2023-12-20T04:24:07.247322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:10.960885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247319+0000","last_change":"2023-12-20T04:24:05.948230+0000","last_active":"2023-12-20T04:24:07.247319+0000","last_peered":"2023-12-20T04:24:07.247319+0000","last_clean":"2023-12-20T04:24:07.247319+0000","last_became_active":"2023-12-20T04:24:05.947759+0000","last_became_peered":"2023-12-20T04:24:05.947759+0000","last_unstale":"2023-12-20T04:24:07.247319+0000","last_undegraded":"2023-12-20T04:24:07.247319+0000","last_fullsized":"2023-12-20T04:24:07.247319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:24:52.250041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941730+0000","last_change":"2023-12-20T04:24:05.572598+0000","last_active":"2023-12-20T04:24:06.941730+0000","last_peered":"2023-12-20T04:24:06.941730+0000","last_clean":"2023-12-20T04:24:06.941730+0000","last_became_active":"2023-12-20T04:24:05.572244+0000","last_became_peered":"2023-12-20T04:24:05.572244+0000","last_unstale":"2023-12-20T04:24:06.941730+0000","last_undegraded":"2023-12-20T04:24:06.941730+0000","last_fullsized":"2023-12-20T04:24:06.941730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:44:54.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246634+0000","last_change":"2023-12-20T04:24:05.946914+0000","last_active":"2023-12-20T04:24:07.246634+0000","last_peered":"2023-12-20T04:24:07.246634+0000","last_clean":"2023-12-20T04:24:07.246634+0000","last_became_active":"2023-12-20T04:24:05.946636+0000","last_became_peered":"2023-12-20T04:24:05.946636+0000","last_unstale":"2023-12-20T04:24:07.246634+0000","last_undegraded":"2023-12-20T04:24:07.246634+0000","last_fullsized":"2023-12-20T04:24:07.246634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:21:45.902052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941553+0000","last_change":"2023-12-20T04:24:05.569682+0000","last_active":"2023-12-20T04:24:06.941553+0000","last_peered":"2023-12-20T04:24:06.941553+0000","last_clean":"2023-12-20T04:24:06.941553+0000","last_became_active":"2023-12-20T04:24:05.569434+0000","last_became_peered":"2023-12-20T04:24:05.569434+0000","last_unstale":"2023-12-20T04:24:06.941553+0000","last_undegraded":"2023-12-20T04:24:06.941553+0000","last_fullsized":"2023-12-20T04:24:06.941553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:33:26.873946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941124+0000","last_change":"2023-12-20T04:24:05.939236+0000","last_active":"2023-12-20T04:24:06.941124+0000","last_peered":"2023-12-20T04:24:06.941124+0000","last_clean":"2023-12-20T04:24:06.941124+0000","last_became_active":"2023-12-20T04:24:05.937076+0000","last_became_peered":"2023-12-20T04:24:05.937076+0000","last_unstale":"2023-12-20T04:24:06.941124+0000","last_undegraded":"2023-12-20T04:24:06.941124+0000","last_fullsized":"2023-12-20T04:24:06.941124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:54.057510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247336+0000","last_change":"2023-12-20T04:24:05.568411+0000","last_active":"2023-12-20T04:24:07.247336+0000","last_peered":"2023-12-20T04:24:07.247336+0000","last_clean":"2023-12-20T04:24:07.247336+0000","last_became_active":"2023-12-20T04:24:05.568082+0000","last_became_peered":"2023-12-20T04:24:05.568082+0000","last_unstale":"2023-12-20T04:24:07.247336+0000","last_undegraded":"2023-12-20T04:24:07.247336+0000","last_fullsized":"2023-12-20T04:24:07.247336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:17.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246522+0000","last_change":"2023-12-20T04:24:05.943163+0000","last_active":"2023-12-20T04:24:07.246522+0000","last_peered":"2023-12-20T04:24:07.246522+0000","last_clean":"2023-12-20T04:24:07.246522+0000","last_became_active":"2023-12-20T04:24:05.942879+0000","last_became_peered":"2023-12-20T04:24:05.942879+0000","last_unstale":"2023-12-20T04:24:07.246522+0000","last_undegraded":"2023-12-20T04:24:07.246522+0000","last_fullsized":"2023-12-20T04:24:07.246522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:14.344584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941524+0000","last_change":"2023-12-20T04:24:05.566884+0000","last_active":"2023-12-20T04:24:06.941524+0000","last_peered":"2023-12-20T04:24:06.941524+0000","last_clean":"2023-12-20T04:24:06.941524+0000","last_became_active":"2023-12-20T04:24:05.566609+0000","last_became_peered":"2023-12-20T04:24:05.566609+0000","last_unstale":"2023-12-20T04:24:06.941524+0000","last_undegraded":"2023-12-20T04:24:06.941524+0000","last_fullsized":"2023-12-20T04:24:06.941524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:02.782164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247003+0000","last_change":"2023-12-20T04:24:05.952616+0000","last_active":"2023-12-20T04:24:07.247003+0000","last_peered":"2023-12-20T04:24:07.247003+0000","last_clean":"2023-12-20T04:24:07.247003+0000","last_became_active":"2023-12-20T04:24:05.952350+0000","last_became_peered":"2023-12-20T04:24:05.952350+0000","last_unstale":"2023-12-20T04:24:07.247003+0000","last_undegraded":"2023-12-20T04:24:07.247003+0000","last_fullsized":"2023-12-20T04:24:07.247003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246836+0000","last_change":"2023-12-20T04:24:05.575704+0000","last_active":"2023-12-20T04:24:07.246836+0000","last_peered":"2023-12-20T04:24:07.246836+0000","last_clean":"2023-12-20T04:24:07.246836+0000","last_became_active":"2023-12-20T04:24:05.575453+0000","last_became_peered":"2023-12-20T04:24:05.575453+0000","last_unstale":"2023-12-20T04:24:07.246836+0000","last_undegraded":"2023-12-20T04:24:07.246836+0000","last_fullsized":"2023-12-20T04:24:07.246836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:55.427981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246756+0000","last_change":"2023-12-20T04:24:05.957017+0000","last_active":"2023-12-20T04:24:07.246756+0000","last_peered":"2023-12-20T04:24:07.246756+0000","last_clean":"2023-12-20T04:24:07.246756+0000","last_became_active":"2023-12-20T04:24:05.956765+0000","last_became_peered":"2023-12-20T04:24:05.956765+0000","last_unstale":"2023-12-20T04:24:07.246756+0000","last_undegraded":"2023-12-20T04:24:07.246756+0000","last_fullsized":"2023-12-20T04:24:07.246756+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942057+0000","last_change":"2023-12-20T04:24:05.572557+0000","last_active":"2023-12-20T04:24:06.942057+0000","last_peered":"2023-12-20T04:24:06.942057+0000","last_clean":"2023-12-20T04:24:06.942057+0000","last_became_active":"2023-12-20T04:24:05.572245+0000","last_became_peered":"2023-12-20T04:24:05.572245+0000","last_unstale":"2023-12-20T04:24:06.942057+0000","last_undegraded":"2023-12-20T04:24:06.942057+0000","last_fullsized":"2023-12-20T04:24:06.942057+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:47.304242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247294+0000","last_change":"2023-12-20T04:24:05.952489+0000","last_active":"2023-12-20T04:24:07.247294+0000","last_peered":"2023-12-20T04:24:07.247294+0000","last_clean":"2023-12-20T04:24:07.247294+0000","last_became_active":"2023-12-20T04:24:05.952141+0000","last_became_peered":"2023-12-20T04:24:05.952141+0000","last_unstale":"2023-12-20T04:24:07.247294+0000","last_undegraded":"2023-12-20T04:24:07.247294+0000","last_fullsized":"2023-12-20T04:24:07.247294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:31:46.773495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246894+0000","last_change":"2023-12-20T04:24:05.575208+0000","last_active":"2023-12-20T04:24:07.246894+0000","last_peered":"2023-12-20T04:24:07.246894+0000","last_clean":"2023-12-20T04:24:07.246894+0000","last_became_active":"2023-12-20T04:24:05.573791+0000","last_became_peered":"2023-12-20T04:24:05.573791+0000","last_unstale":"2023-12-20T04:24:07.246894+0000","last_undegraded":"2023-12-20T04:24:07.246894+0000","last_fullsized":"2023-12-20T04:24:07.246894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:55.427981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246798+0000","last_change":"2023-12-20T04:24:05.950365+0000","last_active":"2023-12-20T04:24:07.246798+0000","last_peered":"2023-12-20T04:24:07.246798+0000","last_clean":"2023-12-20T04:24:07.246798+0000","last_became_active":"2023-12-20T04:24:05.950108+0000","last_became_peered":"2023-12-20T04:24:05.950108+0000","last_unstale":"2023-12-20T04:24:07.246798+0000","last_undegraded":"2023-12-20T04:24:07.246798+0000","last_fullsized":"2023-12-20T04:24:07.246798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:27:47.704347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247381+0000","last_change":"2023-12-20T04:24:05.572507+0000","last_active":"2023-12-20T04:24:07.247381+0000","last_peered":"2023-12-20T04:24:07.247381+0000","last_clean":"2023-12-20T04:24:07.247381+0000","last_became_active":"2023-12-20T04:24:05.571607+0000","last_became_peered":"2023-12-20T04:24:05.571607+0000","last_unstale":"2023-12-20T04:24:07.247381+0000","last_undegraded":"2023-12-20T04:24:07.247381+0000","last_fullsized":"2023-12-20T04:24:07.247381+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:11.239866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246517+0000","last_change":"2023-12-20T04:24:05.943277+0000","last_active":"2023-12-20T04:24:07.246517+0000","last_peered":"2023-12-20T04:24:07.246517+0000","last_clean":"2023-12-20T04:24:07.246517+0000","last_became_active":"2023-12-20T04:24:05.943026+0000","last_became_peered":"2023-12-20T04:24:05.943026+0000","last_unstale":"2023-12-20T04:24:07.246517+0000","last_undegraded":"2023-12-20T04:24:07.246517+0000","last_fullsized":"2023-12-20T04:24:07.246517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:57:19.326122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941703+0000","last_change":"2023-12-20T04:24:05.567962+0000","last_active":"2023-12-20T04:24:06.941703+0000","last_peered":"2023-12-20T04:24:06.941703+0000","last_clean":"2023-12-20T04:24:06.941703+0000","last_became_active":"2023-12-20T04:24:05.567606+0000","last_became_peered":"2023-12-20T04:24:05.567606+0000","last_unstale":"2023-12-20T04:24:06.941703+0000","last_undegraded":"2023-12-20T04:24:06.941703+0000","last_fullsized":"2023-12-20T04:24:06.941703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:48:55.322826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247087+0000","last_change":"2023-12-20T04:24:05.947342+0000","last_active":"2023-12-20T04:24:07.247087+0000","last_peered":"2023-12-20T04:24:07.247087+0000","last_clean":"2023-12-20T04:24:07.247087+0000","last_became_active":"2023-12-20T04:24:05.947091+0000","last_became_peered":"2023-12-20T04:24:05.947091+0000","last_unstale":"2023-12-20T04:24:07.247087+0000","last_undegraded":"2023-12-20T04:24:07.247087+0000","last_fullsized":"2023-12-20T04:24:07.247087+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:16:13.409966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246593+0000","last_change":"2023-12-20T04:24:05.573782+0000","last_active":"2023-12-20T04:24:07.246593+0000","last_peered":"2023-12-20T04:24:07.246593+0000","last_clean":"2023-12-20T04:24:07.246593+0000","last_became_active":"2023-12-20T04:24:05.573514+0000","last_became_peered":"2023-12-20T04:24:05.573514+0000","last_unstale":"2023-12-20T04:24:07.246593+0000","last_undegraded":"2023-12-20T04:24:07.246593+0000","last_fullsized":"2023-12-20T04:24:07.246593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:31:46.635483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246890+0000","last_change":"2023-12-20T04:24:05.952252+0000","last_active":"2023-12-20T04:24:07.246890+0000","last_peered":"2023-12-20T04:24:07.246890+0000","last_clean":"2023-12-20T04:24:07.246890+0000","last_became_active":"2023-12-20T04:24:05.952008+0000","last_became_peered":"2023-12-20T04:24:05.952008+0000","last_unstale":"2023-12-20T04:24:07.246890+0000","last_undegraded":"2023-12-20T04:24:07.246890+0000","last_fullsized":"2023-12-20T04:24:07.246890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:03.033336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247411+0000","last_change":"2023-12-20T04:24:05.574526+0000","last_active":"2023-12-20T04:24:07.247411+0000","last_peered":"2023-12-20T04:24:07.247411+0000","last_clean":"2023-12-20T04:24:07.247411+0000","last_became_active":"2023-12-20T04:24:05.574025+0000","last_became_peered":"2023-12-20T04:24:05.574025+0000","last_unstale":"2023-12-20T04:24:07.247411+0000","last_undegraded":"2023-12-20T04:24:07.247411+0000","last_fullsized":"2023-12-20T04:24:07.247411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:50:04.824071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940843+0000","last_change":"2023-12-20T04:24:05.938739+0000","last_active":"2023-12-20T04:24:06.940843+0000","last_peered":"2023-12-20T04:24:06.940843+0000","last_clean":"2023-12-20T04:24:06.940843+0000","last_became_active":"2023-12-20T04:24:05.938480+0000","last_became_peered":"2023-12-20T04:24:05.938480+0000","last_unstale":"2023-12-20T04:24:06.940843+0000","last_undegraded":"2023-12-20T04:24:06.940843+0000","last_fullsized":"2023-12-20T04:24:06.940843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:14.344584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247013+0000","last_change":"2023-12-20T04:24:05.570961+0000","last_active":"2023-12-20T04:24:07.247013+0000","last_peered":"2023-12-20T04:24:07.247013+0000","last_clean":"2023-12-20T04:24:07.247013+0000","last_became_active":"2023-12-20T04:24:05.570548+0000","last_became_peered":"2023-12-20T04:24:05.570548+0000","last_unstale":"2023-12-20T04:24:07.247013+0000","last_undegraded":"2023-12-20T04:24:07.247013+0000","last_fullsized":"2023-12-20T04:24:07.247013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:03:07.427147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941493+0000","last_change":"2023-12-20T04:24:05.944764+0000","last_active":"2023-12-20T04:24:06.941493+0000","last_peered":"2023-12-20T04:24:06.941493+0000","last_clean":"2023-12-20T04:24:06.941493+0000","last_became_active":"2023-12-20T04:24:05.944513+0000","last_became_peered":"2023-12-20T04:24:05.944513+0000","last_unstale":"2023-12-20T04:24:06.941493+0000","last_undegraded":"2023-12-20T04:24:06.941493+0000","last_fullsized":"2023-12-20T04:24:06.941493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:03:08.432164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247523+0000","last_change":"2023-12-20T04:24:05.575660+0000","last_active":"2023-12-20T04:24:07.247523+0000","last_peered":"2023-12-20T04:24:07.247523+0000","last_clean":"2023-12-20T04:24:07.247523+0000","last_became_active":"2023-12-20T04:24:05.575390+0000","last_became_peered":"2023-12-20T04:24:05.575390+0000","last_unstale":"2023-12-20T04:24:07.247523+0000","last_undegraded":"2023-12-20T04:24:07.247523+0000","last_fullsized":"2023-12-20T04:24:07.247523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:06.440566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246996+0000","last_change":"2023-12-20T04:24:05.955630+0000","last_active":"2023-12-20T04:24:07.246996+0000","last_peered":"2023-12-20T04:24:07.246996+0000","last_clean":"2023-12-20T04:24:07.246996+0000","last_became_active":"2023-12-20T04:24:05.955360+0000","last_became_peered":"2023-12-20T04:24:05.955360+0000","last_unstale":"2023-12-20T04:24:07.246996+0000","last_undegraded":"2023-12-20T04:24:07.246996+0000","last_fullsized":"2023-12-20T04:24:07.246996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:03.033336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941474+0000","last_change":"2023-12-20T04:24:05.574296+0000","last_active":"2023-12-20T04:24:06.941474+0000","last_peered":"2023-12-20T04:24:06.941474+0000","last_clean":"2023-12-20T04:24:06.941474+0000","last_became_active":"2023-12-20T04:24:05.573840+0000","last_became_peered":"2023-12-20T04:24:05.573840+0000","last_unstale":"2023-12-20T04:24:06.941474+0000","last_undegraded":"2023-12-20T04:24:06.941474+0000","last_fullsized":"2023-12-20T04:24:06.941474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:02:52.300898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247561+0000","last_change":"2023-12-20T04:24:05.946303+0000","last_active":"2023-12-20T04:24:07.247561+0000","last_peered":"2023-12-20T04:24:07.247561+0000","last_clean":"2023-12-20T04:24:07.247561+0000","last_became_active":"2023-12-20T04:24:05.946038+0000","last_became_peered":"2023-12-20T04:24:05.946038+0000","last_unstale":"2023-12-20T04:24:07.247561+0000","last_undegraded":"2023-12-20T04:24:07.247561+0000","last_fullsized":"2023-12-20T04:24:07.247561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:28:03.325280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941552+0000","last_change":"2023-12-20T04:24:05.572704+0000","last_active":"2023-12-20T04:24:06.941552+0000","last_peered":"2023-12-20T04:24:06.941552+0000","last_clean":"2023-12-20T04:24:06.941552+0000","last_became_active":"2023-12-20T04:24:05.572069+0000","last_became_peered":"2023-12-20T04:24:05.572069+0000","last_unstale":"2023-12-20T04:24:06.941552+0000","last_undegraded":"2023-12-20T04:24:06.941552+0000","last_fullsized":"2023-12-20T04:24:06.941552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:55.949966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246690+0000","last_change":"2023-12-20T04:24:05.950238+0000","last_active":"2023-12-20T04:24:07.246690+0000","last_peered":"2023-12-20T04:24:07.246690+0000","last_clean":"2023-12-20T04:24:07.246690+0000","last_became_active":"2023-12-20T04:24:05.950012+0000","last_became_peered":"2023-12-20T04:24:05.950012+0000","last_unstale":"2023-12-20T04:24:07.246690+0000","last_undegraded":"2023-12-20T04:24:07.246690+0000","last_fullsized":"2023-12-20T04:24:07.246690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:44:55.112046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941819+0000","last_change":"2023-12-20T04:24:05.580183+0000","last_active":"2023-12-20T04:24:06.941819+0000","last_peered":"2023-12-20T04:24:06.941819+0000","last_clean":"2023-12-20T04:24:06.941819+0000","last_became_active":"2023-12-20T04:24:05.579888+0000","last_became_peered":"2023-12-20T04:24:05.579888+0000","last_unstale":"2023-12-20T04:24:06.941819+0000","last_undegraded":"2023-12-20T04:24:06.941819+0000","last_fullsized":"2023-12-20T04:24:06.941819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:25.835365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246890+0000","last_change":"2023-12-20T04:24:05.952689+0000","last_active":"2023-12-20T04:24:07.246890+0000","last_peered":"2023-12-20T04:24:07.246890+0000","last_clean":"2023-12-20T04:24:07.246890+0000","last_became_active":"2023-12-20T04:24:05.952445+0000","last_became_peered":"2023-12-20T04:24:05.952445+0000","last_unstale":"2023-12-20T04:24:07.246890+0000","last_undegraded":"2023-12-20T04:24:07.246890+0000","last_fullsized":"2023-12-20T04:24:07.246890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:57.526682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942047+0000","last_change":"2023-12-20T04:24:05.573111+0000","last_active":"2023-12-20T04:24:06.942047+0000","last_peered":"2023-12-20T04:24:06.942047+0000","last_clean":"2023-12-20T04:24:06.942047+0000","last_became_active":"2023-12-20T04:24:05.572810+0000","last_became_peered":"2023-12-20T04:24:05.572810+0000","last_unstale":"2023-12-20T04:24:06.942047+0000","last_undegraded":"2023-12-20T04:24:06.942047+0000","last_fullsized":"2023-12-20T04:24:06.942047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:50:21.676373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247610+0000","last_change":"2023-12-20T04:24:05.949703+0000","last_active":"2023-12-20T04:24:07.247610+0000","last_peered":"2023-12-20T04:24:07.247610+0000","last_clean":"2023-12-20T04:24:07.247610+0000","last_became_active":"2023-12-20T04:24:05.948666+0000","last_became_peered":"2023-12-20T04:24:05.948666+0000","last_unstale":"2023-12-20T04:24:07.247610+0000","last_undegraded":"2023-12-20T04:24:07.247610+0000","last_fullsized":"2023-12-20T04:24:07.247610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:56.954983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941017+0000","last_change":"2023-12-20T04:24:05.571924+0000","last_active":"2023-12-20T04:24:06.941017+0000","last_peered":"2023-12-20T04:24:06.941017+0000","last_clean":"2023-12-20T04:24:06.941017+0000","last_became_active":"2023-12-20T04:24:05.571649+0000","last_became_peered":"2023-12-20T04:24:05.571649+0000","last_unstale":"2023-12-20T04:24:06.941017+0000","last_undegraded":"2023-12-20T04:24:06.941017+0000","last_fullsized":"2023-12-20T04:24:06.941017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:53.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247159+0000","last_change":"2023-12-20T04:24:05.949535+0000","last_active":"2023-12-20T04:24:07.247159+0000","last_peered":"2023-12-20T04:24:07.247159+0000","last_clean":"2023-12-20T04:24:07.247159+0000","last_became_active":"2023-12-20T04:24:05.949280+0000","last_became_peered":"2023-12-20T04:24:05.949280+0000","last_unstale":"2023-12-20T04:24:07.247159+0000","last_undegraded":"2023-12-20T04:24:07.247159+0000","last_fullsized":"2023-12-20T04:24:07.247159+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:48:56.327844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941508+0000","last_change":"2023-12-20T04:24:05.573416+0000","last_active":"2023-12-20T04:24:06.941508+0000","last_peered":"2023-12-20T04:24:06.941508+0000","last_clean":"2023-12-20T04:24:06.941508+0000","last_became_active":"2023-12-20T04:24:05.573159+0000","last_became_peered":"2023-12-20T04:24:05.573159+0000","last_unstale":"2023-12-20T04:24:06.941508+0000","last_undegraded":"2023-12-20T04:24:06.941508+0000","last_fullsized":"2023-12-20T04:24:06.941508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:02:50.781343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247212+0000","last_change":"2023-12-20T04:24:05.949749+0000","last_active":"2023-12-20T04:24:07.247212+0000","last_peered":"2023-12-20T04:24:07.247212+0000","last_clean":"2023-12-20T04:24:07.247212+0000","last_became_active":"2023-12-20T04:24:05.949500+0000","last_became_peered":"2023-12-20T04:24:05.949500+0000","last_unstale":"2023-12-20T04:24:07.247212+0000","last_undegraded":"2023-12-20T04:24:07.247212+0000","last_fullsized":"2023-12-20T04:24:07.247212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:21:45.902052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246484+0000","last_change":"2023-12-20T04:24:05.574202+0000","last_active":"2023-12-20T04:24:07.246484+0000","last_peered":"2023-12-20T04:24:07.246484+0000","last_clean":"2023-12-20T04:24:07.246484+0000","last_became_active":"2023-12-20T04:24:05.573917+0000","last_became_peered":"2023-12-20T04:24:05.573917+0000","last_unstale":"2023-12-20T04:24:07.246484+0000","last_undegraded":"2023-12-20T04:24:07.246484+0000","last_fullsized":"2023-12-20T04:24:07.246484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:17.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246638+0000","last_change":"2023-12-20T04:24:05.949356+0000","last_active":"2023-12-20T04:24:07.246638+0000","last_peered":"2023-12-20T04:24:07.246638+0000","last_clean":"2023-12-20T04:24:07.246638+0000","last_became_active":"2023-12-20T04:24:05.949066+0000","last_became_peered":"2023-12-20T04:24:05.949066+0000","last_unstale":"2023-12-20T04:24:07.246638+0000","last_undegraded":"2023-12-20T04:24:07.246638+0000","last_fullsized":"2023-12-20T04:24:07.246638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:02:53.305915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247729+0000","last_change":"2023-12-20T04:24:05.571055+0000","last_active":"2023-12-20T04:24:07.247729+0000","last_peered":"2023-12-20T04:24:07.247729+0000","last_clean":"2023-12-20T04:24:07.247729+0000","last_became_active":"2023-12-20T04:24:05.570354+0000","last_became_peered":"2023-12-20T04:24:05.570354+0000","last_unstale":"2023-12-20T04:24:07.247729+0000","last_undegraded":"2023-12-20T04:24:07.247729+0000","last_fullsized":"2023-12-20T04:24:07.247729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:12:48.071265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247064+0000","last_change":"2023-12-20T04:24:05.945580+0000","last_active":"2023-12-20T04:24:07.247064+0000","last_peered":"2023-12-20T04:24:07.247064+0000","last_clean":"2023-12-20T04:24:07.247064+0000","last_became_active":"2023-12-20T04:24:05.944382+0000","last_became_peered":"2023-12-20T04:24:05.944382+0000","last_unstale":"2023-12-20T04:24:07.247064+0000","last_undegraded":"2023-12-20T04:24:07.247064+0000","last_fullsized":"2023-12-20T04:24:07.247064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:04.945194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:08.711079+0000","last_change":"2023-12-20T04:24:05.569981+0000","last_active":"2023-12-20T04:24:08.711079+0000","last_peered":"2023-12-20T04:24:08.711079+0000","last_clean":"2023-12-20T04:24:08.711079+0000","last_became_active":"2023-12-20T04:24:05.569725+0000","last_became_peered":"2023-12-20T04:24:05.569725+0000","last_unstale":"2023-12-20T04:24:08.711079+0000","last_undegraded":"2023-12-20T04:24:08.711079+0000","last_fullsized":"2023-12-20T04:24:08.711079+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:39:54.768628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941879+0000","last_change":"2023-12-20T04:24:05.945284+0000","last_active":"2023-12-20T04:24:06.941879+0000","last_peered":"2023-12-20T04:24:06.941879+0000","last_clean":"2023-12-20T04:24:06.941879+0000","last_became_active":"2023-12-20T04:24:05.945023+0000","last_became_peered":"2023-12-20T04:24:05.945023+0000","last_unstale":"2023-12-20T04:24:06.941879+0000","last_undegraded":"2023-12-20T04:24:06.941879+0000","last_fullsized":"2023-12-20T04:24:06.941879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:50:05.829088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247635+0000","last_change":"2023-12-20T04:24:05.577095+0000","last_active":"2023-12-20T04:24:07.247635+0000","last_peered":"2023-12-20T04:24:07.247635+0000","last_clean":"2023-12-20T04:24:07.247635+0000","last_became_active":"2023-12-20T04:24:05.576820+0000","last_became_peered":"2023-12-20T04:24:05.576820+0000","last_unstale":"2023-12-20T04:24:07.247635+0000","last_undegraded":"2023-12-20T04:24:07.247635+0000","last_fullsized":"2023-12-20T04:24:07.247635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:53.052492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940965+0000","last_change":"2023-12-20T04:24:05.936523+0000","last_active":"2023-12-20T04:24:06.940965+0000","last_peered":"2023-12-20T04:24:06.940965+0000","last_clean":"2023-12-20T04:24:06.940965+0000","last_became_active":"2023-12-20T04:24:05.936231+0000","last_became_peered":"2023-12-20T04:24:05.936231+0000","last_unstale":"2023-12-20T04:24:06.940965+0000","last_undegraded":"2023-12-20T04:24:06.940965+0000","last_fullsized":"2023-12-20T04:24:06.940965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:12.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942127+0000","last_change":"2023-12-20T04:24:05.569569+0000","last_active":"2023-12-20T04:24:06.942127+0000","last_peered":"2023-12-20T04:24:06.942127+0000","last_clean":"2023-12-20T04:24:06.942127+0000","last_became_active":"2023-12-20T04:24:05.569279+0000","last_became_peered":"2023-12-20T04:24:05.569279+0000","last_unstale":"2023-12-20T04:24:06.942127+0000","last_undegraded":"2023-12-20T04:24:06.942127+0000","last_fullsized":"2023-12-20T04:24:06.942127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:25.835365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.942027+0000","last_change":"2023-12-20T04:24:05.937392+0000","last_active":"2023-12-20T04:24:06.942027+0000","last_peered":"2023-12-20T04:24:06.942027+0000","last_clean":"2023-12-20T04:24:06.942027+0000","last_became_active":"2023-12-20T04:24:05.936741+0000","last_became_peered":"2023-12-20T04:24:05.936741+0000","last_unstale":"2023-12-20T04:24:06.942027+0000","last_undegraded":"2023-12-20T04:24:06.942027+0000","last_fullsized":"2023-12-20T04:24:06.942027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:07.445583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246666+0000","last_change":"2023-12-20T04:24:05.576415+0000","last_active":"2023-12-20T04:24:07.246666+0000","last_peered":"2023-12-20T04:24:07.246666+0000","last_clean":"2023-12-20T04:24:07.246666+0000","last_became_active":"2023-12-20T04:24:05.576084+0000","last_became_peered":"2023-12-20T04:24:05.576084+0000","last_unstale":"2023-12-20T04:24:07.246666+0000","last_undegraded":"2023-12-20T04:24:07.246666+0000","last_fullsized":"2023-12-20T04:24:07.246666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:01:29.477375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.246902+0000","last_change":"2023-12-20T04:24:05.956634+0000","last_active":"2023-12-20T04:24:07.246902+0000","last_peered":"2023-12-20T04:24:07.246902+0000","last_clean":"2023-12-20T04:24:07.246902+0000","last_became_active":"2023-12-20T04:24:05.956373+0000","last_became_peered":"2023-12-20T04:24:05.956373+0000","last_unstale":"2023-12-20T04:24:07.246902+0000","last_undegraded":"2023-12-20T04:24:07.246902+0000","last_fullsized":"2023-12-20T04:24:07.246902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:03.633486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941642+0000","last_change":"2023-12-20T04:24:05.575072+0000","last_active":"2023-12-20T04:24:06.941642+0000","last_peered":"2023-12-20T04:24:06.941642+0000","last_clean":"2023-12-20T04:24:06.941642+0000","last_became_active":"2023-12-20T04:24:05.574821+0000","last_became_peered":"2023-12-20T04:24:05.574821+0000","last_unstale":"2023-12-20T04:24:06.941642+0000","last_undegraded":"2023-12-20T04:24:06.941642+0000","last_fullsized":"2023-12-20T04:24:06.941642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:56.521665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.941472+0000","last_change":"2023-12-20T04:24:05.948619+0000","last_active":"2023-12-20T04:24:06.941472+0000","last_peered":"2023-12-20T04:24:06.941472+0000","last_clean":"2023-12-20T04:24:06.941472+0000","last_became_active":"2023-12-20T04:24:05.947629+0000","last_became_peered":"2023-12-20T04:24:05.947629+0000","last_unstale":"2023-12-20T04:24:06.941472+0000","last_undegraded":"2023-12-20T04:24:06.941472+0000","last_fullsized":"2023-12-20T04:24:06.941472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:13:12.244884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247094+0000","last_change":"2023-12-20T04:24:05.575220+0000","last_active":"2023-12-20T04:24:07.247094+0000","last_peered":"2023-12-20T04:24:07.247094+0000","last_clean":"2023-12-20T04:24:07.247094+0000","last_became_active":"2023-12-20T04:24:05.574953+0000","last_became_peered":"2023-12-20T04:24:05.574953+0000","last_unstale":"2023-12-20T04:24:07.247094+0000","last_undegraded":"2023-12-20T04:24:07.247094+0000","last_fullsized":"2023-12-20T04:24:07.247094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:42:03.002718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:07.247418+0000","last_change":"2023-12-20T04:24:05.949843+0000","last_active":"2023-12-20T04:24:07.247418+0000","last_peered":"2023-12-20T04:24:07.247418+0000","last_clean":"2023-12-20T04:24:07.247418+0000","last_became_active":"2023-12-20T04:24:05.949559+0000","last_became_peered":"2023-12-20T04:24:05.949559+0000","last_unstale":"2023-12-20T04:24:07.247418+0000","last_undegraded":"2023-12-20T04:24:07.247418+0000","last_fullsized":"2023-12-20T04:24:07.247418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:05.550107+0000","last_clean_scrub_stamp":"2023-12-20T04:24:05.550107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:51.081089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-20T04:24:06.940804+0000","last_change":"2023-12-20T04:24:05.569452+0000","last_active":"2023-12-20T04:24:06.940804+0000","last_peered":"2023-12-20T04:24:06.940804+0000","last_clean":"2023-12-20T04:24:06.940804+0000","last_became_active":"2023-12-20T04:24:05.569110+0000","last_became_peered":"2023-12-20T04:24:05.569110+0000","last_unstale":"2023-12-20T04:24:06.940804+0000","last_undegraded":"2023-12-20T04:24:06.940804+0000","last_fullsized":"2023-12-20T04:24:06.940804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:24:04.545089+0000","last_clean_scrub_stamp":"2023-12-20T04:24:04.545089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:22.752853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-20T04:24:05.940311+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T04:24:05.940311+0000","last_peered":"2023-12-20T04:24:05.940311+0000","last_clean":"2023-12-20T04:24:05.940311+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T04:24:05.940311+0000","last_undegraded":"2023-12-20T04:24:05.940311+0000","last_fullsized":"2023-12-20T04:24:05.940311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":942080,"data_stored":724630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T04:24:14.014 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:24:14.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:24:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.162+0000 7f166e6af640 1 Processor -- start 2023-12-20T04:24:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.162+0000 7f166e6af640 1 -- start start 2023-12-20T04:24:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f166e6af640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f16680b8210 0x7f16680b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f166e6af640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16680b7d80 con 0x7f16680b5a80 2023-12-20T04:24:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f166e6af640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16680b5fd0 con 0x7f16680bae10 2023-12-20T04:24:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f166e6af640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680b7a10 con 0x7f16680b8210 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f166cc4c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16680b5a80 0x7f1668142730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43142/0 (socket says 172.21.15.40:43142) 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f166cc4c640 1 -- 172.21.15.40:0/1986832342 learned_addr learned my addr 172.21.15.40:0/1986832342 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f16677fe640 1 --2- 172.21.15.40:0/1986832342 >> v2:172.21.15.69:3300/0 conn(0x7f16680b8210 0x7f16680b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.163+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640816967 0 0) 0x7f16680b7d80 con 0x7f16680b5a80 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.164+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1654003520 con 0x7f16680b5a80 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.164+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371797033 0 0) 0x7f16680b5fd0 con 0x7f16680bae10 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.164+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16680b7d80 con 0x7f16680bae10 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.164+0000 7f16677fe640 1 -- 172.21.15.40:0/1986832342 >> v1:172.21.15.69:6789/0 conn(0x7f16680bae10 legacy=0x7f166814beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.164+0000 7f16677fe640 1 -- 172.21.15.40:0/1986832342 >> v1:172.21.15.40:6789/0 conn(0x7f16680b5a80 legacy=0x7f1668142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.164+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101817201 0 0) 0x7f1654003520 con 0x7f16680b5a80 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.164+0000 7f16677fe640 1 -- 172.21.15.40:0/1986832342 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680bb1f0 con 0x7f16680b8210 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f16677fe640 1 --2- 172.21.15.40:0/1986832342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 0x7f16680b5540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16500097a0 tx=0x7f165002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cd0949b90582ee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165002f050 con 0x7f16680b8210 2023-12-20T04:24:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650031500 con 0x7f16680b8210 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f1666ffd640 1 -- 172.21.15.40:0/1986832342 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16600019f0 con 0x7f16680b8210 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f166e6af640 1 -- 172.21.15.40:0/1986832342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 msgr2=0x7f16680b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f166e6af640 1 --2- 172.21.15.40:0/1986832342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 0x7f16680b5540 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16500097a0 tx=0x7f165002b820 comp rx=0 tx=0).stop 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f166e6af640 1 -- 172.21.15.40:0/1986832342 shutdown_connections 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f166e6af640 1 --2- 172.21.15.40:0/1986832342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 0x7f16680b5540 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f166e6af640 1 -- 172.21.15.40:0/1986832342 >> 172.21.15.40:0/1986832342 conn(0x7f1668069ba0 msgr2=0x7f1668069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f166e6af640 1 -- 172.21.15.40:0/1986832342 shutdown_connections 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.165+0000 7f166e6af640 1 -- 172.21.15.40:0/1986832342 wait complete. 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.166+0000 7f166e6af640 1 Processor -- start 2023-12-20T04:24:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166e6af640 1 -- start start 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166e6af640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16680b5a80 0x7f16681e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166e6af640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 0x7f16680bcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166e6af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16680bae10 0x7f1668145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166e6af640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16681461e0 con 0x7f16680bae10 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166e6af640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680bc700 con 0x7f16680b8210 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166e6af640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16681e1ea0 con 0x7f16680b5a80 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166cc4c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16680bae10 0x7f1668145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166cc4c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16680bae10 0x7f1668145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53274/0 (socket says 172.21.15.40:53274) 2023-12-20T04:24:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f166cc4c640 1 -- 172.21.15.40:0/1869996110 learned_addr learned my addr 172.21.15.40:0/1869996110 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f16677fe640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 0x7f16680bcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.167+0000 7f1667fff640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16680b5a80 0x7f16681e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166cc4c640 1 -- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16680b5a80 msgr2=0x7f16681e0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166cc4c640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16680b5a80 0x7f16681e0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166cc4c640 1 -- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 msgr2=0x7f16680bcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166cc4c640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 0x7f16680bcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166cc4c640 1 -- 172.21.15.40:0/1869996110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650009400 con 0x7f16680bae10 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166cc4c640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16680bae10 0x7f1668145ca0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1660001f80 tx=0x7f166000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f1664ff9640 1 -- 172.21.15.40:0/1869996110 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660012400 con 0x7f16680bae10 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f1664ff9640 1 -- 172.21.15.40:0/1869996110 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1660012560 con 0x7f16680bae10 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16680be320 con 0x7f16680bae10 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f1664ff9640 1 -- 172.21.15.40:0/1869996110 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660012930 con 0x7f16680bae10 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.168+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16681433d0 con 0x7f16680bae10 2023-12-20T04:24:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.169+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16680bc890 con 0x7f16680bae10 2023-12-20T04:24:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.169+0000 7f1664ff9640 1 -- 172.21.15.40:0/1869996110 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1660012a90 con 0x7f16680bae10 2023-12-20T04:24:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.170+0000 7f1664ff9640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f164806a460 0x7f164806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.170+0000 7f1664ff9640 1 -- 172.21.15.40:0/1869996110 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1660088fd0 con 0x7f16680bae10 2023-12-20T04:24:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.170+0000 7f1667fff640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f164806a460 0x7f164806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.170+0000 7f1667fff640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f164806a460 0x7f164806c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f16580011e0 tx=0x7f1658009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:14.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.174+0000 7f1664ff9640 1 -- 172.21.15.40:0/1869996110 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1660054700 con 0x7f16680bae10 2023-12-20T04:24:14.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.419+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f16680740a0 con 0x7f16680bae10 2023-12-20T04:24:14.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.423+0000 7f1664ff9640 1 -- 172.21.15.40:0/1869996110 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1660057d20 con 0x7f16680bae10 2023-12-20T04:24:14.423 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f164806a460 msgr2=0x7f164806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f164806a460 0x7f164806c920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f16580011e0 tx=0x7f1658009040 comp rx=0 tx=0).stop 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16680bae10 msgr2=0x7f1668145ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16680bae10 0x7f1668145ca0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1660001f80 tx=0x7f166000a430 comp rx=0 tx=0).stop 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 shutdown_connections 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f164806a460 0x7f164806c920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16680bae10 0x7f1668145ca0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16680b8210 0x7f16680bcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 --2- 172.21.15.40:0/1869996110 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f16680b5a80 0x7f16681e0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 >> 172.21.15.40:0/1869996110 conn(0x7f1668069ba0 msgr2=0x7f16680b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:14.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 shutdown_connections 2023-12-20T04:24:14.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.425+0000 7f166e6af640 1 -- 172.21.15.40:0/1869996110 wait complete. 2023-12-20T04:24:14.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:24:14.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.541+0000 7f64a3b47640 1 Processor -- start 2023-12-20T04:24:14.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.541+0000 7f64a3b47640 1 -- start start 2023-12-20T04:24:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a3b47640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f649c0bcdd0 0x7f649c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a3b47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c0b64c0 0x7f649c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a3b47640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f649c144cd0 0x7f649c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a3b47640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0bc6b0 con 0x7f649c0bcdd0 2023-12-20T04:24:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a3b47640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0b6900 con 0x7f649c144cd0 2023-12-20T04:24:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a3b47640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c0a59f0 con 0x7f649c0b64c0 2023-12-20T04:24:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a18e3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f649c0bcdd0 0x7f649c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a18e3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f649c0bcdd0 0x7f649c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53282/0 (socket says 172.21.15.40:53282) 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a18e3640 1 -- 172.21.15.40:0/672237849 learned_addr learned my addr 172.21.15.40:0/672237849 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a10e2640 1 --2- 172.21.15.40:0/672237849 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c0b64c0 0x7f649c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a20e4640 1 --2- 172.21.15.40:0/672237849 >> v2:172.21.15.69:3300/0 conn(0x7f649c144cd0 0x7f649c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.542+0000 7f64a18e3640 1 -- 172.21.15.40:0/672237849 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c0b64c0 msgr2=0x7f649c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a18e3640 1 --2- 172.21.15.40:0/672237849 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c0b64c0 0x7f649c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a18e3640 1 -- 172.21.15.40:0/672237849 >> v2:172.21.15.69:3300/0 conn(0x7f649c144cd0 msgr2=0x7f649c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a18e3640 1 --2- 172.21.15.40:0/672237849 >> v2:172.21.15.69:3300/0 conn(0x7f649c144cd0 0x7f649c14e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a18e3640 1 -- 172.21.15.40:0/672237849 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c0bc0a0 con 0x7f649c0bcdd0 2023-12-20T04:24:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a18e3640 1 --2- 172.21.15.40:0/672237849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0bcdd0 0x7f649c0b5f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f649c1486d0 tx=0x7f649402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fe9c7011a9f251 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a08e1640 1 -- 172.21.15.40:0/672237849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494030860 con 0x7f649c0bcdd0 2023-12-20T04:24:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a08e1640 1 -- 172.21.15.40:0/672237849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64940309c0 con 0x7f649c0bcdd0 2023-12-20T04:24:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.543+0000 7f64a08e1640 1 -- 172.21.15.40:0/672237849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494030d50 con 0x7f649c0bcdd0 2023-12-20T04:24:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 -- 172.21.15.40:0/672237849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0bcdd0 msgr2=0x7f649c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 --2- 172.21.15.40:0/672237849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0bcdd0 0x7f649c0b5f80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f649c1486d0 tx=0x7f649402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 -- 172.21.15.40:0/672237849 shutdown_connections 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 --2- 172.21.15.40:0/672237849 >> v2:172.21.15.69:3300/0 conn(0x7f649c144cd0 0x7f649c14e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 --2- 172.21.15.40:0/672237849 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c0b64c0 0x7f649c144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 --2- 172.21.15.40:0/672237849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0bcdd0 0x7f649c0b5f80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 -- 172.21.15.40:0/672237849 >> 172.21.15.40:0/672237849 conn(0x7f649c071e60 msgr2=0x7f649c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 -- 172.21.15.40:0/672237849 shutdown_connections 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.544+0000 7f64a3b47640 1 -- 172.21.15.40:0/672237849 wait complete. 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.545+0000 7f64a3b47640 1 Processor -- start 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.545+0000 7f64a3b47640 1 -- start start 2023-12-20T04:24:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a3b47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0b64c0 0x7f649c1453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a3b47640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f649c0bcdd0 0x7f649c1d2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a3b47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c144cd0 0x7f649c13f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a3b47640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1477b0 con 0x7f649c0b64c0 2023-12-20T04:24:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a3b47640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1470f0 con 0x7f649c0bcdd0 2023-12-20T04:24:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a3b47640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1473d0 con 0x7f649c144cd0 2023-12-20T04:24:14.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0b64c0 0x7f649c1453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0b64c0 0x7f649c1453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53296/0 (socket says 172.21.15.40:53296) 2023-12-20T04:24:14.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 -- 172.21.15.40:0/2043779864 learned_addr learned my addr 172.21.15.40:0/2043779864 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:14.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a10e2640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f649c0bcdd0 0x7f649c1d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a20e4640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c144cd0 0x7f649c13f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 -- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c144cd0 msgr2=0x7f649c13f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c144cd0 0x7f649c13f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 -- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f649c0bcdd0 msgr2=0x7f649c1d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f649c0bcdd0 0x7f649c1d2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 -- 172.21.15.40:0/2043779864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940094d0 con 0x7f649c0b64c0 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.546+0000 7f64a18e3640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0b64c0 0x7f649c1453f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6494000c00 tx=0x7f6494004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.547+0000 7f649a7fc640 1 -- 172.21.15.40:0/2043779864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494039d40 con 0x7f649c0b64c0 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.547+0000 7f649a7fc640 1 -- 172.21.15.40:0/2043779864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6494043400 con 0x7f649c0b64c0 2023-12-20T04:24:14.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.547+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c146da0 con 0x7f649c0b64c0 2023-12-20T04:24:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.547+0000 7f649a7fc640 1 -- 172.21.15.40:0/2043779864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6494039ea0 con 0x7f649c0b64c0 2023-12-20T04:24:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.547+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c1d2a60 con 0x7f649c0b64c0 2023-12-20T04:24:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.548+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649c1478f0 con 0x7f649c0b64c0 2023-12-20T04:24:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.548+0000 7f649a7fc640 1 -- 172.21.15.40:0/2043779864 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f64940437b0 con 0x7f649c0b64c0 2023-12-20T04:24:14.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.548+0000 7f649a7fc640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f648806a430 0x7f648806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.549+0000 7f649a7fc640 1 -- 172.21.15.40:0/2043779864 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f649403e070 con 0x7f649c0b64c0 2023-12-20T04:24:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.549+0000 7f64a10e2640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f648806a430 0x7f648806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.549+0000 7f64a10e2640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f648806a430 0x7f648806c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6490006fd0 tx=0x7f6490008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:14.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.553+0000 7f649a7fc640 1 -- 172.21.15.40:0/2043779864 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6494077220 con 0x7f649c0b64c0 2023-12-20T04:24:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.766+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f649c06c030 con 0x7f649c0b64c0 2023-12-20T04:24:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.766+0000 7f649a7fc640 1 -- 172.21.15.40:0/2043779864 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3952 (secure 0 0 0) 0x7f649407a840 con 0x7f649c0b64c0 2023-12-20T04:24:14.768 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:14.768 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1306717467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1306717467},{"type":"v1","addr":"172.21.15.40:6835","nonce":1306717467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4625,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1583424120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1583424120},{"type":"v1","addr":"172.21.15.69:6835","nonce":1583424120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:24:05.927869+0000","modified":"2023-12-20T04:24:08.263654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/3041271085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3041271085},{"type":"v1","addr":"172.21.15.40:6834","nonce":3041271085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:24:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2023-12-20T04:24:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f648806a430 msgr2=0x7f648806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f648806a430 0x7f648806c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6490006fd0 tx=0x7f6490008040 comp rx=0 tx=0).stop 2023-12-20T04:24:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0b64c0 msgr2=0x7f649c1453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0b64c0 0x7f649c1453f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6494000c00 tx=0x7f6494004730 comp rx=0 tx=0).stop 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 shutdown_connections 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f648806a430 0x7f648806c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f649c144cd0 0x7f649c13f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f649c0bcdd0 0x7f649c1d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 --2- 172.21.15.40:0/2043779864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0b64c0 0x7f649c1453f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 >> 172.21.15.40:0/2043779864 conn(0x7f649c071e60 msgr2=0x7f649c1d50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 shutdown_connections 2023-12-20T04:24:14.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:14.768+0000 7f64a3b47640 1 -- 172.21.15.40:0/2043779864 wait complete. 2023-12-20T04:24:15.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:24:05.927869+0000', 'modified': '2023-12-20T04:24:08.263654+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4932}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4932': {'gid': 4932, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6834/3041271085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6832', 'nonce': 3041271085}, {'type': 'v1', 'addr': '172.21.15.40:6834', 'nonce': 3041271085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:24:15.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:24:15.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-20T04:24:15.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.192+0000 7fa238d89640 1 Processor -- start 2023-12-20T04:24:15.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.192+0000 7fa238d89640 1 -- start start 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa238d89640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2340bab80 0x7fa23414b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa238d89640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa2340b8b40 0x7fa234155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa238d89640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2340b6da0 con 0x7fa234144e30 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa238d89640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2340b8090 con 0x7fa2340bab80 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa238d89640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23414afe0 con 0x7fa2340b8b40 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa231d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2340bab80 0x7fa23414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa231d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2340bab80 0x7fa23414b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53300/0 (socket says 172.21.15.40:53300) 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa231d9b640 1 -- 172.21.15.40:0/3896456073 learned_addr learned my addr 172.21.15.40:0/3896456073 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa23259c640 1 --1- 172.21.15.40:0/3896456073 >> v1:172.21.15.40:6789/0 conn(0x7fa234144e30 0x7fa2340b7600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43152/0 (socket says 172.21.15.40:43152) 2023-12-20T04:24:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa232d9d640 1 --2- 172.21.15.40:0/3896456073 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa2340b8b40 0x7fa234155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa231d9b640 1 -- 172.21.15.40:0/3896456073 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa2340b8b40 msgr2=0x7fa234155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa231d9b640 1 --2- 172.21.15.40:0/3896456073 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa2340b8b40 0x7fa234155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa231d9b640 1 -- 172.21.15.40:0/3896456073 >> v1:172.21.15.40:6789/0 conn(0x7fa234144e30 legacy=0x7fa2340b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa23159a640 1 -- 172.21.15.40:0/3896456073 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750931521 0 0) 0x7fa224001490 con 0x7fa234144e30 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.193+0000 7fa231d9b640 1 -- 172.21.15.40:0/3896456073 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234145210 con 0x7fa2340bab80 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.194+0000 7fa231d9b640 1 --2- 172.21.15.40:0/3896456073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340bab80 0x7fa23414b470 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009850 tx=0x7fa21c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a352140a3859ca server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.194+0000 7fa23159a640 1 -- 172.21.15.40:0/3896456073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004230 con 0x7fa2340bab80 2023-12-20T04:24:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.194+0000 7fa23159a640 1 -- 172.21.15.40:0/3896456073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c004390 con 0x7fa2340bab80 2023-12-20T04:24:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.194+0000 7fa23159a640 1 -- 172.21.15.40:0/3896456073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c003810 con 0x7fa2340bab80 2023-12-20T04:24:15.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 -- 172.21.15.40:0/3896456073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340bab80 msgr2=0x7fa23414b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 --2- 172.21.15.40:0/3896456073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340bab80 0x7fa23414b470 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009850 tx=0x7fa21c02b9f0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 -- 172.21.15.40:0/3896456073 shutdown_connections 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 --2- 172.21.15.40:0/3896456073 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa2340b8b40 0x7fa234155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 --2- 172.21.15.40:0/3896456073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340bab80 0x7fa23414b470 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 -- 172.21.15.40:0/3896456073 >> 172.21.15.40:0/3896456073 conn(0x7fa2340c0200 msgr2=0x7fa2340c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 -- 172.21.15.40:0/3896456073 shutdown_connections 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.195+0000 7fa238d89640 1 -- 172.21.15.40:0/3896456073 wait complete. 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.196+0000 7fa238d89640 1 Processor -- start 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.196+0000 7fa238d89640 1 -- start start 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.196+0000 7fa238d89640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340b8b40 0x7fa2340b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.196+0000 7fa238d89640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2340bab80 0x7fa2341dff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.196+0000 7fa238d89640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa234144e30 0x7fa2340ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa238d89640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340b24a0 con 0x7fa2340b8b40 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa238d89640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341d7600 con 0x7fa2340bab80 2023-12-20T04:24:15.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa238d89640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341d78e0 con 0x7fa234144e30 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340b8b40 0x7fa2340b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340b8b40 0x7fa2340b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53306/0 (socket says 172.21.15.40:53306) 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 -- 172.21.15.40:0/2687228423 learned_addr learned my addr 172.21.15.40:0/2687228423 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa232d9d640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa234144e30 0x7fa2340ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa231d9b640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2340bab80 0x7fa2341dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 -- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa234144e30 msgr2=0x7fa2340ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa234144e30 0x7fa2340ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 -- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2340bab80 msgr2=0x7fa2341dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2340bab80 0x7fa2341dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 -- 172.21.15.40:0/2687228423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c009460 con 0x7fa2340b8b40 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa23259c640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340b8b40 0x7fa2340b1f60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c7c0 tx=0x7fa22400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa22affd640 1 -- 172.21.15.40:0/2687228423 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400a5e0 con 0x7fa2340b8b40 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa22affd640 1 -- 172.21.15.40:0/2687228423 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400a760 con 0x7fa2340b8b40 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2341df700 con 0x7fa2340b8b40 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa22affd640 1 -- 172.21.15.40:0/2687228423 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400ab10 con 0x7fa2340b8b40 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.197+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2341d0ae0 con 0x7fa2340b8b40 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.199+0000 7fa22affd640 1 -- 172.21.15.40:0/2687228423 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa22400ac70 con 0x7fa2340b8b40 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.199+0000 7fa22affd640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa21406a460 0x7fa21406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.199+0000 7fa22affd640 1 -- 172.21.15.40:0/2687228423 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa224087e80 con 0x7fa2340b8b40 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.200+0000 7fa231d9b640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa21406a460 0x7fa21406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.200+0000 7fa231d9b640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa21406a460 0x7fa21406c920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa21c035000 tx=0x7fa21c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.200+0000 7fa23b9d1740 1 Processor -- start 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23b9d1740 1 -- start start 2023-12-20T04:24:15.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb21ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb21f100 0x55eebb24fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb250560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb18e0b0 con 0x55eebb25a800 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb18b840 con 0x55eebb21f100 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eebb187130 con 0x55eebb2500e0 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb21ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb21ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53322/0 (socket says 172.21.15.40:53322) 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 -- 172.21.15.40:0/2138272810 learned_addr learned my addr 172.21.15.40:0/2138272810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa231d9b640 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb21f100 0x55eebb24fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa232d9d640 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb250560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 -- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 msgr2=0x55eebb250560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb250560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 -- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb21f100 msgr2=0x55eebb24fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb21f100 0x55eebb24fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.201+0000 7fa23259c640 1 -- 172.21.15.40:0/2138272810 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eebb141c40 con 0x55eebb25a800 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23259c640 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb21ebc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2240863d0 tx=0x7fa2240570e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f93655d8db2f24 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa213fff640 1 -- 172.21.15.40:0/2138272810 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22405d070 con 0x55eebb25a800 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa213fff640 1 -- 172.21.15.40:0/2138272810 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224059040 con 0x55eebb25a800 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa213fff640 1 -- 172.21.15.40:0/2138272810 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22405f110 con 0x55eebb25a800 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2138272810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 msgr2=0x55eebb21ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb21ebc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa2240863d0 tx=0x7fa2240570e0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2138272810 shutdown_connections 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb250560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb21f100 0x55eebb24fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2138272810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb21ebc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.202+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2138272810 >> 172.21.15.40:0/2138272810 conn(0x55eebb2205f0 msgr2=0x55eebb259f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.203+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2138272810 shutdown_connections 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.203+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2138272810 wait complete. 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.203+0000 7fa23b9d1740 1 -- start start 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.203+0000 7fa23b9d1740 1 Processor -- start 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb24e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb24cb50 0x55eebb24f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb145840 con 0x55eebb25a800 2023-12-20T04:24:15.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb1454e0 con 0x55eebb2500e0 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eebb10b230 con 0x55eebb24cb50 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23b9d1740 10 client.0 _ll_register_callbacks cb 0x55eebb15c6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2667b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53328/0 (socket says 172.21.15.40:53328) 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 -- 172.21.15.40:0/2115004786 learned_addr learned my addr 172.21.15.40:0/2115004786 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa232d9d640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb24cb50 0x55eebb24f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23259c640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb24e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 -- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb24cb50 msgr2=0x55eebb24f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb24cb50 0x55eebb24f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 -- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 msgr2=0x55eebb24e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb24e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 -- 172.21.15.40:0/2115004786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2341d0ae0 con 0x55eebb25a800 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa23259c640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb24e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa231d9b640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2667b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa21c02c000 tx=0x7fa21c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403c74a3812aaa40 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.204+0000 7fa2117fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa2117fa640 1 -- 172.21.15.40:0/2115004786 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c04c070 con 0x55eebb25a800 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa2117fa640 1 -- 172.21.15.40:0/2115004786 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa21c003db0 con 0x55eebb25a800 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eebb1b0970 con 0x55eebb25a800 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa2117fa640 1 -- 172.21.15.40:0/2115004786 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa21c02f610 con 0x55eebb25a800 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 10 client.5145 fetch_fsmap learned FSMap version 13 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55eebb1857b0 con 0x55eebb25a800 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa2117fa640 1 -- 172.21.15.40:0/2115004786 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eebb1b0970 con 0x55eebb25a800 2023-12-20T04:24:15.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa2117fa640 1 -- 172.21.15.40:0/2115004786 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 13) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fa21c041070 con 0x55eebb25a800 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 10 client.5145 fetch_fsmap finished waiting for FSMap version 13 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 10 client.5145 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 20 client.5145 populate_metadata read hostname 'smithi040' 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb26a080 0x55eebb26a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 4 client.5145 mds_command: new command op to 4932 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 --> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eebb178f00 con 0x55eebb26a080 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23259c640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb26a080 0x55eebb26a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa2117fa640 10 client.5145 ms_handle_connect on v2:172.21.15.40:6832/3041271085 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.205+0000 7fa23259c640 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb26a080 0x55eebb26a460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29063536093e986 server_cookie=1c8c6bcf9bc2f910 in_seq=0 out_seq=0 2023-12-20T04:24:15.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa2117fa640 1 -- 172.21.15.40:0/2115004786 <== mds.0 v2:172.21.15.40:6832/3041271085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55eebb178f00 con 0x55eebb26a080 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa2117fa640 10 client.5145 handle_command_reply: tid=0 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 client.5145 shutdown 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 msgr2=0x55eebb2667b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2667b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa21c02c000 tx=0x7fa21c004730 comp rx=0 tx=0).stop 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 shutdown_connections 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb26a080 0x55eebb26a460 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb24cb50 0x55eebb24f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa2117fa640 0 client.5145 ms_handle_reset on v2:172.21.15.40:6832/3041271085 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2667b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/2115004786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb24e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 >> 172.21.15.40:0/2115004786 conn(0x55eebb21f100 msgr2=0x55eebb24b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 shutdown_connections 2023-12-20T04:24:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 1 -- 172.21.15.40:0/2115004786 wait complete. 2023-12-20T04:24:15.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.206+0000 7fa23b9d1740 20 client.5145 trim_cache size 0 max 16384 2023-12-20T04:24:15.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.221+0000 7fa23b9d1740 1 Processor -- start 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.221+0000 7fa23b9d1740 1 -- start start 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb24cb50 0x55eebb270940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb21d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb25a800 0x55eebb223a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb1bc440 con 0x55eebb24cb50 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb21f4e0 con 0x55eebb2500e0 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eebb249e50 con 0x55eebb25a800 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb24cb50 0x55eebb270940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb24cb50 0x55eebb270940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53338/0 (socket says 172.21.15.40:53338) 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 -- 172.21.15.40:0/3082685867 learned_addr learned my addr 172.21.15.40:0/3082685867 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 -- 172.21.15.40:0/3082685867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb25a800 msgr2=0x55eebb223a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 --2- 172.21.15.40:0/3082685867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb25a800 0x55eebb223a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 -- 172.21.15.40:0/3082685867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 msgr2=0x55eebb21d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 --2- 172.21.15.40:0/3082685867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb21d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 -- 172.21.15.40:0/3082685867 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eebb127be0 con 0x55eebb24cb50 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa23259c640 1 --2- 172.21.15.40:0/3082685867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb24cb50 0x55eebb270940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa2240012e0 tx=0x7fa22405d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2915b1e2fa4d420f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa228ff9640 1 -- 172.21.15.40:0/3082685867 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22405f190 con 0x55eebb24cb50 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa228ff9640 1 -- 172.21.15.40:0/3082685867 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2240860c0 con 0x55eebb24cb50 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.222+0000 7fa228ff9640 1 -- 172.21.15.40:0/3082685867 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240538f0 con 0x55eebb24cb50 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3082685867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb24cb50 msgr2=0x55eebb270940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3082685867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb24cb50 0x55eebb270940 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa2240012e0 tx=0x7fa22405d000 comp rx=0 tx=0).stop 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3082685867 shutdown_connections 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3082685867 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb25a800 0x55eebb223a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3082685867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb2500e0 0x55eebb21d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3082685867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb24cb50 0x55eebb270940 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3082685867 >> 172.21.15.40:0/3082685867 conn(0x55eebb21f100 msgr2=0x55eebb2232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3082685867 shutdown_connections 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3082685867 wait complete. 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 -- start start 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.223+0000 7fa23b9d1740 1 Processor -- start 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb24cb50 0x55eebb2226e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb255f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23b9d1740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2b7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb256ab0 con 0x55eebb25a800 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eebb2c0a70 con 0x55eebb24cb50 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23b9d1740 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eebb21db80 con 0x55eebb2500e0 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23b9d1740 10 client.0 _ll_register_callbacks cb 0x7fa22400ced0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:24:15.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa232d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa232d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2b7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53350/0 (socket says 172.21.15.40:53350) 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa232d9d640 1 -- 172.21.15.40:0/3732732585 learned_addr learned my addr 172.21.15.40:0/3732732585 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa231d9b640 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb255f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.224+0000 7fa23259c640 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb24cb50 0x55eebb2226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa232d9d640 1 -- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 msgr2=0x55eebb255f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa232d9d640 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb255f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa232d9d640 1 -- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb24cb50 msgr2=0x55eebb2226e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa232d9d640 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb24cb50 0x55eebb2226e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa232d9d640 1 -- 172.21.15.40:0/3732732585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eebb141c40 con 0x55eebb25a800 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa232d9d640 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2b7070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0157e0 tx=0x7fa22c0158d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1838c2c20c40db server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa2117fa640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa2117fa640 1 -- 172.21.15.40:0/3732732585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c01a070 con 0x55eebb25a800 2023-12-20T04:24:15.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa2117fa640 1 -- 172.21.15.40:0/3732732585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa22c004300 con 0x55eebb25a800 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa224059040 con 0x55eebb25a800 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa2117fa640 1 -- 172.21.15.40:0/3732732585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa22c0044c0 con 0x55eebb25a800 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 10 client.5151 fetch_fsmap learned FSMap version 13 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55eebb14d2f0 con 0x55eebb25a800 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa2117fa640 1 -- 172.21.15.40:0/3732732585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224059040 con 0x55eebb25a800 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa2117fa640 1 -- 172.21.15.40:0/3732732585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 13) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fa22c011040 con 0x55eebb25a800 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 10 client.5151 fetch_fsmap finished waiting for FSMap version 13 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 10 client.5151 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 20 client.5151 populate_metadata read hostname 'smithi040' 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb24d380 0x55eebb24d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 4 client.5151 mds_command: new command op to 4932 tid=0[{"prefix": "status"}] 2023-12-20T04:24:15.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 --> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55eebb1801b0 con 0x55eebb24d380 2023-12-20T04:24:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.225+0000 7fa23259c640 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb24d380 0x55eebb24d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa2117fa640 10 client.5151 ms_handle_connect on v2:172.21.15.40:6832/3041271085 2023-12-20T04:24:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23259c640 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb24d380 0x55eebb24d760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff0342ac622d07f server_cookie=a31541e304dee917 in_seq=0 out_seq=0 2023-12-20T04:24:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa2117fa640 1 -- 172.21.15.40:0/3732732585 <== mds.0 v2:172.21.15.40:6832/3041271085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55eebb1801b0 con 0x55eebb24d380 2023-12-20T04:24:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa2117fa640 10 client.5151 handle_command_reply: tid=0 2023-12-20T04:24:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 client.5151 shutdown 2023-12-20T04:24:15.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 msgr2=0x55eebb2b7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2b7070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0157e0 tx=0x7fa22c0158d0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 shutdown_connections 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55eebb25a800 0x55eebb2b7070 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.40:6832/3041271085,v1:172.21.15.40:6834/3041271085] conn(0x55eebb24d380 0x55eebb24d760 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x55eebb2500e0 0x55eebb255f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 --2- 172.21.15.40:0/3732732585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eebb24cb50 0x55eebb2226e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa2117fa640 0 client.5151 ms_handle_reset on v2:172.21.15.40:6832/3041271085 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 >> 172.21.15.40:0/3732732585 conn(0x55eebb21f100 msgr2=0x55eebb21d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 shutdown_connections 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 1 -- 172.21.15.40:0/3732732585 wait complete. 2023-12-20T04:24:15.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.226+0000 7fa23b9d1740 20 client.5151 trim_cache size 0 max 16384 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "9ed6574e-2792-4eae-92b0-945f286f0eed", 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4932, 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-12-20T04:24:15.238 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 9.2976835930000004, 2023-12-20T04:24:15.239 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 13, 2023-12-20T04:24:15.239 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 31, 2023-12-20T04:24:15.239 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 31, 2023-12-20T04:24:15.239 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 16.519821869000001 2023-12-20T04:24:15.239 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T04:24:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa21406a460 msgr2=0x7fa21406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa21406a460 0x7fa21406c920 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa21c035000 tx=0x7fa21c008030 comp rx=0 tx=0).stop 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340b8b40 msgr2=0x7fa2340b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340b8b40 0x7fa2340b1f60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c7c0 tx=0x7fa22400cc80 comp rx=0 tx=0).stop 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 shutdown_connections 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fa21406a460 0x7fa21406c920 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fa234144e30 0x7fa2340ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2340bab80 0x7fa2341dff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 --2- 172.21.15.40:0/2687228423 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2340b8b40 0x7fa2340b1f60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 >> 172.21.15.40:0/2687228423 conn(0x7fa2340c0200 msgr2=0x7fa2340b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 shutdown_connections 2023-12-20T04:24:15.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.227+0000 7fa238d89640 1 -- 172.21.15.40:0/2687228423 wait complete. 2023-12-20T04:24:15.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:24:15.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.347+0000 7f355c18b640 1 Processor -- start 2023-12-20T04:24:15.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.348+0000 7f355c18b640 1 -- start start 2023-12-20T04:24:15.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.348+0000 7f355c18b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3554070ff0 0x7f355414aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.348+0000 7f355c18b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f35540ba0e0 0x7f35540b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.348+0000 7f355c18b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355414af90 con 0x7f35540b7d60 2023-12-20T04:24:15.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.348+0000 7f355c18b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35540b8630 con 0x7f3554070ff0 2023-12-20T04:24:15.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.348+0000 7f355c18b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355406b090 con 0x7f35540ba0e0 2023-12-20T04:24:15.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.348+0000 7f355a728640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f35540b7d60 0x7f355414e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43158/0 (socket says 172.21.15.40:43158) 2023-12-20T04:24:15.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f355a728640 1 -- 172.21.15.40:0/620347642 learned_addr learned my addr 172.21.15.40:0/620347642 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3559f27640 1 --2- 172.21.15.40:0/620347642 >> v2:172.21.15.69:3300/0 conn(0x7f3554070ff0 0x7f355414aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3559726640 1 --2- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f35540ba0e0 0x7f35540b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3558f25640 1 -- 172.21.15.40:0/620347642 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902682837 0 0) 0x7f355414af90 con 0x7f35540b7d60 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3558f25640 1 -- 172.21.15.40:0/620347642 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003520 con 0x7f35540b7d60 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3559f27640 1 -- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f35540ba0e0 msgr2=0x7f35540b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3558f25640 1 -- 172.21.15.40:0/620347642 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273882395 0 0) 0x7f3540003520 con 0x7f35540b7d60 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3559f27640 1 --2- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f35540ba0e0 0x7f35540b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3559f27640 1 -- 172.21.15.40:0/620347642 >> v1:172.21.15.40:6789/0 conn(0x7f35540b7d60 legacy=0x7f355414e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.349+0000 7f3559f27640 1 -- 172.21.15.40:0/620347642 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554071d10 con 0x7f3554070ff0 2023-12-20T04:24:15.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.350+0000 7f3559f27640 1 --2- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3554070ff0 0x7f355414aa50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35500097d0 tx=0x7f355002b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e55db9bac325dcd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.350+0000 7f3558f25640 1 -- 172.21.15.40:0/620347642 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0019f0 con 0x7f3554070ff0 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.350+0000 7f3558f25640 1 -- 172.21.15.40:0/620347642 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355002e050 con 0x7f3554070ff0 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.350+0000 7f3558f25640 1 -- 172.21.15.40:0/620347642 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550030730 con 0x7f3554070ff0 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 -- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3554070ff0 msgr2=0x7f355414aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 --2- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3554070ff0 0x7f355414aa50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f35500097d0 tx=0x7f355002b770 comp rx=0 tx=0).stop 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 -- 172.21.15.40:0/620347642 shutdown_connections 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 --2- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f35540ba0e0 0x7f35540b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 --2- 172.21.15.40:0/620347642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3554070ff0 0x7f355414aa50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 -- 172.21.15.40:0/620347642 >> 172.21.15.40:0/620347642 conn(0x7f35540be120 msgr2=0x7f35540be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 -- 172.21.15.40:0/620347642 shutdown_connections 2023-12-20T04:24:15.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.351+0000 7f355c18b640 1 -- 172.21.15.40:0/620347642 wait complete. 2023-12-20T04:24:15.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.352+0000 7f355c18b640 1 Processor -- start 2023-12-20T04:24:15.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.352+0000 7f355c18b640 1 -- start start 2023-12-20T04:24:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3554070ff0 0x7f3554141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540b7d60 0x7f35541dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35540ba0e0 0x7f3554140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554148100 con 0x7f35540b7d60 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355413f090 con 0x7f35540ba0e0 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355413fba0 con 0x7f3554070ff0 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540b7d60 0x7f35541dfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540b7d60 0x7f35541dfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53362/0 (socket says 172.21.15.40:53362) 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 -- 172.21.15.40:0/2996015615 learned_addr learned my addr 172.21.15.40:0/2996015615 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355a728640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35540ba0e0 0x7f3554140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559f27640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3554070ff0 0x7f3554141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 -- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3554070ff0 msgr2=0x7f3554141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3554070ff0 0x7f3554141890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 -- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35540ba0e0 msgr2=0x7f3554140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35540ba0e0 0x7f3554140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 -- 172.21.15.40:0/2996015615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009400 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355a728640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35540ba0e0 0x7f3554140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f3559726640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540b7d60 0x7f35541dfdd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f354400e840 tx=0x7f354400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f354a7fc640 1 -- 172.21.15.40:0/2996015615 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35440094f0 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35541e0310 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f354a7fc640 1 -- 172.21.15.40:0/2996015615 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400c940 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f354a7fc640 1 -- 172.21.15.40:0/2996015615 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400ccd0 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.353+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355413f840 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.354+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355413f250 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.355+0000 7f354a7fc640 1 -- 172.21.15.40:0/2996015615 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3544013470 con 0x7f35540b7d60 2023-12-20T04:24:15.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.355+0000 7f354a7fc640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f353806a460 0x7f353806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.355+0000 7f354a7fc640 1 -- 172.21.15.40:0/2996015615 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3544088810 con 0x7f35540b7d60 2023-12-20T04:24:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.355+0000 7f3559f27640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f353806a460 0x7f353806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:15.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.356+0000 7f3559f27640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f353806a460 0x7f353806c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3550034000 tx=0x7f3550008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:15.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.359+0000 7f354a7fc640 1 -- 172.21.15.40:0/2996015615 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3544053d80 con 0x7f35540b7d60 2023-12-20T04:24:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.573+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f355413f840 con 0x7f35540b7d60 2023-12-20T04:24:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.573+0000 7f354a7fc640 1 -- 172.21.15.40:0/2996015615 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f355413f840 con 0x7f35540b7d60 2023-12-20T04:24:15.574 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f353806a460 msgr2=0x7f353806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f353806a460 0x7f353806c920 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3550034000 tx=0x7f3550008030 comp rx=0 tx=0).stop 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540b7d60 msgr2=0x7f35541dfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540b7d60 0x7f35541dfdd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f354400e840 tx=0x7f354400ed00 comp rx=0 tx=0).stop 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 shutdown_connections 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f353806a460 0x7f353806c920 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f35540ba0e0 0x7f3554140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35540b7d60 0x7f35541dfdd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 --2- 172.21.15.40:0/2996015615 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3554070ff0 0x7f3554141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 >> 172.21.15.40:0/2996015615 conn(0x7f35540be120 msgr2=0x7f35540b6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 shutdown_connections 2023-12-20T04:24:15.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:15.575+0000 7f355c18b640 1 -- 172.21.15.40:0/2996015615 wait complete. 2023-12-20T04:24:15.586 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-20T04:24:15.586 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:24:15.586 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-12-20T04:24:15.587 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:24:15.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:24:15.587 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-20T04:24:15.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-20T04:24:15.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:24:15.587 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:24:15.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:15.587 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-12-20T04:24:15.650 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:24:15.650 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:24:15.651 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:24:15.651 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:24:15.651 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-12-20T04:24:15.651 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:24:15.651 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:24:15.651 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:24:15.652 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2023-12-20T04:24:15.652 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:24:15.652 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:24:15.652 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2023-12-20T04:24:15.652 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:24:15.652 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:24:15.652 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42332sec preferred_lft 42332sec 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 22:45:04:ba:cf:6c brd ff:ff:ff:ff:ff:ff 2023-12-20T04:24:15.653 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:24:15.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:24:15.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::e074:bdff:fef8:a0b6/64 scope link 2023-12-20T04:24:15.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:24:15.654 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:24:15.654 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 22:45:04:ba:cf:6c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:24:15.654 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::2045:4ff:feba:cf6c/64 scope link 2023-12-20T04:24:15.654 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:24:15.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:15.655 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:24:15.748 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-12-20T04:24:15.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:15.752 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-12-20T04:24:15.804 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-12-20T04:24:15.804 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:24:15.804 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:24:15.804 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:24:15.804 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:24:15.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:15.804 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-12-20T04:24:15.805 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-12-20T04:24:15.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:24:15.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:24:15.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:24:15.805 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-12-20T04:24:15.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:15.979 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-20T04:24:16.029 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:24:16.033 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:24:16.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:16.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-12-20T04:24:16.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:24:16.128 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:24:16.180 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:24:16.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:24:16.180 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:24:16.234 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-20T04:24:16.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:16.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:24:16.375 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:24:16.375 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-20T04:24:16.375 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-20T04:24:16.397 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:24:16.397 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-20T04:24:16.397 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-20T04:24:16.397 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-20T04:24:16.397 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-20T04:24:16.424 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-20T04:24:16.424 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-20T04:24:16.424 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-12-20T04:24:16.424 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.69:3300,172.21.15.69:3301" 2023-12-20T04:24:16.424 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-20T04:24:16.424 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.40:6789,172.21.15.69:6789,172.21.15.69:6790" 2023-12-20T04:24:16.425 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.40:6789,172.21.15.69:6789,172.21.15.69:6790:/ 2023-12-20T04:24:16.425 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9ed6574e-2792-4eae-92b0-945f286f0eed" will pass to kernel 2023-12-20T04:24:16.426 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-20T04:24:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2023-12-20T04:24:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-20T04:24:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2023-12-20T04:24:16.426 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-20T04:24:16.431 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-20T04:24:16.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:16.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:24:16.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:16.517 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-20T04:24:16.585 INFO:teuthology.orchestra.run.smithi081.stdout:client4978 2023-12-20T04:24:16.585 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:24:16.586 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:24:16.641 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=xfstests-dev 2023-12-20T04:24:16.691 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.utfXGGFva6xfstests-dev 2023-12-20T04:24:16.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:16.691 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.utfXGGFva6xfstests-dev) 2023-12-20T04:24:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:Cloning into '/tmp/tmp.utfXGGFva6xfstests-dev'... 2023-12-20T04:24:17.815 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=xfsprogs-dev 2023-12-20T04:24:17.869 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.GopArGmA0Mxfsprogs-dev 2023-12-20T04:24:17.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:17.869 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.GopArGmA0Mxfsprogs-dev) 2023-12-20T04:24:17.924 INFO:teuthology.orchestra.run.smithi081.stderr:Cloning into '/tmp/tmp.GopArGmA0Mxfsprogs-dev'... 2023-12-20T04:24:18.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:18.595 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-20T04:24:18.659 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=test 2023-12-20T04:24:18.712 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.ZcYVmbFZ9Btest 2023-12-20T04:24:18.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:24:18.712 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-20T04:24:18.770 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=scratch 2023-12-20T04:24:18.826 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.a4FpERTltXscratch 2023-12-20T04:24:18.827 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-20T04:24:18.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-12-20T04:24:19.659 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:03:28 ago on Wed 20 Dec 2023 04:20:51 AM UTC. 2023-12-20T04:24:19.758 INFO:teuthology.orchestra.run.smithi081.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-20T04:24:19.758 INFO:teuthology.orchestra.run.smithi081.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-20T04:24:19.759 INFO:teuthology.orchestra.run.smithi081.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-20T04:24:19.761 INFO:teuthology.orchestra.run.smithi081.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-20T04:24:19.762 INFO:teuthology.orchestra.run.smithi081.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-20T04:24:19.763 INFO:teuthology.orchestra.run.smithi081.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-20T04:24:19.765 INFO:teuthology.orchestra.run.smithi081.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-20T04:24:19.767 INFO:teuthology.orchestra.run.smithi081.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-20T04:24:19.768 INFO:teuthology.orchestra.run.smithi081.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-20T04:24:19.769 INFO:teuthology.orchestra.run.smithi081.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-20T04:24:19.770 INFO:teuthology.orchestra.run.smithi081.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-20T04:24:19.771 INFO:teuthology.orchestra.run.smithi081.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-20T04:24:19.773 INFO:teuthology.orchestra.run.smithi081.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-20T04:24:19.773 INFO:teuthology.orchestra.run.smithi081.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-20T04:24:19.775 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-12-20T04:24:19.776 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:24:19.777 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-20T04:24:19.778 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-20T04:24:19.779 INFO:teuthology.orchestra.run.smithi081.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-20T04:24:19.780 INFO:teuthology.orchestra.run.smithi081.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-20T04:24:19.781 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:24:19.782 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-20T04:24:19.787 INFO:teuthology.orchestra.run.smithi081.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2023-12-20T04:24:19.794 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:24:19.853 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-12-20T04:24:19.856 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-devel x86_64 9:1.02.195-3.el9 crb 43 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: inih-devel x86_64 49-6.el9 crb 11 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 17 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: libedit-devel x86_64 3.1-38.20210216cvs.el9 CentOS-AppStream 39 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: libicu-devel x86_64 67.1-9.el9 CentOS-AppStream 830 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-20T04:24:19.857 INFO:teuthology.orchestra.run.smithi081.stdout: userspace-rcu-devel x86_64 0.12.1-6.el9 crb 120 k 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-20T04:24:19.858 INFO:teuthology.orchestra.run.smithi081.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: python-unversioned-command 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel x86_64 3.5-1.el9 CentOS-AppStream 114 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel x86_64 3.5-1.el9 CentOS-AppStream 40 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel x86_64 10.40-2.el9 appstream 515 k 2023-12-20T04:24:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16 x86_64 10.40-2.el9 appstream 217 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32 x86_64 10.40-2.el9 appstream 206 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: systemd-devel x86_64 252-18.el9 CentOS-AppStream 482 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-20T04:24:19.860 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:24:19.861 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-12-20T04:24:19.861 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2023-12-20T04:24:19.861 INFO:teuthology.orchestra.run.smithi081.stdout:Install 24 Packages 2023-12-20T04:24:19.861 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 16 Packages 2023-12-20T04:24:19.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:24:19.861 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 78 M 2023-12-20T04:24:19.862 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-12-20T04:24:20.845 INFO:teuthology.orchestra.run.smithi081.stdout:(1/40): fio-engine-http-3.35-1.el9.x86_64.rpm 69 kB/s | 17 kB 00:00 2023-12-20T04:24:20.895 INFO:teuthology.orchestra.run.smithi081.stdout:(2/40): fio-engine-libaio-3.35-1.el9.x86_64.rpm 49 kB/s | 14 kB 00:00 2023-12-20T04:24:21.071 INFO:teuthology.orchestra.run.smithi081.stdout:(3/40): fio-engine-nbd-3.35-1.el9.x86_64.rpm 61 kB/s | 13 kB 00:00 2023-12-20T04:24:21.129 INFO:teuthology.orchestra.run.smithi081.stdout:(4/40): fio-engine-rados-3.35-1.el9.x86_64.rpm 63 kB/s | 15 kB 00:00 2023-12-20T04:24:21.296 INFO:teuthology.orchestra.run.smithi081.stdout:(5/40): fio-3.35-1.el9.x86_64.rpm 8.9 MB/s | 6.2 MB 00:00 2023-12-20T04:24:21.346 INFO:teuthology.orchestra.run.smithi081.stdout:(6/40): fio-engine-rbd-3.35-1.el9.x86_64.rpm 56 kB/s | 15 kB 00:00 2023-12-20T04:24:21.438 INFO:teuthology.orchestra.run.smithi081.stdout:(7/40): fio-engine-rdma-3.35-1.el9.x86_64.rpm 64 kB/s | 20 kB 00:00 2023-12-20T04:24:21.489 INFO:teuthology.orchestra.run.smithi081.stdout:(8/40): libblkid-devel-2.37.4-15.el9.x86_64.rpm 88 kB/s | 17 kB 00:00 2023-12-20T04:24:21.547 INFO:teuthology.orchestra.run.smithi081.stdout:(9/40): libedit-devel-3.1-38.20210216cvs.el9.x8 361 kB/s | 39 kB 00:00 2023-12-20T04:24:21.589 INFO:teuthology.orchestra.run.smithi081.stdout:(10/40): libicu-devel-67.1-9.el9.x86_64.rpm 5.4 MB/s | 830 kB 00:00 2023-12-20T04:24:21.614 INFO:teuthology.orchestra.run.smithi081.stdout:(11/40): libselinux-devel-3.5-1.el9.x86_64.rpm 974 kB/s | 114 kB 00:00 2023-12-20T04:24:21.648 INFO:teuthology.orchestra.run.smithi081.stdout:(12/40): libsepol-devel-3.5-1.el9.x86_64.rpm 703 kB/s | 40 kB 00:00 2023-12-20T04:24:21.690 INFO:teuthology.orchestra.run.smithi081.stdout:(13/40): sqlite-3.34.1-6.el9.x86_64.rpm 7.4 MB/s | 747 kB 00:00 2023-12-20T04:24:21.723 INFO:teuthology.orchestra.run.smithi081.stdout:(14/40): systemd-devel-252-18.el9.x86_64.rpm 4.6 MB/s | 482 kB 00:00 2023-12-20T04:24:21.784 INFO:teuthology.orchestra.run.smithi081.stdout:(15/40): rmt-1.6-6.el9.x86_64.rpm 346 kB/s | 45 kB 00:00 2023-12-20T04:24:21.999 INFO:teuthology.orchestra.run.smithi081.stdout:(16/40): libnbd-1.18.1-3.el9.x86_64.rpm 607 kB/s | 166 kB 00:00 2023-12-20T04:24:22.033 INFO:teuthology.orchestra.run.smithi081.stdout:(17/40): pcre2-utf16-10.40-2.el9.x86_64.rpm 877 kB/s | 217 kB 00:00 2023-12-20T04:24:22.100 INFO:teuthology.orchestra.run.smithi081.stdout:(18/40): pcre2-devel-10.40-2.el9.x86_64.rpm 1.3 MB/s | 515 kB 00:00 2023-12-20T04:24:22.125 INFO:teuthology.orchestra.run.smithi081.stdout:(19/40): pcre2-utf32-10.40-2.el9.x86_64.rpm 1.6 MB/s | 206 kB 00:00 2023-12-20T04:24:22.509 INFO:teuthology.orchestra.run.smithi081.stdout:(20/40): device-mapper-devel-1.02.195-3.el9.x86 91 kB/s | 43 kB 00:00 2023-12-20T04:24:22.558 INFO:teuthology.orchestra.run.smithi081.stdout:(21/40): inih-devel-49-6.el9.x86_64.rpm 24 kB/s | 11 kB 00:00 2023-12-20T04:24:22.859 INFO:teuthology.orchestra.run.smithi081.stdout:(22/40): dump-0.4-0.51.b47.el9.x86_64.rpm 252 kB/s | 88 kB 00:00 2023-12-20T04:24:22.884 INFO:teuthology.orchestra.run.smithi081.stdout:(23/40): userspace-rcu-devel-0.12.1-6.el9.x86_6 188 kB/s | 120 kB 00:00 2023-12-20T04:24:22.964 INFO:teuthology.orchestra.run.smithi081.stdout:(24/40): indent-2.2.13-4.el9.x86_64.rpm 444 kB/s | 179 kB 00:00 2023-12-20T04:24:23.660 INFO:teuthology.orchestra.run.smithi081.stdout:(25/40): cpp-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 11 MB 00:00 2023-12-20T04:24:24.143 INFO:teuthology.orchestra.run.smithi081.stdout:(26/40): gcc-11.4.1-2.3.el9.x86_64.rpm 26 MB/s | 32 MB 00:01 2023-12-20T04:24:24.344 INFO:teuthology.orchestra.run.smithi081.stdout:(27/40): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 9.3 MB/s | 13 MB 00:01 2023-12-20T04:24:24.369 INFO:teuthology.orchestra.run.smithi081.stdout:(28/40): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 66 kB/s | 47 kB 00:00 2023-12-20T04:24:24.478 INFO:teuthology.orchestra.run.smithi081.stdout:(29/40): libstdc++-devel-11.4.1-2.3.el9.x86_64. 7.0 MB/s | 2.2 MB 00:00 2023-12-20T04:24:24.544 INFO:teuthology.orchestra.run.smithi081.stdout:(30/40): python3-devel-3.9.18-1.el9.x86_64.rpm 1.2 MB/s | 204 kB 00:00 2023-12-20T04:24:24.570 INFO:teuthology.orchestra.run.smithi081.stdout:(31/40): python-unversioned-command-3.9.18-1.el 47 kB/s | 8.8 kB 00:00 2023-12-20T04:24:24.612 INFO:teuthology.orchestra.run.smithi081.stdout:(32/40): e2fsprogs-1.46.5-4.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2023-12-20T04:24:24.645 INFO:teuthology.orchestra.run.smithi081.stdout:(33/40): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 2.4 MB/s | 221 kB 00:00 2023-12-20T04:24:24.671 INFO:teuthology.orchestra.run.smithi081.stdout:(34/40): libgcc-11.4.1-2.3.el9.x86_64.rpm 1.6 MB/s | 92 kB 00:00 2023-12-20T04:24:24.696 INFO:teuthology.orchestra.run.smithi081.stdout:(35/40): libcom_err-1.46.5-4.el9.x86_64.rpm 311 kB/s | 25 kB 00:00 2023-12-20T04:24:24.721 INFO:teuthology.orchestra.run.smithi081.stdout:(36/40): libgomp-11.4.1-2.3.el9.x86_64.rpm 3.5 MB/s | 268 kB 00:00 2023-12-20T04:24:24.746 INFO:teuthology.orchestra.run.smithi081.stdout:(37/40): libss-1.46.5-4.el9.x86_64.rpm 426 kB/s | 31 kB 00:00 2023-12-20T04:24:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:(38/40): python3-3.9.18-1.el9.x86_64.rpm 527 kB/s | 26 kB 00:00 2023-12-20T04:24:24.839 INFO:teuthology.orchestra.run.smithi081.stdout:(39/40): libstdc++-11.4.1-2.3.el9.x86_64.rpm 6.2 MB/s | 735 kB 00:00 2023-12-20T04:24:25.005 INFO:teuthology.orchestra.run.smithi081.stdout:(40/40): python3-libs-3.9.18-1.el9.x86_64.rpm 28 MB/s | 7.3 MB 00:00 2023-12-20T04:24:25.021 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:24:25.021 INFO:teuthology.orchestra.run.smithi081.stdout:Total 15 MB/s | 78 MB 00:05 2023-12-20T04:24:25.303 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-12-20T04:24:25.633 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-12-20T04:24:25.633 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-12-20T04:24:26.473 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-12-20T04:24:26.473 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-12-20T04:24:26.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:24:26.761 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:24:26.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:24:28.767 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-12-20T04:24:28.885 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/56 2023-12-20T04:24:28.932 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-20T04:24:29.094 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-20T04:24:29.220 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/56 2023-12-20T04:24:29.964 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/56 2023-12-20T04:24:30.084 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/56 2023-12-20T04:24:31.665 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/56 2023-12-20T04:24:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/56 2023-12-20T04:24:31.967 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/56 2023-12-20T04:24:32.009 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/56 2023-12-20T04:24:32.322 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/56 2023-12-20T04:24:33.530 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/56 2023-12-20T04:24:33.780 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-20T04:24:33.882 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-20T04:24:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf32-10.40-2.el9.x86_64 13/56 2023-12-20T04:24:34.117 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf16-10.40-2.el9.x86_64 14/56 2023-12-20T04:24:34.159 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-devel-10.40-2.el9.x86_64 15/56 2023-12-20T04:24:34.186 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-20T04:24:34.247 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 17/56 2023-12-20T04:24:34.288 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 18/56 2023-12-20T04:24:34.323 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 19/56 2023-12-20T04:24:34.356 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 20/56 2023-12-20T04:24:34.390 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 21/56 2023-12-20T04:24:34.638 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 22/56 2023-12-20T04:24:34.711 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-3.35-1.el9.x86_64 23/56 2023-12-20T04:24:35.130 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rmt-2:1.6-6.el9.x86_64 24/56 2023-12-20T04:24:35.190 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : systemd-devel-252-18.el9.x86_64 25/56 2023-12-20T04:24:35.321 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libsepol-devel-3.5-1.el9.x86_64 26/56 2023-12-20T04:24:35.366 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libselinux-devel-3.5-1.el9.x86_64 27/56 2023-12-20T04:24:35.432 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : device-mapper-devel-9:1.02.195-3.el9.x86_64 28/56 2023-12-20T04:24:35.880 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 29/56 2023-12-20T04:24:35.960 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 30/56 2023-12-20T04:24:35.992 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-20T04:24:36.175 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-20T04:24:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 32/56 2023-12-20T04:24:36.517 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 33/56 2023-12-20T04:24:36.649 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : indent-2.2.13-4.el9.x86_64 34/56 2023-12-20T04:24:36.692 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : userspace-rcu-devel-0.12.1-6.el9.x86_64 35/56 2023-12-20T04:24:36.739 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : inih-devel-49-6.el9.x86_64 36/56 2023-12-20T04:24:37.069 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 37/56 2023-12-20T04:24:37.133 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libicu-devel-67.1-9.el9.x86_64 38/56 2023-12-20T04:24:37.165 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libedit-devel-3.1-38.20210216cvs.el9.x86_64 39/56 2023-12-20T04:24:37.193 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libblkid-devel-2.37.4-15.el9.x86_64 40/56 2023-12-20T04:24:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 41/56 2023-12-20T04:24:37.272 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 42/56 2023-12-20T04:24:37.308 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 43/56 2023-12-20T04:24:37.341 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 44/56 2023-12-20T04:24:37.367 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 45/56 2023-12-20T04:24:37.368 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-20T04:24:37.487 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-20T04:24:37.545 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 47/56 2023-12-20T04:24:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 48/56 2023-12-20T04:24:37.651 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 49/56 2023-12-20T04:24:37.696 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 50/56 2023-12-20T04:24:37.728 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 51/56 2023-12-20T04:24:37.729 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-20T04:24:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-20T04:24:37.906 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 53/56 2023-12-20T04:24:37.946 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 54/56 2023-12-20T04:24:38.094 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 55/56 2023-12-20T04:24:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-3.35-1.el9.x86_64 1/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/56 2023-12-20T04:24:40.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libblkid-devel-2.37.4-15.el9.x86_64 8/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libedit-devel-3.1-38.20210216cvs.el9.x86_64 9/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libicu-devel-67.1-9.el9.x86_64 10/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libselinux-devel-3.5-1.el9.x86_64 11/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsepol-devel-3.5-1.el9.x86_64 12/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 13/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : systemd-devel-252-18.el9.x86_64 14/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 15/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-devel-10.40-2.el9.x86_64 17/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf16-10.40-2.el9.x86_64 18/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf32-10.40-2.el9.x86_64 19/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-devel-9:1.02.195-3.el9.x86_64 20/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : inih-devel-49-6.el9.x86_64 21/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : userspace-rcu-devel-0.12.1-6.el9.x86_64 22/56 2023-12-20T04:24:40.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 23/56 2023-12-20T04:24:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : indent-2.2.13-4.el9.x86_64 24/56 2023-12-20T04:24:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 25/56 2023-12-20T04:24:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 26/56 2023-12-20T04:24:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 27/56 2023-12-20T04:24:40.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 28/56 2023-12-20T04:24:40.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 29/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 30/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 32/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 33/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 34/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 35/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 36/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 37/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 38/56 2023-12-20T04:24:40.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 39/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 40/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 41/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 42/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 43/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 44/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 45/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 46/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 47/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 48/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libss-1.46.5-4.el9.x86_64 49/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libss-1.46.5-3.el9.x86_64 50/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 51/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 52/56 2023-12-20T04:24:40.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-3.9.18-1.el9.x86_64 53/56 2023-12-20T04:24:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-3.9.17-2.el9.x86_64 54/56 2023-12-20T04:24:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 55/56 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.339 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: libss-1.46.5-4.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: python3-3.9.18-1.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-devel-9:1.02.195-3.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: dump-1:0.4-0.51.b47.el9.x86_64 2023-12-20T04:24:41.340 INFO:teuthology.orchestra.run.smithi081.stdout: fio-3.35-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-http-3.35-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-libaio-3.35-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-nbd-3.35-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rados-3.35-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rbd-3.35-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: indent-2.2.13-4.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: inih-devel-49-6.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid-devel-2.37.4-15.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: libedit-devel-3.1-38.20210216cvs.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: libicu-devel-67.1-9.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd-1.18.1-3.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel-3.5-1.el9.x86_64 2023-12-20T04:24:41.341 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel-3.5-1.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel-10.40-2.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16-10.40-2.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32-10.40-2.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: rmt-2:1.6-6.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: sqlite-3.34.1-6.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: systemd-devel-252-18.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: userspace-rcu-devel-0.12.1-6.el9.x86_64 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:24:41.342 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-12-20T04:24:41.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo useradd -m fsgqa 2023-12-20T04:24:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:useradd: user 'fsgqa' already exists 2023-12-20T04:24:41.954 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-20T04:24:41.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo groupadd fsgqa 2023-12-20T04:24:42.024 INFO:teuthology.orchestra.run.smithi081.stderr:groupadd: group 'fsgqa' already exists 2023-12-20T04:24:42.027 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-20T04:24:42.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo useradd fsgqa2 2023-12-20T04:24:42.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo useradd 123456-fsgqa 2023-12-20T04:24:43.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-20T04:24:43.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.548+0000 7f646982c640 1 Processor -- start 2023-12-20T04:24:43.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.548+0000 7f646982c640 1 -- start start 2023-12-20T04:24:43.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f646982c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464141520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f646982c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f64641483c0 0x7f6464141a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f646982c640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6464071620 con 0x7f6464070780 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f646982c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640b8720 con 0x7f64641483c0 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f646982c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6464071060 con 0x7f64640b7b00 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f64637fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f64641483c0 0x7f6464141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f64637fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f64641483c0 0x7f6464141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41548/0 (socket says 172.21.15.40:41548) 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f64637fe640 1 -- 172.21.15.40:0/4055359467 learned_addr learned my addr 172.21.15.40:0/4055359467 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f6462ffd640 1 --2- 172.21.15.40:0/4055359467 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f64637fe640 1 -- 172.21.15.40:0/4055359467 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 msgr2=0x7f6464141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f64637fe640 1 --2- 172.21.15.40:0/4055359467 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f64637fe640 1 -- 172.21.15.40:0/4055359467 >> v1:172.21.15.69:6789/0 conn(0x7f6464070780 legacy=0x7f6464147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.549+0000 7f64637fe640 1 -- 172.21.15.40:0/4055359467 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464071340 con 0x7f64641483c0 2023-12-20T04:24:43.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.550+0000 7f64637fe640 1 --2- 172.21.15.40:0/4055359467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464141a60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f645c009e50 tx=0x7f645c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc28fe7bfe1665c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.550+0000 7f6461ffb640 1 -- 172.21.15.40:0/4055359467 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c02cb00 con 0x7f64641483c0 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.550+0000 7f6461ffb640 1 -- 172.21.15.40:0/4055359467 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c02cc60 con 0x7f64641483c0 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.550+0000 7f6461ffb640 1 -- 172.21.15.40:0/4055359467 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0343f0 con 0x7f64641483c0 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 -- 172.21.15.40:0/4055359467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 msgr2=0x7f6464141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 --2- 172.21.15.40:0/4055359467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464141a60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f645c009e50 tx=0x7f645c02bf60 comp rx=0 tx=0).stop 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 -- 172.21.15.40:0/4055359467 shutdown_connections 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 --2- 172.21.15.40:0/4055359467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464141a60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 --2- 172.21.15.40:0/4055359467 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 -- 172.21.15.40:0/4055359467 >> 172.21.15.40:0/4055359467 conn(0x7f64640bc220 msgr2=0x7f64640bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 -- 172.21.15.40:0/4055359467 shutdown_connections 2023-12-20T04:24:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.551+0000 7f646982c640 1 -- 172.21.15.40:0/4055359467 wait complete. 2023-12-20T04:24:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.552+0000 7f646982c640 1 Processor -- start 2023-12-20T04:24:43.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.552+0000 7f646982c640 1 -- start start 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f646982c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6464070780 0x7f6464136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f646982c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464132c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f646982c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f646982c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6464136560 con 0x7f64641483c0 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f646982c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6464133170 con 0x7f6464070780 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f646982c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64641333f0 con 0x7f64640b7b00 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464145840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41562/0 (socket says 172.21.15.40:41562) 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 -- 172.21.15.40:0/2984950666 learned_addr learned my addr 172.21.15.40:0/2984950666 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f6462ffd640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6464070780 0x7f6464136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64627fc640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464132c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 -- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 msgr2=0x7f6464132c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464132c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 -- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6464070780 msgr2=0x7f6464136020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6464070780 0x7f6464136020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 -- 172.21.15.40:0/2984950666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009b30 con 0x7f64641483c0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f64637fe640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464145840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f645c036040 tx=0x7f645c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f644bfff640 1 -- 172.21.15.40:0/2984950666 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c040670 con 0x7f64641483c0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f644bfff640 1 -- 172.21.15.40:0/2984950666 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c0407f0 con 0x7f64641483c0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.553+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64641336d0 con 0x7f64641483c0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.554+0000 7f644bfff640 1 -- 172.21.15.40:0/2984950666 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c040ba0 con 0x7f64641483c0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.554+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64640bb480 con 0x7f64641483c0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.555+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646404e840 con 0x7f64641483c0 2023-12-20T04:24:43.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.555+0000 7f644bfff640 1 -- 172.21.15.40:0/2984950666 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f645c040d00 con 0x7f64641483c0 2023-12-20T04:24:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.555+0000 7f644bfff640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f645006a430 0x7f645006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.555+0000 7f644bfff640 1 -- 172.21.15.40:0/2984950666 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f645c0ab7f0 con 0x7f64641483c0 2023-12-20T04:24:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.556+0000 7f6462ffd640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f645006a430 0x7f645006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.556+0000 7f6462ffd640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f645006a430 0x7f645006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6454006fd0 tx=0x7f6454008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:43.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.560+0000 7f644bfff640 1 -- 172.21.15.40:0/2984950666 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f645c076e90 con 0x7f64641483c0 2023-12-20T04:24:43.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.812+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f64641454f0 con 0x7f64641483c0 2023-12-20T04:24:43.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.812+0000 7f644bfff640 1 -- 172.21.15.40:0/2984950666 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f645c009510 con 0x7f64641483c0 2023-12-20T04:24:43.813 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:24:43.814 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","modified":"2023-12-20T04:22:28.206702Z","created":"2023-12-20T04:22:28.206702Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3301","nonce":0},{"type":"v1","addr":"172.21.15.69:6790","nonce":0}]},"addr":"172.21.15.69:6790/0","public_addr":"172.21.15.69:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-20T04:24:43.814 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 1 2023-12-20T04:24:43.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f645006a430 msgr2=0x7f645006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f645006a430 0x7f645006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6454006fd0 tx=0x7f6454008040 comp rx=0 tx=0).stop 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 msgr2=0x7f6464145840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464145840 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f645c036040 tx=0x7f645c004a40 comp rx=0 tx=0).stop 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 shutdown_connections 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f645006a430 0x7f645006c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64641483c0 0x7f6464145840 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f64640b7b00 0x7f6464132c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 --2- 172.21.15.40:0/2984950666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6464070780 0x7f6464136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.814+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 >> 172.21.15.40:0/2984950666 conn(0x7f64640bc220 msgr2=0x7f646406ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.815+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 shutdown_connections 2023-12-20T04:24:43.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.815+0000 7f646982c640 1 -- 172.21.15.40:0/2984950666 wait complete. 2023-12-20T04:24:43.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-20T04:24:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.932+0000 7efe70b47640 1 Processor -- start 2023-12-20T04:24:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.932+0000 7efe70b47640 1 -- start start 2023-12-20T04:24:43.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe70b47640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe6c144ea0 0x7efe6c156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe70b47640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c0bc6b0 con 0x7efe6c0b6690 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe70b47640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c0a59f0 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe70b47640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6c0bc0a0 con 0x7efe6c144ea0 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe6ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe6c144ea0 0x7efe6c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe69d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efe6c0b6690 0x7efe6c144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59322/0 (socket says 172.21.15.40:59322) 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe69d9b640 1 -- 172.21.15.40:0/1141270518 learned_addr learned my addr 172.21.15.40:0/1141270518 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe6ad9d640 1 -- 172.21.15.40:0/1141270518 >> v1:172.21.15.69:6789/0 conn(0x7efe6c0bcdd0 legacy=0x7efe6c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe6ad9d640 1 -- 172.21.15.40:0/1141270518 >> v1:172.21.15.40:6789/0 conn(0x7efe6c0b6690 legacy=0x7efe6c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe6959a640 1 -- 172.21.15.40:0/1141270518 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884826532 0 0) 0x7efe6c0bc6b0 con 0x7efe6c0b6690 2023-12-20T04:24:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.933+0000 7efe6ad9d640 1 -- 172.21.15.40:0/1141270518 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c0bc340 con 0x7efe6c144ea0 2023-12-20T04:24:43.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.934+0000 7efe6ad9d640 1 --2- 172.21.15.40:0/1141270518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c144ea0 0x7efe6c156350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0a5b80 tx=0x7efe6402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f6437067b3d24a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:43.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.934+0000 7efe6959a640 1 -- 172.21.15.40:0/1141270518 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64030610 con 0x7efe6c144ea0 2023-12-20T04:24:43.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.934+0000 7efe6959a640 1 -- 172.21.15.40:0/1141270518 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64030770 con 0x7efe6c144ea0 2023-12-20T04:24:43.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.934+0000 7efe6959a640 1 -- 172.21.15.40:0/1141270518 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64030b00 con 0x7efe6c144ea0 2023-12-20T04:24:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.935+0000 7efe70b47640 1 -- 172.21.15.40:0/1141270518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c144ea0 msgr2=0x7efe6c156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.935+0000 7efe70b47640 1 --2- 172.21.15.40:0/1141270518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c144ea0 0x7efe6c156350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0a5b80 tx=0x7efe6402b960 comp rx=0 tx=0).stop 2023-12-20T04:24:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.935+0000 7efe70b47640 1 -- 172.21.15.40:0/1141270518 shutdown_connections 2023-12-20T04:24:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.935+0000 7efe70b47640 1 --2- 172.21.15.40:0/1141270518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c144ea0 0x7efe6c156350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.935+0000 7efe70b47640 1 -- 172.21.15.40:0/1141270518 >> 172.21.15.40:0/1141270518 conn(0x7efe6c071e60 msgr2=0x7efe6c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.935+0000 7efe70b47640 1 -- 172.21.15.40:0/1141270518 shutdown_connections 2023-12-20T04:24:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.935+0000 7efe70b47640 1 -- 172.21.15.40:0/1141270518 wait complete. 2023-12-20T04:24:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.936+0000 7efe70b47640 1 Processor -- start 2023-12-20T04:24:43.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.936+0000 7efe70b47640 1 -- start start 2023-12-20T04:24:43.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe70b47640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0b6690 0x7efe6c14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe70b47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c0bcdd0 0x7efe6c1d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe70b47640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efe6c144ea0 0x7efe6c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe70b47640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c148250 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe70b47640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c14b840 con 0x7efe6c0b6690 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe70b47640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c149010 con 0x7efe6c144ea0 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c0bcdd0 0x7efe6c1d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c0bcdd0 0x7efe6c1d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41566/0 (socket says 172.21.15.40:41566) 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 -- 172.21.15.40:0/2048424153 learned_addr learned my addr 172.21.15.40:0/2048424153 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe6a59c640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0b6690 0x7efe6c14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe6ad9d640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efe6c144ea0 0x7efe6c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 -- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efe6c144ea0 msgr2=0x7efe6c1497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efe6c144ea0 0x7efe6c1497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 -- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0b6690 msgr2=0x7efe6c14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0b6690 0x7efe6c14a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 -- 172.21.15.40:0/2048424153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe64009400 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe69d9b640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c0bcdd0 0x7efe6c1d0b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c4d0 tx=0x7efe5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.937+0000 7efe62ffd640 1 -- 172.21.15.40:0/2048424153 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540074e0 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.938+0000 7efe62ffd640 1 -- 172.21.15.40:0/2048424153 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54007660 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.938+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c1d13c0 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.938+0000 7efe62ffd640 1 -- 172.21.15.40:0/2048424153 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54004a20 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.938+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c14ac50 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.938+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c04e840 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.939+0000 7efe62ffd640 1 -- 172.21.15.40:0/2048424153 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe54004b80 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.939+0000 7efe62ffd640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efe4c06a430 0x7efe4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:24:43.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.939+0000 7efe62ffd640 1 -- 172.21.15.40:0/2048424153 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe54087b70 con 0x7efe6c0bcdd0 2023-12-20T04:24:43.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.939+0000 7efe6a59c640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efe4c06a430 0x7efe4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:24:43.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.940+0000 7efe6a59c640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efe4c06a430 0x7efe4c06c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe5c005520 tx=0x7efe5c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:24:43.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:43.943+0000 7efe62ffd640 1 -- 172.21.15.40:0/2048424153 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efe540530d0 con 0x7efe6c0bcdd0 2023-12-20T04:24:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.189+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7efe6c144220 con 0x7efe6c0bcdd0 2023-12-20T04:24:44.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.190+0000 7efe62ffd640 1 -- 172.21.15.40:0/2048424153 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7efe540566f0 con 0x7efe6c0bcdd0 2023-12-20T04:24:44.191 INFO:teuthology.orchestra.run.smithi040.stdout:[client.admin] 2023-12-20T04:24:44.191 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAEbIJl4UNQIBAAiKmukv4UdnsKSNal0x9M9Q== 2023-12-20T04:24:44.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efe4c06a430 msgr2=0x7efe4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efe4c06a430 0x7efe4c06c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe5c005520 tx=0x7efe5c009040 comp rx=0 tx=0).stop 2023-12-20T04:24:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c0bcdd0 msgr2=0x7efe6c1d0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:24:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c0bcdd0 0x7efe6c1d0b20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c4d0 tx=0x7efe5400c990 comp rx=0 tx=0).stop 2023-12-20T04:24:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 shutdown_connections 2023-12-20T04:24:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efe4c06a430 0x7efe4c06c8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:44.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efe6c144ea0 0x7efe6c1497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:44.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe6c0bcdd0 0x7efe6c1d0b20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:44.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 --2- 172.21.15.40:0/2048424153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0b6690 0x7efe6c14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:24:44.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 >> 172.21.15.40:0/2048424153 conn(0x7efe6c071e60 msgr2=0x7efe6c1435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:24:44.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 shutdown_connections 2023-12-20T04:24:44.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:24:44.192+0000 7efe70b47640 1 -- 172.21.15.40:0/2048424153 wait complete. 2023-12-20T04:24:44.204 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:24:44.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/tmp/tmp.utfXGGFva6xfstests-dev/local.config 2023-12-20T04:24:44.280 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.40:6789:/test export TEST_DIR=/tmp/tmp.ZcYVmbFZ9Btest export SCRATCH_DEV=172.21.15.40:6789:/scratch export SCRATCH_MNT=/tmp/tmp.a4FpERTltXscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAEbIJl4UNQIBAAiKmukv4UdnsKSNal0x9M9Q==" 2023-12-20T04:24:44.280 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:24:44.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/tmp/tmp.utfXGGFva6xfstests-dev/ceph.exclude 2023-12-20T04:24:44.389 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.utfXGGFva6xfstests-dev && exec sudo make) 2023-12-20T04:24:44.523 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize -cfi 2023-12-20T04:24:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-20T04:24:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './config.guess' 2023-12-20T04:24:45.098 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './config.sub' 2023-12-20T04:24:45.109 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './install-sh' 2023-12-20T04:24:45.121 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './ltmain.sh' 2023-12-20T04:24:45.190 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-20T04:24:45.191 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-20T04:24:45.204 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-20T04:24:45.218 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-20T04:24:45.233 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-20T04:24:45.246 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-20T04:24:45.267 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-20T04:24:45.271 INFO:teuthology.orchestra.run.smithi081.stdout:cp include/install-sh . 2023-12-20T04:24:45.273 INFO:teuthology.orchestra.run.smithi081.stdout:aclocal -I m4 2023-12-20T04:24:46.549 INFO:teuthology.orchestra.run.smithi081.stdout:autoheader 2023-12-20T04:24:46.926 INFO:teuthology.orchestra.run.smithi081.stdout:autoconf 2023-12-20T04:24:47.161 INFO:teuthology.orchestra.run.smithi081.stdout:./configure \ 2023-12-20T04:24:47.161 INFO:teuthology.orchestra.run.smithi081.stdout: --libexecdir=/usr/lib \ 2023-12-20T04:24:47.161 INFO:teuthology.orchestra.run.smithi081.stdout: --exec_prefix=/var/lib 2023-12-20T04:24:47.555 INFO:teuthology.orchestra.run.smithi081.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-20T04:24:47.556 INFO:teuthology.orchestra.run.smithi081.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-20T04:24:47.559 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to print strings... printf 2023-12-20T04:24:47.560 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... gcc 2023-12-20T04:24:47.726 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether the C compiler works... yes 2023-12-20T04:24:47.726 INFO:teuthology.orchestra.run.smithi081.stdout:checking for C compiler default output file name... a.out 2023-12-20T04:24:47.789 INFO:teuthology.orchestra.run.smithi081.stdout:checking for suffix of executables... 2023-12-20T04:24:47.880 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are cross compiling... no 2023-12-20T04:24:47.920 INFO:teuthology.orchestra.run.smithi081.stdout:checking for suffix of object files... o 2023-12-20T04:24:47.955 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... yes 2023-12-20T04:24:47.989 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... yes 2023-12-20T04:24:48.044 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-20T04:24:48.051 INFO:teuthology.orchestra.run.smithi081.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-20T04:24:48.056 INFO:teuthology.orchestra.run.smithi081.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-20T04:24:48.060 INFO:teuthology.orchestra.run.smithi081.stdout:checking for egrep... /bin/grep -E 2023-12-20T04:24:48.063 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fgrep... /bin/grep -F 2023-12-20T04:24:48.073 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ld used by gcc... /bin/ld 2023-12-20T04:24:48.078 INFO:teuthology.orchestra.run.smithi081.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-20T04:24:48.085 INFO:teuthology.orchestra.run.smithi081.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-20T04:24:49.124 INFO:teuthology.orchestra.run.smithi081.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-20T04:24:49.124 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether ln -s works... yes 2023-12-20T04:24:49.142 INFO:teuthology.orchestra.run.smithi081.stdout:checking the maximum length of command line arguments... 1572864 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking for /bin/ld option to reload object files... -r 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking for objdump... objdump 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to recognize dependent libraries... pass_all 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dlltool... no 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-20T04:24:49.152 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ar... ar 2023-12-20T04:24:49.282 INFO:teuthology.orchestra.run.smithi081.stdout:checking for archiver @FILE support... @ 2023-12-20T04:24:49.282 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strip... strip 2023-12-20T04:24:49.283 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ranlib... ranlib 2023-12-20T04:24:49.283 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gawk... gawk 2023-12-20T04:24:49.452 INFO:teuthology.orchestra.run.smithi081.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-20T04:24:49.457 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sysroot... no 2023-12-20T04:24:49.467 INFO:teuthology.orchestra.run.smithi081.stdout:checking for a working dd... /bin/dd 2023-12-20T04:24:49.475 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-20T04:24:49.507 INFO:teuthology.orchestra.run.smithi081.stdout:checking for mt... no 2023-12-20T04:24:49.513 INFO:teuthology.orchestra.run.smithi081.stdout:checking if : is a manifest tool... no 2023-12-20T04:24:49.600 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to run the C preprocessor... gcc -E 2023-12-20T04:24:49.944 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ANSI C header files... yes 2023-12-20T04:24:49.993 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/types.h... yes 2023-12-20T04:24:50.069 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/stat.h... yes 2023-12-20T04:24:50.127 INFO:teuthology.orchestra.run.smithi081.stdout:checking for stdlib.h... yes 2023-12-20T04:24:50.199 INFO:teuthology.orchestra.run.smithi081.stdout:checking for string.h... yes 2023-12-20T04:24:50.265 INFO:teuthology.orchestra.run.smithi081.stdout:checking for memory.h... yes 2023-12-20T04:24:50.325 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strings.h... yes 2023-12-20T04:24:50.425 INFO:teuthology.orchestra.run.smithi081.stdout:checking for inttypes.h... yes 2023-12-20T04:24:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:checking for stdint.h... yes 2023-12-20T04:24:50.561 INFO:teuthology.orchestra.run.smithi081.stdout:checking for unistd.h... yes 2023-12-20T04:24:50.632 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dlfcn.h... yes 2023-12-20T04:24:50.642 INFO:teuthology.orchestra.run.smithi081.stdout:checking for objdir... .libs 2023-12-20T04:24:50.829 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-20T04:24:50.829 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-20T04:24:50.881 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-20T04:24:50.932 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc static flag -static works... no 2023-12-20T04:24:51.028 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -c -o file.o... yes 2023-12-20T04:24:51.028 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-20T04:24:51.053 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-20T04:24:51.124 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether -lc should be explicitly linked in... no 2023-12-20T04:24:51.301 INFO:teuthology.orchestra.run.smithi081.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-20T04:24:51.301 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to hardcode library paths into programs... immediate 2023-12-20T04:24:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether stripping libraries is possible... yes 2023-12-20T04:24:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:checking if libtool supports shared libraries... yes 2023-12-20T04:24:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether to build shared libraries... yes 2023-12-20T04:24:51.306 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether to build static libraries... yes 2023-12-20T04:24:51.328 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... (cached) gcc 2023-12-20T04:24:51.385 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-20T04:24:51.385 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-20T04:24:51.386 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-20T04:24:51.386 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gmake... /usr/bin/gmake 2023-12-20T04:24:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2023-12-20T04:24:51.387 INFO:teuthology.orchestra.run.smithi081.stdout:checking for tar... /bin/tar 2023-12-20T04:24:51.387 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gzip... /bin/gzip 2023-12-20T04:24:51.414 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc -MM is supported... yes 2023-12-20T04:24:51.414 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sort... /bin/sort 2023-12-20T04:24:51.414 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether ln -s works... yes 2023-12-20T04:24:51.414 INFO:teuthology.orchestra.run.smithi081.stdout:checking for rpm... /bin/rpm 2023-12-20T04:24:51.424 INFO:teuthology.orchestra.run.smithi081.stdout:checking for rpmbuild... no 2023-12-20T04:24:51.496 INFO:teuthology.orchestra.run.smithi081.stdout:checking assert.h usability... yes 2023-12-20T04:24:51.521 INFO:teuthology.orchestra.run.smithi081.stdout:checking assert.h presence... yes 2023-12-20T04:24:51.521 INFO:teuthology.orchestra.run.smithi081.stdout:checking for assert.h... yes 2023-12-20T04:24:51.608 INFO:teuthology.orchestra.run.smithi081.stdout:checking bstring.h usability... no 2023-12-20T04:24:51.660 INFO:teuthology.orchestra.run.smithi081.stdout:checking bstring.h presence... no 2023-12-20T04:24:51.661 INFO:teuthology.orchestra.run.smithi081.stdout:checking for bstring.h... no 2023-12-20T04:24:51.746 INFO:teuthology.orchestra.run.smithi081.stdout:checking libgen.h usability... yes 2023-12-20T04:24:51.775 INFO:teuthology.orchestra.run.smithi081.stdout:checking libgen.h presence... yes 2023-12-20T04:24:51.775 INFO:teuthology.orchestra.run.smithi081.stdout:checking for libgen.h... yes 2023-12-20T04:24:51.907 INFO:teuthology.orchestra.run.smithi081.stdout:checking dirent.h usability... yes 2023-12-20T04:24:51.937 INFO:teuthology.orchestra.run.smithi081.stdout:checking dirent.h presence... yes 2023-12-20T04:24:51.937 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dirent.h... yes 2023-12-20T04:24:52.155 INFO:teuthology.orchestra.run.smithi081.stdout:checking errno.h usability... yes 2023-12-20T04:24:52.186 INFO:teuthology.orchestra.run.smithi081.stdout:checking errno.h presence... yes 2023-12-20T04:24:52.186 INFO:teuthology.orchestra.run.smithi081.stdout:checking for errno.h... yes 2023-12-20T04:24:52.291 INFO:teuthology.orchestra.run.smithi081.stdout:checking malloc.h usability... yes 2023-12-20T04:24:52.321 INFO:teuthology.orchestra.run.smithi081.stdout:checking malloc.h presence... yes 2023-12-20T04:24:52.321 INFO:teuthology.orchestra.run.smithi081.stdout:checking for malloc.h... yes 2023-12-20T04:24:52.419 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid.h usability... no 2023-12-20T04:24:52.463 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid.h presence... no 2023-12-20T04:24:52.463 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid.h... no 2023-12-20T04:24:52.545 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid/uuid.h usability... yes 2023-12-20T04:24:52.575 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid/uuid.h presence... yes 2023-12-20T04:24:52.575 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid/uuid.h... yes 2023-12-20T04:24:52.646 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/uuid.h usability... no 2023-12-20T04:24:52.684 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/uuid.h presence... no 2023-12-20T04:24:52.684 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/uuid.h... no 2023-12-20T04:24:52.763 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/file.h usability... yes 2023-12-20T04:24:52.791 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/file.h presence... yes 2023-12-20T04:24:52.791 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/file.h... yes 2023-12-20T04:24:52.891 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fcntl.h usability... yes 2023-12-20T04:24:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fcntl.h presence... yes 2023-12-20T04:24:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/fcntl.h... yes 2023-12-20T04:24:52.992 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/syssgi.h usability... no 2023-12-20T04:24:53.031 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/syssgi.h presence... no 2023-12-20T04:24:53.032 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/syssgi.h... no 2023-12-20T04:24:53.150 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/param.h usability... yes 2023-12-20T04:24:53.183 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/param.h presence... yes 2023-12-20T04:24:53.183 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/param.h... yes 2023-12-20T04:24:53.202 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/stat.h... (cached) yes 2023-12-20T04:24:53.290 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/statvfs.h usability... yes 2023-12-20T04:24:53.317 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/statvfs.h presence... yes 2023-12-20T04:24:53.317 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/statvfs.h... yes 2023-12-20T04:24:53.400 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/time.h usability... yes 2023-12-20T04:24:53.424 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/time.h presence... yes 2023-12-20T04:24:53.424 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/time.h... yes 2023-12-20T04:24:53.542 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/ioctl.h usability... yes 2023-12-20T04:24:53.567 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/ioctl.h presence... yes 2023-12-20T04:24:53.567 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/ioctl.h... yes 2023-12-20T04:24:53.656 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/wait.h usability... yes 2023-12-20T04:24:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/wait.h presence... yes 2023-12-20T04:24:53.689 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/wait.h... yes 2023-12-20T04:24:53.709 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/types.h... (cached) yes 2023-12-20T04:24:53.726 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strings.h... (cached) yes 2023-12-20T04:24:53.802 INFO:teuthology.orchestra.run.smithi081.stdout:checking err.h usability... yes 2023-12-20T04:24:53.826 INFO:teuthology.orchestra.run.smithi081.stdout:checking err.h presence... yes 2023-12-20T04:24:53.826 INFO:teuthology.orchestra.run.smithi081.stdout:checking for err.h... yes 2023-12-20T04:24:53.901 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/falloc.h usability... yes 2023-12-20T04:24:53.924 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/falloc.h presence... yes 2023-12-20T04:24:53.925 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/falloc.h... yes 2023-12-20T04:24:54.011 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-20T04:24:54.056 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-20T04:24:54.056 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-20T04:24:54.128 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-20T04:24:54.168 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-20T04:24:54.168 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-20T04:24:54.242 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/platform_defs.h usability... no 2023-12-20T04:24:54.284 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/platform_defs.h presence... no 2023-12-20T04:24:54.284 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/platform_defs.h... no 2023-12-20T04:24:54.356 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfs/ioctl.h usability... no 2023-12-20T04:24:54.397 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfs/ioctl.h presence... no 2023-12-20T04:24:54.397 INFO:teuthology.orchestra.run.smithi081.stdout:checking for btrfs/ioctl.h... no 2023-12-20T04:24:54.467 INFO:teuthology.orchestra.run.smithi081.stdout:checking cifs/ioctl.h usability... no 2023-12-20T04:24:54.507 INFO:teuthology.orchestra.run.smithi081.stdout:checking cifs/ioctl.h presence... no 2023-12-20T04:24:54.507 INFO:teuthology.orchestra.run.smithi081.stdout:checking for cifs/ioctl.h... no 2023-12-20T04:24:54.581 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/mman.h usability... yes 2023-12-20T04:24:54.608 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/mman.h presence... yes 2023-12-20T04:24:54.608 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/mman.h... yes 2023-12-20T04:24:54.662 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/xfs_log_format.h... no 2023-12-20T04:24:54.754 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid_compare... no 2023-12-20T04:24:54.834 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid_compare in -luuid... yes 2023-12-20T04:24:54.996 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/xfs.h... yes 2023-12-20T04:24:55.041 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/libxfs.h... no 2023-12-20T04:24:55.095 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-20T04:24:55.169 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/xqm.h... yes 2023-12-20T04:24:55.271 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-20T04:24:55.332 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/handle.h usability... yes 2023-12-20T04:24:55.357 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/handle.h presence... yes 2023-12-20T04:24:55.358 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/handle.h... yes 2023-12-20T04:24:55.443 INFO:teuthology.orchestra.run.smithi081.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-20T04:24:55.508 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/acl.h usability... yes 2023-12-20T04:24:55.534 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/acl.h presence... yes 2023-12-20T04:24:55.534 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/acl.h... yes 2023-12-20T04:24:55.595 INFO:teuthology.orchestra.run.smithi081.stdout:checking acl/libacl.h usability... yes 2023-12-20T04:24:55.623 INFO:teuthology.orchestra.run.smithi081.stdout:checking acl/libacl.h presence... yes 2023-12-20T04:24:55.623 INFO:teuthology.orchestra.run.smithi081.stdout:checking for acl/libacl.h... yes 2023-12-20T04:24:55.707 INFO:teuthology.orchestra.run.smithi081.stdout:checking for acl_init in -lacl... yes 2023-12-20T04:24:55.775 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm-ndbm.h usability... no 2023-12-20T04:24:55.819 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm-ndbm.h presence... no 2023-12-20T04:24:55.819 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gdbm-ndbm.h... no 2023-12-20T04:24:55.885 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm/ndbm.h usability... no 2023-12-20T04:24:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm/ndbm.h presence... no 2023-12-20T04:24:55.928 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gdbm/ndbm.h... no 2023-12-20T04:24:55.995 INFO:teuthology.orchestra.run.smithi081.stdout:checking ndbm.h usability... no 2023-12-20T04:24:56.038 INFO:teuthology.orchestra.run.smithi081.stdout:checking ndbm.h presence... no 2023-12-20T04:24:56.038 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ndbm.h... no 2023-12-20T04:24:56.103 INFO:teuthology.orchestra.run.smithi081.stdout:checking libaio.h usability... yes 2023-12-20T04:24:56.135 INFO:teuthology.orchestra.run.smithi081.stdout:checking libaio.h presence... yes 2023-12-20T04:24:56.135 INFO:teuthology.orchestra.run.smithi081.stdout:checking for libaio.h... yes 2023-12-20T04:24:56.202 INFO:teuthology.orchestra.run.smithi081.stdout:checking liburing.h usability... no 2023-12-20T04:24:56.244 INFO:teuthology.orchestra.run.smithi081.stdout:checking liburing.h presence... no 2023-12-20T04:24:56.245 INFO:teuthology.orchestra.run.smithi081.stdout:checking for liburing.h... no 2023-12-20T04:24:56.310 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/capability.h usability... no 2023-12-20T04:24:56.350 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/capability.h presence... no 2023-12-20T04:24:56.350 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/capability.h... no 2023-12-20T04:24:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fiemap.h usability... yes 2023-12-20T04:24:56.439 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fiemap.h presence... yes 2023-12-20T04:24:56.439 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/fiemap.h... yes 2023-12-20T04:24:56.525 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fallocate... yes 2023-12-20T04:24:56.608 INFO:teuthology.orchestra.run.smithi081.stdout:checking for open_by_handle_at... yes 2023-12-20T04:24:56.679 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/prctl.h usability... yes 2023-12-20T04:24:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/prctl.h presence... yes 2023-12-20T04:24:56.704 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/prctl.h... yes 2023-12-20T04:24:56.769 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fs.h usability... yes 2023-12-20T04:24:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fs.h presence... yes 2023-12-20T04:24:56.798 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/fs.h... yes 2023-12-20T04:24:56.863 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfsutil.h usability... no 2023-12-20T04:24:56.901 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfsutil.h presence... no 2023-12-20T04:24:56.901 INFO:teuthology.orchestra.run.smithi081.stdout:checking for btrfsutil.h... no 2023-12-20T04:24:56.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:24:56.941 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:24:56.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:24:56.984 INFO:teuthology.orchestra.run.smithi081.stdout:checking for copy_file_range... yes 2023-12-20T04:24:57.064 INFO:teuthology.orchestra.run.smithi081.stdout:checking for SEEK_DATA... yes 2023-12-20T04:24:57.174 INFO:teuthology.orchestra.run.smithi081.stdout:checking for BMV_OF_SHARED... yes 2023-12-20T04:24:57.264 INFO:teuthology.orchestra.run.smithi081.stdout:checking for nftw... yes 2023-12-20T04:24:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:checking for RLIMIT_NOFILE... yes 2023-12-20T04:24:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2023-12-20T04:24:57.513 INFO:teuthology.orchestra.run.smithi081.stdout:checking for FICLONE... yes 2023-12-20T04:24:57.591 INFO:teuthology.orchestra.run.smithi081.stdout:checking for renameat2... yes 2023-12-20T04:24:57.673 INFO:teuthology.orchestra.run.smithi081.stdout:checking for reallocarray... yes 2023-12-20T04:24:57.765 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct mount_attr... yes 2023-12-20T04:24:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-20T04:24:57.965 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-20T04:24:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-20T04:24:58.173 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-20T04:24:58.278 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-20T04:24:58.386 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-20T04:24:58.489 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-20T04:24:58.556 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs.h usability... yes 2023-12-20T04:24:58.581 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs.h presence... yes 2023-12-20T04:24:58.581 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/btrfs.h... yes 2023-12-20T04:24:58.657 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-20T04:24:58.678 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-20T04:24:58.678 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/btrfs_tree.h... yes 2023-12-20T04:24:58.730 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-20T04:24:58.765 INFO:teuthology.orchestra.run.smithi081.stdout:configure: creating ./config.status 2023-12-20T04:24:59.761 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: creating include/builddefs 2023-12-20T04:24:59.796 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: creating include/config.h 2023-12-20T04:24:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: executing libtool commands 2023-12-20T04:24:59.909 INFO:teuthology.orchestra.run.smithi081.stdout:Building include 2023-12-20T04:24:59.918 INFO:teuthology.orchestra.run.smithi081.stdout:Building lib 2023-12-20T04:24:59.927 INFO:teuthology.orchestra.run.smithi081.stdout: [LTDEP] 2023-12-20T04:25:00.215 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dataascii.lo 2023-12-20T04:25:00.471 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] databin.lo 2023-12-20T04:25:00.761 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] datapid.lo 2023-12-20T04:25:01.017 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] file_lock.lo 2023-12-20T04:25:01.321 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] forker.lo 2023-12-20T04:25:01.591 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] pattern.lo 2023-12-20T04:25:01.853 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] open_flags.lo 2023-12-20T04:25:02.161 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] random_range.lo 2023-12-20T04:25:02.539 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] string_to_tokens.lo 2023-12-20T04:25:02.777 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] str_to_bytes.lo 2023-12-20T04:25:03.076 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] tlibio.lo 2023-12-20T04:25:03.486 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] write_log.lo 2023-12-20T04:25:03.878 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] random.lo 2023-12-20T04:25:04.139 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] 2023-12-20T04:25:04.375 INFO:teuthology.orchestra.run.smithi081.stdout:Building ltp 2023-12-20T04:25:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2023-12-20T04:25:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] doio 2023-12-20T04:25:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsstress 2023-12-20T04:25:07.162 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsx 2023-12-20T04:25:08.104 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] growfiles 2023-12-20T04:25:08.796 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] iogen 2023-12-20T04:25:09.390 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-stress 2023-12-20T04:25:10.022 INFO:teuthology.orchestra.run.smithi081.stdout:Building src 2023-12-20T04:25:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2023-12-20T04:25:13.766 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2023-12-20T04:25:13.833 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2023-12-20T04:25:13.855 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2023-12-20T04:25:14.329 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2023-12-20T04:25:14.382 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dirstress 2023-12-20T04:25:14.853 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fill 2023-12-20T04:25:15.188 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fill2 2023-12-20T04:25:15.634 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] getpagesize 2023-12-20T04:25:15.943 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] holes 2023-12-20T04:25:16.330 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] lstat64 2023-12-20T04:25:16.703 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] nametest 2023-12-20T04:25:17.128 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] permname 2023-12-20T04:25:17.522 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] randholes 2023-12-20T04:25:17.979 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] runas 2023-12-20T04:25:18.363 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] truncfile 2023-12-20T04:25:18.710 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] usemem 2023-12-20T04:25:19.038 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mmapcat 2023-12-20T04:25:19.366 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] append_reader 2023-12-20T04:25:19.721 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] append_writer 2023-12-20T04:25:20.052 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dirperf 2023-12-20T04:25:20.468 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] metaperf 2023-12-20T04:25:20.941 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] devzero 2023-12-20T04:25:21.314 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] feature 2023-12-20T04:25:21.739 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] alloc 2023-12-20T04:25:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fault 2023-12-20T04:25:22.513 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fstest 2023-12-20T04:25:22.960 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_access_root 2023-12-20T04:25:23.296 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] godown 2023-12-20T04:25:23.683 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] resvtest 2023-12-20T04:25:24.051 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] writemod 2023-12-20T04:25:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] writev_on_pagefault 2023-12-20T04:25:24.709 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] makeextents 2023-12-20T04:25:25.063 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] itrash 2023-12-20T04:25:25.439 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] rename 2023-12-20T04:25:25.746 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] multi_open_unlink 2023-12-20T04:25:26.094 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] unwritten_sync 2023-12-20T04:25:26.424 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] genhashnames 2023-12-20T04:25:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_holes 2023-12-20T04:25:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_writev 2023-12-20T04:25:27.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:25:27.171 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:25:27.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:25:27.404 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_truncate_cmtime 2023-12-20T04:25:27.750 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dirhash_collide 2023-12-20T04:25:28.100 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_rename_overwrite 2023-12-20T04:25:28.422 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] holetest 2023-12-20T04:25:28.839 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_truncate_self 2023-12-20T04:25:29.164 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] af_unix 2023-12-20T04:25:29.500 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_stale_pmd 2023-12-20T04:25:29.826 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_cow_race 2023-12-20T04:25:30.168 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_fallocate 2023-12-20T04:25:30.448 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsync-err 2023-12-20T04:25:30.848 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_write_ro 2023-12-20T04:25:31.179 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-20T04:25:31.523 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-20T04:25:31.876 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_ofd_locks 2023-12-20T04:25:32.290 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_collision 2023-12-20T04:25:32.664 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mmap-write-concurrent 2023-12-20T04:25:32.984 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_get_file_time 2023-12-20T04:25:33.323 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_create_short_dirs 2023-12-20T04:25:33.680 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_create_long_dirs 2023-12-20T04:25:34.019 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_enospc 2023-12-20T04:25:34.384 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_writev_overlap 2023-12-20T04:25:34.741 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] checkpoint_journal 2023-12-20T04:25:35.096 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mmap-rw-fault 2023-12-20T04:25:35.469 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] allocstale 2023-12-20T04:25:35.820 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_cow_memory_failure 2023-12-20T04:25:36.201 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fake-dump-rootino 2023-12-20T04:25:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dio-buf-fault 2023-12-20T04:25:36.841 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] rewinddir-test 2023-12-20T04:25:37.185 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfsctl 2023-12-20T04:25:37.560 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bstat 2023-12-20T04:25:37.944 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mtab 2023-12-20T04:25:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] getdevicesize 2023-12-20T04:25:38.649 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] preallo_rw_pattern_reader 2023-12-20T04:25:38.992 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] preallo_rw_pattern_writer 2023-12-20T04:25:39.359 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] ftrunc 2023-12-20T04:25:39.688 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] trunc 2023-12-20T04:25:40.028 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fs_perms 2023-12-20T04:25:40.403 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] testx 2023-12-20T04:25:40.680 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] looptest 2023-12-20T04:25:41.048 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] locktest 2023-12-20T04:25:41.547 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] unwritten_mmap 2023-12-20T04:25:41.884 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat_unlink_test 2023-12-20T04:25:42.279 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] deduperace 2023-12-20T04:25:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat_unlink_test_modified 2023-12-20T04:25:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_dir_offset 2023-12-20T04:25:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_futimens 2023-12-20T04:25:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_immutable 2023-12-20T04:25:44.441 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] stale_handle 2023-12-20T04:25:44.777 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] pwrite_mmap_blocked 2023-12-20T04:25:45.117 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_dir_offset2 2023-12-20T04:25:45.485 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] seek_sanity_test 2023-12-20T04:25:46.141 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] seek_copy_test 2023-12-20T04:25:46.486 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_readdir_1 2023-12-20T04:25:46.822 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_readdir_2 2023-12-20T04:25:47.124 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsync-tester 2023-12-20T04:25:47.599 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] nsexec 2023-12-20T04:25:47.985 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] cloner 2023-12-20T04:25:48.325 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] renameat2 2023-12-20T04:25:48.640 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_getcwd 2023-12-20T04:25:48.964 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] e4compact 2023-12-20T04:25:49.354 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] test-nextquota 2023-12-20T04:25:49.683 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] punch-alternating 2023-12-20T04:25:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-20T04:25:50.392 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] listxattr 2023-12-20T04:25:50.730 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dio-interleaved 2023-12-20T04:25:51.093 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_dir_type 2023-12-20T04:25:51.442 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dio-invalidate-cache 2023-12-20T04:25:51.811 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] stat_test 2023-12-20T04:25:52.312 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_encrypted_d_revalidate 2023-12-20T04:25:52.637 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attr_replace_test 2023-12-20T04:25:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] swapon 2023-12-20T04:25:53.342 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mkswap 2023-12-20T04:25:53.675 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_attr_corruption 2023-12-20T04:25:54.010 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_open_tmpfiles 2023-12-20T04:25:54.380 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fscrypt-crypt-util 2023-12-20T04:25:55.240 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat_null_ocount 2023-12-20T04:25:55.579 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] splice-test 2023-12-20T04:25:55.972 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] chprojid_fail 2023-12-20T04:25:56.310 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] detached_mounts_propagation 2023-12-20T04:25:56.697 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] ext4_resize 2023-12-20T04:25:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_readdir_3 2023-12-20T04:25:57.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:25:57.286 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:25:57.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:25:57.359 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] splice2pipe 2023-12-20T04:25:57.683 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] uuid_ioctl 2023-12-20T04:25:58.022 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fiemap-tester 2023-12-20T04:25:58.485 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_stripealign 2023-12-20T04:25:58.826 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] open_by_handle 2023-12-20T04:25:59.263 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_dio 2023-12-20T04:25:59.602 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfsfind 2023-12-20T04:25:59.990 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_reflink_read_race 2023-12-20T04:26:00.375 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fssum 2023-12-20T04:26:01.017 INFO:teuthology.orchestra.run.smithi081.stdout:Building log-writes 2023-12-20T04:26:01.030 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] replay-log 2023-12-20T04:26:01.534 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2023-12-20T04:26:01.544 INFO:teuthology.orchestra.run.smithi081.stdout:Building aio-dio-regress 2023-12-20T04:26:01.560 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aiocp 2023-12-20T04:26:01.965 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-20T04:26:02.294 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-append-write-read-race 2023-12-20T04:26:02.692 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-cow-race 2023-12-20T04:26:03.025 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-cycle-write 2023-12-20T04:26:03.387 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-eof-race 2023-12-20T04:26:03.755 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-extend-stat 2023-12-20T04:26:04.095 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-fcntl-race 2023-12-20T04:26:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-hole-filling-race 2023-12-20T04:26:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-invalidate-failure 2023-12-20T04:26:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-invalidate-readahead 2023-12-20T04:26:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aiodio_sparse2 2023-12-20T04:26:05.909 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-subblock-eof-read 2023-12-20T04:26:06.243 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-write-verify 2023-12-20T04:26:06.626 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-20T04:26:06.947 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-20T04:26:07.236 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-last-ref-held-by-io 2023-12-20T04:26:07.611 INFO:teuthology.orchestra.run.smithi081.stdout:Building vfs 2023-12-20T04:26:07.623 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] vfstest 2023-12-20T04:26:09.951 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mount-idmapped 2023-12-20T04:26:10.543 INFO:teuthology.orchestra.run.smithi081.stdout:Building m4 2023-12-20T04:26:10.555 INFO:teuthology.orchestra.run.smithi081.stdout:Building common 2023-12-20T04:26:10.565 INFO:teuthology.orchestra.run.smithi081.stdout:Building tests 2023-12-20T04:26:10.579 INFO:teuthology.orchestra.run.smithi081.stdout:Building btrfs 2023-12-20T04:26:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/btrfs/group.list 2023-12-20T04:26:10.807 INFO:teuthology.orchestra.run.smithi081.stdout:Building ceph 2023-12-20T04:26:10.822 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/ceph/group.list 2023-12-20T04:26:10.876 INFO:teuthology.orchestra.run.smithi081.stdout:Building cifs 2023-12-20T04:26:10.889 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/cifs/group.list 2023-12-20T04:26:10.935 INFO:teuthology.orchestra.run.smithi081.stdout:Building ext4 2023-12-20T04:26:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/ext4/group.list 2023-12-20T04:26:11.093 INFO:teuthology.orchestra.run.smithi081.stdout:Building f2fs 2023-12-20T04:26:11.107 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/f2fs/group.list 2023-12-20T04:26:11.175 INFO:teuthology.orchestra.run.smithi081.stdout:Building generic 2023-12-20T04:26:11.193 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/generic/group.list 2023-12-20T04:26:11.559 INFO:teuthology.orchestra.run.smithi081.stdout:Building nfs 2023-12-20T04:26:11.574 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/nfs/group.list 2023-12-20T04:26:11.627 INFO:teuthology.orchestra.run.smithi081.stdout:Building ocfs2 2023-12-20T04:26:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/ocfs2/group.list 2023-12-20T04:26:11.693 INFO:teuthology.orchestra.run.smithi081.stdout:Building overlay 2023-12-20T04:26:11.707 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/overlay/group.list 2023-12-20T04:26:11.857 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2023-12-20T04:26:11.872 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/perf/group.list 2023-12-20T04:26:11.913 INFO:teuthology.orchestra.run.smithi081.stdout:Building selftest 2023-12-20T04:26:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/selftest/group.list 2023-12-20T04:26:11.969 INFO:teuthology.orchestra.run.smithi081.stdout:Building shared 2023-12-20T04:26:11.981 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/shared/group.list 2023-12-20T04:26:12.043 INFO:teuthology.orchestra.run.smithi081.stdout:Building tmpfs 2023-12-20T04:26:12.056 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/tmpfs/group.list 2023-12-20T04:26:12.102 INFO:teuthology.orchestra.run.smithi081.stdout:Building udf 2023-12-20T04:26:12.115 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/udf/group.list 2023-12-20T04:26:12.158 INFO:teuthology.orchestra.run.smithi081.stdout:Building xfs 2023-12-20T04:26:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/xfs/group.list 2023-12-20T04:26:12.566 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.utfXGGFva6xfstests-dev && exec sudo make install) 2023-12-20T04:26:12.692 INFO:teuthology.orchestra.run.smithi081.stdout:Building include 2023-12-20T04:26:12.702 INFO:teuthology.orchestra.run.smithi081.stdout:Building lib 2023-12-20T04:26:12.712 INFO:teuthology.orchestra.run.smithi081.stdout:Building ltp 2023-12-20T04:26:12.723 INFO:teuthology.orchestra.run.smithi081.stdout:Building src 2023-12-20T04:26:12.806 INFO:teuthology.orchestra.run.smithi081.stdout:Building log-writes 2023-12-20T04:26:12.816 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2023-12-20T04:26:12.827 INFO:teuthology.orchestra.run.smithi081.stdout:Building aio-dio-regress 2023-12-20T04:26:12.838 INFO:teuthology.orchestra.run.smithi081.stdout:Building vfs 2023-12-20T04:26:12.850 INFO:teuthology.orchestra.run.smithi081.stdout:Building m4 2023-12-20T04:26:12.861 INFO:teuthology.orchestra.run.smithi081.stdout:Building common 2023-12-20T04:26:12.871 INFO:teuthology.orchestra.run.smithi081.stdout:Building tests 2023-12-20T04:26:12.886 INFO:teuthology.orchestra.run.smithi081.stdout:Building btrfs 2023-12-20T04:26:12.903 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/btrfs/group.list 2023-12-20T04:26:13.129 INFO:teuthology.orchestra.run.smithi081.stdout:Building ceph 2023-12-20T04:26:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/ceph/group.list 2023-12-20T04:26:13.197 INFO:teuthology.orchestra.run.smithi081.stdout:Building cifs 2023-12-20T04:26:13.212 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/cifs/group.list 2023-12-20T04:26:13.259 INFO:teuthology.orchestra.run.smithi081.stdout:Building ext4 2023-12-20T04:26:13.273 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/ext4/group.list 2023-12-20T04:26:13.415 INFO:teuthology.orchestra.run.smithi081.stdout:Building f2fs 2023-12-20T04:26:13.431 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/f2fs/group.list 2023-12-20T04:26:13.496 INFO:teuthology.orchestra.run.smithi081.stdout:Building generic 2023-12-20T04:26:13.514 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/generic/group.list 2023-12-20T04:26:13.890 INFO:teuthology.orchestra.run.smithi081.stdout:Building nfs 2023-12-20T04:26:13.905 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/nfs/group.list 2023-12-20T04:26:13.961 INFO:teuthology.orchestra.run.smithi081.stdout:Building ocfs2 2023-12-20T04:26:13.976 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/ocfs2/group.list 2023-12-20T04:26:14.027 INFO:teuthology.orchestra.run.smithi081.stdout:Building overlay 2023-12-20T04:26:14.042 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/overlay/group.list 2023-12-20T04:26:14.197 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2023-12-20T04:26:14.212 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/perf/group.list 2023-12-20T04:26:14.253 INFO:teuthology.orchestra.run.smithi081.stdout:Building selftest 2023-12-20T04:26:14.266 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/selftest/group.list 2023-12-20T04:26:14.312 INFO:teuthology.orchestra.run.smithi081.stdout:Building shared 2023-12-20T04:26:14.325 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/shared/group.list 2023-12-20T04:26:14.388 INFO:teuthology.orchestra.run.smithi081.stdout:Building tmpfs 2023-12-20T04:26:14.403 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/tmpfs/group.list 2023-12-20T04:26:14.454 INFO:teuthology.orchestra.run.smithi081.stdout:Building udf 2023-12-20T04:26:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/udf/group.list 2023-12-20T04:26:14.509 INFO:teuthology.orchestra.run.smithi081.stdout:Building xfs 2023-12-20T04:26:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.utfXGGFva6xfstests-dev/tests/xfs/group.list 2023-12-20T04:26:14.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-20T04:26:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-20T04:26:14.872 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-20T04:26:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-20T04:26:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-20T04:26:14.882 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-20T04:26:14.914 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-20T04:26:15.160 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-20T04:26:15.193 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-20T04:26:15.237 INFO:teuthology.orchestra.run.smithi081.stdout:Building log-writes 2023-12-20T04:26:15.248 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2023-12-20T04:26:15.259 INFO:teuthology.orchestra.run.smithi081.stdout:Building aio-dio-regress 2023-12-20T04:26:15.270 INFO:teuthology.orchestra.run.smithi081.stdout:Building vfs 2023-12-20T04:26:15.280 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C log-writes install 2023-12-20T04:26:15.283 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-20T04:26:15.317 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-20T04:26:15.351 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C perf install 2023-12-20T04:26:15.354 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-20T04:26:15.388 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-20T04:26:15.471 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-20T04:26:15.475 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-20T04:26:15.509 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-20T04:26:15.696 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C vfs install 2023-12-20T04:26:15.700 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-20T04:26:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-20T04:26:15.775 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-20T04:26:15.809 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2023-12-20T04:26:20.189 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-20T04:26:20.531 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-20T04:26:20.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-20T04:26:20.607 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-20T04:26:20.607 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-20T04:26:20.611 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-20T04:26:20.644 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-20T04:26:21.149 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-20T04:26:21.153 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/btrfs/ install 2023-12-20T04:26:21.160 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-20T04:26:21.192 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2023-12-20T04:26:24.287 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-20T04:26:24.320 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2023-12-20T04:26:27.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:26:27.405 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:26:27.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:26:27.609 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/ceph/ install 2023-12-20T04:26:27.612 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-20T04:26:27.642 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-20T04:26:27.706 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-20T04:26:27.736 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-20T04:26:27.805 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/cifs/ install 2023-12-20T04:26:27.808 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-20T04:26:27.843 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-20T04:26:27.875 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-20T04:26:27.907 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-20T04:26:27.940 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/ext4/ install 2023-12-20T04:26:27.944 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-20T04:26:27.977 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-20T04:26:28.730 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-20T04:26:28.764 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-20T04:26:29.543 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/f2fs/ install 2023-12-20T04:26:29.547 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-20T04:26:29.580 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-20T04:26:29.623 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-20T04:26:29.656 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-20T04:26:29.699 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/generic/ install 2023-12-20T04:26:29.709 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-20T04:26:29.742 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 /var/lib/xfstests/tests/generic 2023-12-20T04:26:36.900 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-20T04:26:36.933 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out /var/lib/xfstests/tests/generic 2023-12-20T04:26:44.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/nfs/ install 2023-12-20T04:26:44.491 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-20T04:26:44.525 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-20T04:26:44.560 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-20T04:26:44.592 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-20T04:26:44.623 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/ocfs2/ install 2023-12-20T04:26:44.628 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-20T04:26:44.660 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-20T04:26:44.691 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-20T04:26:44.723 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-20T04:26:44.755 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/overlay/ install 2023-12-20T04:26:44.759 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-20T04:26:44.791 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-20T04:26:45.877 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-20T04:26:45.914 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-20T04:26:46.979 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/perf/ install 2023-12-20T04:26:46.983 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-20T04:26:47.015 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-20T04:26:47.047 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-20T04:26:47.080 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-20T04:26:47.113 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/selftest/ install 2023-12-20T04:26:47.117 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-20T04:26:47.150 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-20T04:26:47.233 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-20T04:26:47.264 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-20T04:26:47.345 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/shared/ install 2023-12-20T04:26:47.349 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-20T04:26:47.382 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-20T04:26:47.432 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-20T04:26:47.464 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-20T04:26:47.515 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/tmpfs/ install 2023-12-20T04:26:47.518 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-20T04:26:47.551 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-20T04:26:47.583 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-20T04:26:47.614 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-20T04:26:47.647 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/udf/ install 2023-12-20T04:26:47.652 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-20T04:26:47.683 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-20T04:26:47.716 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-20T04:26:47.748 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-20T04:26:47.781 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.utfXGGFva6xfstests-dev/tests/xfs/ install 2023-12-20T04:26:47.791 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-20T04:26:47.824 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-20T04:26:54.795 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-20T04:26:54.829 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-20T04:26:57.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:26:57.547 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:26:57.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:27:01.951 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-20T04:27:01.984 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-20T04:27:02.018 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-20T04:27:02.052 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-20T04:27:02.090 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.GopArGmA0Mxfsprogs-dev && exec sudo make) 2023-12-20T04:27:02.199 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize -c -i -f 2023-12-20T04:27:02.556 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-12-20T04:27:02.556 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './config.guess' 2023-12-20T04:27:02.570 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './config.sub' 2023-12-20T04:27:02.586 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './install-sh' 2023-12-20T04:27:02.601 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './ltmain.sh' 2023-12-20T04:27:02.696 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-20T04:27:02.696 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-20T04:27:02.719 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-20T04:27:02.742 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-20T04:27:02.765 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-20T04:27:02.788 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-20T04:27:02.818 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-20T04:27:02.823 INFO:teuthology.orchestra.run.smithi081.stdout:cp include/install-sh . 2023-12-20T04:27:02.826 INFO:teuthology.orchestra.run.smithi081.stdout:aclocal -I m4 2023-12-20T04:27:04.226 INFO:teuthology.orchestra.run.smithi081.stdout:autoconf 2023-12-20T04:27:04.735 INFO:teuthology.orchestra.run.smithi081.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-12-20T04:27:04.909 INFO:teuthology.orchestra.run.smithi081.stdout:configure: loading site script /usr/share/config.site 2023-12-20T04:27:04.955 INFO:teuthology.orchestra.run.smithi081.stdout:checking for a BSD-compatible install... /bin/install -c 2023-12-20T04:27:05.085 INFO:teuthology.orchestra.run.smithi081.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-20T04:27:05.085 INFO:teuthology.orchestra.run.smithi081.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-20T04:27:05.090 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to print strings... printf 2023-12-20T04:27:05.090 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... gcc 2023-12-20T04:27:05.212 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether the C compiler works... yes 2023-12-20T04:27:05.213 INFO:teuthology.orchestra.run.smithi081.stdout:checking for C compiler default output file name... a.out 2023-12-20T04:27:05.281 INFO:teuthology.orchestra.run.smithi081.stdout:checking for suffix of executables... 2023-12-20T04:27:05.360 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are cross compiling... no 2023-12-20T04:27:05.409 INFO:teuthology.orchestra.run.smithi081.stdout:checking for suffix of object files... o 2023-12-20T04:27:05.453 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... yes 2023-12-20T04:27:05.498 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... yes 2023-12-20T04:27:05.565 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-20T04:27:05.575 INFO:teuthology.orchestra.run.smithi081.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-20T04:27:05.583 INFO:teuthology.orchestra.run.smithi081.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-20T04:27:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:checking for egrep... /bin/grep -E 2023-12-20T04:27:05.592 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fgrep... /bin/grep -F 2023-12-20T04:27:05.606 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ld used by gcc... /bin/ld 2023-12-20T04:27:05.613 INFO:teuthology.orchestra.run.smithi081.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-20T04:27:05.620 INFO:teuthology.orchestra.run.smithi081.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-20T04:27:05.708 INFO:teuthology.orchestra.run.smithi081.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-20T04:27:05.708 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether ln -s works... yes 2023-12-20T04:27:05.720 INFO:teuthology.orchestra.run.smithi081.stdout:checking the maximum length of command line arguments... 1572864 2023-12-20T04:27:05.731 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-20T04:27:05.732 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-20T04:27:05.732 INFO:teuthology.orchestra.run.smithi081.stdout:checking for /bin/ld option to reload object files... -r 2023-12-20T04:27:05.732 INFO:teuthology.orchestra.run.smithi081.stdout:checking for objdump... objdump 2023-12-20T04:27:05.733 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to recognize dependent libraries... pass_all 2023-12-20T04:27:05.734 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dlltool... no 2023-12-20T04:27:05.735 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-20T04:27:05.735 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ar... ar 2023-12-20T04:27:05.832 INFO:teuthology.orchestra.run.smithi081.stdout:checking for archiver @FILE support... @ 2023-12-20T04:27:05.833 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strip... strip 2023-12-20T04:27:05.833 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ranlib... ranlib 2023-12-20T04:27:05.834 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gawk... gawk 2023-12-20T04:27:06.017 INFO:teuthology.orchestra.run.smithi081.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-20T04:27:06.021 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sysroot... no 2023-12-20T04:27:06.033 INFO:teuthology.orchestra.run.smithi081.stdout:checking for a working dd... /bin/dd 2023-12-20T04:27:06.044 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-20T04:27:06.087 INFO:teuthology.orchestra.run.smithi081.stdout:checking for mt... no 2023-12-20T04:27:06.095 INFO:teuthology.orchestra.run.smithi081.stdout:checking if : is a manifest tool... no 2023-12-20T04:27:06.158 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to run the C preprocessor... gcc -E 2023-12-20T04:27:06.424 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ANSI C header files... yes 2023-12-20T04:27:06.480 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/types.h... yes 2023-12-20T04:27:06.549 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/stat.h... yes 2023-12-20T04:27:06.617 INFO:teuthology.orchestra.run.smithi081.stdout:checking for stdlib.h... yes 2023-12-20T04:27:06.688 INFO:teuthology.orchestra.run.smithi081.stdout:checking for string.h... yes 2023-12-20T04:27:06.754 INFO:teuthology.orchestra.run.smithi081.stdout:checking for memory.h... yes 2023-12-20T04:27:06.825 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strings.h... yes 2023-12-20T04:27:06.899 INFO:teuthology.orchestra.run.smithi081.stdout:checking for inttypes.h... yes 2023-12-20T04:27:06.969 INFO:teuthology.orchestra.run.smithi081.stdout:checking for stdint.h... yes 2023-12-20T04:27:07.040 INFO:teuthology.orchestra.run.smithi081.stdout:checking for unistd.h... yes 2023-12-20T04:27:07.111 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dlfcn.h... yes 2023-12-20T04:27:07.122 INFO:teuthology.orchestra.run.smithi081.stdout:checking for objdir... .libs 2023-12-20T04:27:07.291 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-20T04:27:07.291 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-20T04:27:07.346 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-20T04:27:07.397 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc static flag -static works... no 2023-12-20T04:27:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -c -o file.o... yes 2023-12-20T04:27:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-20T04:27:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-20T04:27:07.564 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether -lc should be explicitly linked in... no 2023-12-20T04:27:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-20T04:27:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to hardcode library paths into programs... immediate 2023-12-20T04:27:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether stripping libraries is possible... yes 2023-12-20T04:27:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:checking if libtool supports shared libraries... yes 2023-12-20T04:27:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether to build shared libraries... yes 2023-12-20T04:27:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether to build static libraries... yes 2023-12-20T04:27:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... (cached) gcc 2023-12-20T04:27:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-20T04:27:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-20T04:27:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-20T04:27:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... (cached) gcc 2023-12-20T04:27:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-20T04:27:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-20T04:27:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-20T04:27:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... (cached) gcc 2023-12-20T04:27:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-20T04:27:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-20T04:27:07.928 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-20T04:27:07.929 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gmake... /bin/gmake 2023-12-20T04:27:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:checking for tar... /bin/tar 2023-12-20T04:27:07.930 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gzip... /bin/gzip 2023-12-20T04:27:07.958 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc -MM is supported... yes 2023-12-20T04:27:07.959 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sort... /bin/sort 2023-12-20T04:27:07.959 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether ln -s works... yes 2023-12-20T04:27:07.960 INFO:teuthology.orchestra.run.smithi081.stdout:checking for msgfmt... /bin/msgfmt 2023-12-20T04:27:07.961 INFO:teuthology.orchestra.run.smithi081.stdout:checking for msgmerge... /bin/msgmerge 2023-12-20T04:27:07.961 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xgettext... /bin/xgettext 2023-12-20T04:27:07.962 INFO:teuthology.orchestra.run.smithi081.stdout:checking for rpm... /bin/rpm 2023-12-20T04:27:07.973 INFO:teuthology.orchestra.run.smithi081.stdout:checking for rpmbuild... no 2023-12-20T04:27:08.039 INFO:teuthology.orchestra.run.smithi081.stdout:checking ini.h usability... yes 2023-12-20T04:27:08.068 INFO:teuthology.orchestra.run.smithi081.stdout:checking ini.h presence... yes 2023-12-20T04:27:08.068 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ini.h... yes 2023-12-20T04:27:08.153 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ini_parse in -linih... yes 2023-12-20T04:27:08.223 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid.h usability... no 2023-12-20T04:27:08.263 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid.h presence... no 2023-12-20T04:27:08.263 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid.h... no 2023-12-20T04:27:08.334 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/uuid.h usability... no 2023-12-20T04:27:08.377 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/uuid.h presence... no 2023-12-20T04:27:08.377 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/uuid.h... no 2023-12-20T04:27:08.445 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid/uuid.h usability... yes 2023-12-20T04:27:08.475 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid/uuid.h presence... yes 2023-12-20T04:27:08.475 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid/uuid.h... yes 2023-12-20T04:27:08.578 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid_compare... no 2023-12-20T04:27:08.658 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid_compare in -luuid... yes 2023-12-20T04:27:08.722 INFO:teuthology.orchestra.run.smithi081.stdout:checking pthread.h usability... yes 2023-12-20T04:27:08.755 INFO:teuthology.orchestra.run.smithi081.stdout:checking pthread.h presence... yes 2023-12-20T04:27:08.755 INFO:teuthology.orchestra.run.smithi081.stdout:checking for pthread.h... yes 2023-12-20T04:27:08.841 INFO:teuthology.orchestra.run.smithi081.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-12-20T04:27:08.912 INFO:teuthology.orchestra.run.smithi081.stdout:checking urcu.h usability... yes 2023-12-20T04:27:08.953 INFO:teuthology.orchestra.run.smithi081.stdout:checking urcu.h presence... yes 2023-12-20T04:27:08.953 INFO:teuthology.orchestra.run.smithi081.stdout:checking for urcu.h... yes 2023-12-20T04:27:09.016 INFO:teuthology.orchestra.run.smithi081.stdout:checking for liburcu... yes 2023-12-20T04:27:09.073 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fadvise ... yes 2023-12-20T04:27:09.126 INFO:teuthology.orchestra.run.smithi081.stdout:checking for madvise ... yes 2023-12-20T04:27:09.178 INFO:teuthology.orchestra.run.smithi081.stdout:checking for mincore ... yes 2023-12-20T04:27:09.244 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sendfile ... yes 2023-12-20T04:27:09.298 INFO:teuthology.orchestra.run.smithi081.stdout:checking for getmntent ... yes 2023-12-20T04:27:09.382 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fallocate... yes 2023-12-20T04:27:09.466 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fiemap... yes 2023-12-20T04:27:09.551 INFO:teuthology.orchestra.run.smithi081.stdout:checking for pwritev2... yes 2023-12-20T04:27:09.635 INFO:teuthology.orchestra.run.smithi081.stdout:checking for preadv... yes 2023-12-20T04:27:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:checking for copy_file_range... yes 2023-12-20T04:27:09.805 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sync_file_range... yes 2023-12-20T04:27:09.889 INFO:teuthology.orchestra.run.smithi081.stdout:checking for syncfs... yes 2023-12-20T04:27:09.951 INFO:teuthology.orchestra.run.smithi081.stdout:checking mntent.h usability... yes 2023-12-20T04:27:09.979 INFO:teuthology.orchestra.run.smithi081.stdout:checking mntent.h presence... yes 2023-12-20T04:27:09.979 INFO:teuthology.orchestra.run.smithi081.stdout:checking for mntent.h... yes 2023-12-20T04:27:10.044 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether fls is declared... no 2023-12-20T04:27:10.121 INFO:teuthology.orchestra.run.smithi081.stdout:checking for readdir... yes 2023-12-20T04:27:10.188 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether fsetxattr is declared... yes 2023-12-20T04:27:10.253 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether mremap is declared... yes 2023-12-20T04:27:10.350 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct fsxattr... yes 2023-12-20T04:27:10.403 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-12-20T04:27:10.495 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct fscrypt_add_key_arg... yes 2023-12-20T04:27:10.546 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-12-20T04:27:10.638 INFO:teuthology.orchestra.run.smithi081.stdout:checking for GETFSMAP... yes 2023-12-20T04:27:10.740 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct statfs... yes 2023-12-20T04:27:10.794 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct statfs.f_flags... yes 2023-12-20T04:27:10.842 INFO:teuthology.orchestra.run.smithi081.stdout:checking for MAP_SYNC... yes 2023-12-20T04:27:11.024 INFO:teuthology.orchestra.run.smithi081.stdout:checking for library containing dm_task_create... -ldevmapper 2023-12-20T04:27:11.082 INFO:teuthology.orchestra.run.smithi081.stdout:checking for mallinfo ... yes 2023-12-20T04:27:11.134 INFO:teuthology.orchestra.run.smithi081.stdout:checking for mallinfo2 ... yes 2023-12-20T04:27:11.191 INFO:teuthology.orchestra.run.smithi081.stdout:checking attr/attributes.h usability... yes 2023-12-20T04:27:11.218 INFO:teuthology.orchestra.run.smithi081.stdout:checking attr/attributes.h presence... yes 2023-12-20T04:27:11.218 INFO:teuthology.orchestra.run.smithi081.stdout:checking for attr/attributes.h... yes 2023-12-20T04:27:11.271 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct attrlist_cursor... yes 2023-12-20T04:27:11.274 INFO:teuthology.orchestra.run.smithi081.stdout:checking for pkg-config... /bin/pkg-config 2023-12-20T04:27:11.292 INFO:teuthology.orchestra.run.smithi081.stdout:checking pkg-config is at least version 0.9.0... yes 2023-12-20T04:27:11.376 INFO:teuthology.orchestra.run.smithi081.stdout:checking for libicu... yes 2023-12-20T04:27:11.447 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether openat is declared... yes 2023-12-20T04:27:11.519 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether fstatat is declared... yes 2023-12-20T04:27:11.583 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct sg_io_hdr ... yes 2023-12-20T04:27:11.647 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct hd_geometry ... yes 2023-12-20T04:27:11.733 INFO:teuthology.orchestra.run.smithi081.stdout:checking for systemd... yes 2023-12-20T04:27:11.752 INFO:teuthology.orchestra.run.smithi081.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-12-20T04:27:11.753 INFO:teuthology.orchestra.run.smithi081.stdout:checking for system crontab dir... /etc/cron.d 2023-12-20T04:27:11.836 INFO:teuthology.orchestra.run.smithi081.stdout:checking for udev... yes 2023-12-20T04:27:11.856 INFO:teuthology.orchestra.run.smithi081.stdout:checking for udev rule dir... /usr/lib/udev/rules.d 2023-12-20T04:27:12.049 INFO:teuthology.orchestra.run.smithi081.stdout:checking for library containing blkid_probe_all... -lblkid 2023-12-20T04:27:12.140 INFO:teuthology.orchestra.run.smithi081.stdout:checking for blkid_probe_get_topology... yes 2023-12-20T04:27:12.256 INFO:teuthology.orchestra.run.smithi081.stdout:checking size of long... 8 2023-12-20T04:27:12.374 INFO:teuthology.orchestra.run.smithi081.stdout:checking size of char *... 8 2023-12-20T04:27:12.418 INFO:teuthology.orchestra.run.smithi081.stdout:checking for umode_t... no 2023-12-20T04:27:12.519 INFO:teuthology.orchestra.run.smithi081.stdout:checking for atomic64_t support in liburcu... yes 2023-12-20T04:27:12.562 INFO:teuthology.orchestra.run.smithi081.stdout:configure: creating ./config.status 2023-12-20T04:27:13.923 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: creating include/builddefs 2023-12-20T04:27:13.964 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: creating include/platform_defs.h 2023-12-20T04:27:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: executing libtool commands 2023-12-20T04:27:14.121 INFO:teuthology.orchestra.run.smithi081.stdout: [HEADERS] include 2023-12-20T04:27:14.146 INFO:teuthology.orchestra.run.smithi081.stdout: [HEADERS] libxfs 2023-12-20T04:27:14.188 INFO:teuthology.orchestra.run.smithi081.stdout:Building include 2023-12-20T04:27:14.203 INFO:teuthology.orchestra.run.smithi081.stdout: [LN] disk 2023-12-20T04:27:14.209 INFO:teuthology.orchestra.run.smithi081.stdout:Building libfrog 2023-12-20T04:27:14.219 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] gen_crc32table 2023-12-20T04:27:14.315 INFO:teuthology.orchestra.run.smithi081.stdout: [GENERATE] crc32table.h 2023-12-20T04:27:15.042 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] avl64.lo 2023-12-20T04:27:15.789 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bitmap.lo 2023-12-20T04:27:16.394 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat.lo 2023-12-20T04:27:17.032 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] convert.lo 2023-12-20T04:27:17.631 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] crc32.lo 2023-12-20T04:27:18.094 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsgeom.lo 2023-12-20T04:27:18.712 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] list_sort.lo 2023-12-20T04:27:19.225 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] linux.lo 2023-12-20T04:27:19.859 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] logging.lo 2023-12-20T04:27:20.249 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] paths.lo 2023-12-20T04:27:20.951 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] projects.lo 2023-12-20T04:27:21.516 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] ptvar.lo 2023-12-20T04:27:22.015 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] radix-tree.lo 2023-12-20T04:27:22.845 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] randbytes.lo 2023-12-20T04:27:23.315 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] scrub.lo 2023-12-20T04:27:23.745 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] util.lo 2023-12-20T04:27:24.221 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] workqueue.lo 2023-12-20T04:27:24.792 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] libfrog.la 2023-12-20T04:27:25.011 INFO:teuthology.orchestra.run.smithi081.stdout:Building libxfs 2023-12-20T04:27:27.396 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] cache.lo 2023-12-20T04:27:27.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:27:27.661 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:27:27.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:27:28.231 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] defer_item.lo 2023-12-20T04:27:28.919 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] init.lo 2023-12-20T04:27:29.894 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] kmem.lo 2023-12-20T04:27:30.446 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] logitem.lo 2023-12-20T04:27:31.007 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] rdwr.lo 2023-12-20T04:27:32.171 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] topology.lo 2023-12-20T04:27:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] trans.lo 2023-12-20T04:27:33.662 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] util.lo 2023-12-20T04:27:34.475 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_ag.lo 2023-12-20T04:27:35.568 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_ag_resv.lo 2023-12-20T04:27:36.164 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_alloc.lo 2023-12-20T04:27:37.926 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_alloc_btree.lo 2023-12-20T04:27:38.692 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_attr.lo 2023-12-20T04:27:39.652 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_attr_leaf.lo 2023-12-20T04:27:41.375 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_attr_remote.lo 2023-12-20T04:27:42.163 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_bit.lo 2023-12-20T04:27:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_bmap.lo 2023-12-20T04:27:45.840 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_bmap_btree.lo 2023-12-20T04:27:46.683 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_btree.lo 2023-12-20T04:27:49.175 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_btree_staging.lo 2023-12-20T04:27:49.922 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_da_btree.lo 2023-12-20T04:27:51.552 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_defer.lo 2023-12-20T04:27:52.320 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_dir2.lo 2023-12-20T04:27:53.139 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_dir2_block.lo 2023-12-20T04:27:54.326 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_dir2_data.lo 2023-12-20T04:27:55.429 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_dir2_leaf.lo 2023-12-20T04:27:56.689 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_dir2_node.lo 2023-12-20T04:27:57.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:27:57.781 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:27:57.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:27:58.060 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_dir2_sf.lo 2023-12-20T04:27:59.099 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_dquot_buf.lo 2023-12-20T04:27:59.745 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_ialloc.lo 2023-12-20T04:28:01.340 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_iext_tree.lo 2023-12-20T04:28:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_inode_buf.lo 2023-12-20T04:28:03.412 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_inode_fork.lo 2023-12-20T04:28:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_ialloc_btree.lo 2023-12-20T04:28:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_log_rlimit.lo 2023-12-20T04:28:05.764 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_refcount.lo 2023-12-20T04:28:06.958 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_refcount_btree.lo 2023-12-20T04:28:07.720 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_rmap.lo 2023-12-20T04:28:09.169 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_rmap_btree.lo 2023-12-20T04:28:09.998 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_rtbitmap.lo 2023-12-20T04:28:10.932 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_sb.lo 2023-12-20T04:28:12.032 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_symlink_remote.lo 2023-12-20T04:28:12.605 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_trans_inode.lo 2023-12-20T04:28:13.200 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_trans_resv.lo 2023-12-20T04:28:14.071 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_types.lo 2023-12-20T04:28:14.760 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] libxfs.la 2023-12-20T04:28:15.094 INFO:teuthology.orchestra.run.smithi081.stdout:Building libxlog 2023-12-20T04:28:15.221 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_log_recover.lo 2023-12-20T04:28:16.324 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] util.lo 2023-12-20T04:28:17.020 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] libxlog.la 2023-12-20T04:28:17.232 INFO:teuthology.orchestra.run.smithi081.stdout:Building libxcmd 2023-12-20T04:28:17.429 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] command.lo 2023-12-20T04:28:18.067 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] input.lo 2023-12-20T04:28:18.667 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] help.lo 2023-12-20T04:28:19.135 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] quit.lo 2023-12-20T04:28:19.615 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] libxcmd.la 2023-12-20T04:28:19.820 INFO:teuthology.orchestra.run.smithi081.stdout:Building libhandle 2023-12-20T04:28:19.929 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] handle.lo 2023-12-20T04:28:20.563 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] jdm.lo 2023-12-20T04:28:21.107 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] libhandle.la 2023-12-20T04:28:21.371 INFO:teuthology.orchestra.run.smithi081.stdout:Building copy 2023-12-20T04:28:21.449 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_copy.o 2023-12-20T04:28:21.945 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_copy 2023-12-20T04:28:22.178 INFO:teuthology.orchestra.run.smithi081.stdout:Building db 2023-12-20T04:28:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] addr.o 2023-12-20T04:28:25.251 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] agf.o 2023-12-20T04:28:25.396 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] agfl.o 2023-12-20T04:28:25.539 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] agi.o 2023-12-20T04:28:25.684 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attr.o 2023-12-20T04:28:25.943 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attrshort.o 2023-12-20T04:28:26.111 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bit.o 2023-12-20T04:28:26.282 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] block.o 2023-12-20T04:28:26.470 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bmap.o 2023-12-20T04:28:26.715 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] btblock.o 2023-12-20T04:28:26.895 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bmroot.o 2023-12-20T04:28:27.102 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] check.o 2023-12-20T04:28:27.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:28:27.928 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:28:27.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:28:29.000 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] command.o 2023-12-20T04:28:29.148 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] crc.o 2023-12-20T04:28:29.303 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] debug.o 2023-12-20T04:28:29.424 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dir2.o 2023-12-20T04:28:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dir2sf.o 2023-12-20T04:28:29.968 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dquot.o 2023-12-20T04:28:30.120 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] echo.o 2023-12-20T04:28:30.248 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] faddr.o 2023-12-20T04:28:30.479 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] field.o 2023-12-20T04:28:30.637 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] flist.o 2023-12-20T04:28:30.923 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fprint.o 2023-12-20T04:28:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] frag.o 2023-12-20T04:28:31.416 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] freesp.o 2023-12-20T04:28:31.661 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] hash.o 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c: In function ‘hash_f’: 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of ‘libxfs_da_hashname’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~^~~ 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr: | char * 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from ../include/libxfs.h:59, 2023-12-20T04:28:31.761 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.762 INFO:teuthology.orchestra.run.smithi081.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected ‘const uint8_t *’ {aka ‘const unsigned char *’} but argument is of type ‘char *’ 2023-12-20T04:28:31.762 INFO:teuthology.orchestra.run.smithi081.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-12-20T04:28:31.762 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-12-20T04:28:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c: In function ‘collide_dirents’: 2023-12-20T04:28:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of ‘openat’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.764 INFO:teuthology.orchestra.run.smithi081.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-12-20T04:28:31.764 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~ 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr: | const unsigned char * 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from /usr/include/features.h:490, 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr: from /usr/include/bits/libc-header-start.h:33, 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr: from /usr/include/stdio.h:27, 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/platform_defs.h:10, 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/libxfs.h:11, 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.765 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/fcntl.h:237:12: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: 237 | extern int __REDIRECT (openat, (int __fd, const char *__file, int __oflag, 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~~~~~~~ 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~~~~~~~ 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: | unsigned char * 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from ../include/platform_defs.h:17, 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/libxfs.h:11, 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/string.h:128:40: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-20T04:28:31.766 INFO:teuthology.orchestra.run.smithi081.stderr: 128 | extern char *strncpy (char *__restrict __dest, 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~^~~~~~ 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~ 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr: | const unsigned char * 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from ../include/platform_defs.h:17, 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/libxfs.h:11, 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.767 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/string.h:129:46: note: expected ‘const char * restrict’ but argument is of type ‘const unsigned char *’ 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: 129 | const char *__restrict __src, size_t __n) 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~^~~~~ 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~ 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: | const unsigned char * 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from ../include/platform_defs.h:19, 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/libxfs.h:11, 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/unistd.h:825:46: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.768 INFO:teuthology.orchestra.run.smithi081.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~~~~~~~ 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: | unsigned char * 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from ../include/platform_defs.h:19, 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/libxfs.h:11, 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/unistd.h:826:32: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: 826 | const char *__to, int __flags) 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~^~~~ 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c: In function ‘collide_xattrs’: 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~~~~~~ 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.769 INFO:teuthology.orchestra.run.smithi081.stderr: | unsigned char * 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from ../include/platform_defs.h:10, 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/libxfs.h:11, 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~~~~~~ 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: | unsigned char * 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from hash.c:16: 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-20T04:28:31.770 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~~~~~~ 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: | unsigned char * 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from ../include/platform_defs.h:10, 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: from ../include/libxfs.h:11, 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: from hash.c:7: 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-20T04:28:31.771 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~~~~~~~ 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: | unsigned char * 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:In file included from hash.c:16: 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c: In function ‘hashcoll_f’: 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~ 2023-12-20T04:28:31.772 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: | char * 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: 300 | const unsigned char *name, 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: | ^~~ 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: | char * 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: 234 | const unsigned char *name, 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.773 INFO:teuthology.orchestra.run.smithi081.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~^~~ 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | char * 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: 300 | const unsigned char *name, 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~^~~ 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | | 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | char * 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: 234 | const unsigned char *name, 2023-12-20T04:28:31.774 INFO:teuthology.orchestra.run.smithi081.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-20T04:28:31.878 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] help.o 2023-12-20T04:28:32.020 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] init.o 2023-12-20T04:28:32.192 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] inode.o 2023-12-20T04:28:32.532 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] input.o 2023-12-20T04:28:32.712 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] io.o 2023-12-20T04:28:32.954 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] logformat.o 2023-12-20T04:28:33.102 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] malloc.o 2023-12-20T04:28:33.237 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] metadump.o 2023-12-20T04:28:34.089 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] output.o 2023-12-20T04:28:34.221 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] print.o 2023-12-20T04:28:34.409 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] quit.o 2023-12-20T04:28:34.529 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] sb.o 2023-12-20T04:28:34.811 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] sig.o 2023-12-20T04:28:34.936 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] strvec.o 2023-12-20T04:28:35.073 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] text.o 2023-12-20T04:28:35.204 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] type.o 2023-12-20T04:28:35.370 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] write.o 2023-12-20T04:28:35.643 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attrset.o 2023-12-20T04:28:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] symlink.o 2023-12-20T04:28:35.954 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsmap.o 2023-12-20T04:28:36.124 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fuzz.o 2023-12-20T04:28:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] obfuscate.o 2023-12-20T04:28:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] btdump.o 2023-12-20T04:28:36.745 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] btheight.o 2023-12-20T04:28:36.956 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] convert.o 2023-12-20T04:28:37.145 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] info.o 2023-12-20T04:28:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] iunlink.o 2023-12-20T04:28:37.529 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] namei.o 2023-12-20T04:28:37.769 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] timelimit.o 2023-12-20T04:28:37.921 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_db 2023-12-20T04:28:38.258 INFO:teuthology.orchestra.run.smithi081.stdout:Building estimate 2023-12-20T04:28:38.334 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_estimate.o 2023-12-20T04:28:38.501 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_estimate 2023-12-20T04:28:38.605 INFO:teuthology.orchestra.run.smithi081.stdout:Building fsck 2023-12-20T04:28:38.614 INFO:teuthology.orchestra.run.smithi081.stdout:Building fsr 2023-12-20T04:28:38.693 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_fsr.o 2023-12-20T04:28:39.175 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_fsr 2023-12-20T04:28:39.363 INFO:teuthology.orchestra.run.smithi081.stdout:Building growfs 2023-12-20T04:28:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_growfs.o 2023-12-20T04:28:39.645 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_growfs 2023-12-20T04:28:39.900 INFO:teuthology.orchestra.run.smithi081.stdout:Building io 2023-12-20T04:28:41.873 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] init.o 2023-12-20T04:28:42.015 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attr.o 2023-12-20T04:28:42.191 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bmap.o 2023-12-20T04:28:42.403 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat.o 2023-12-20T04:28:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] crc32cselftest.o 2023-12-20T04:28:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] cowextsize.o 2023-12-20T04:28:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] encrypt.o 2023-12-20T04:28:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] file.o 2023-12-20T04:28:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] freeze.o 2023-12-20T04:28:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsuuid.o 2023-12-20T04:28:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsync.o 2023-12-20T04:28:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] getrusage.o 2023-12-20T04:28:43.689 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] imap.o 2023-12-20T04:28:43.803 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] inject.o 2023-12-20T04:28:43.926 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] label.o 2023-12-20T04:28:44.069 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] link.o 2023-12-20T04:28:44.176 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mmap.o 2023-12-20T04:28:44.414 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] open.o 2023-12-20T04:28:44.738 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] parent.o 2023-12-20T04:28:44.923 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] pread.o 2023-12-20T04:28:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] prealloc.o 2023-12-20T04:28:45.301 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] pwrite.o 2023-12-20T04:28:45.489 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] reflink.o 2023-12-20T04:28:45.646 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] resblks.o 2023-12-20T04:28:45.754 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] scrub.o 2023-12-20T04:28:45.911 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] seek.o 2023-12-20T04:28:46.046 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] shutdown.o 2023-12-20T04:28:46.155 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] stat.o 2023-12-20T04:28:46.391 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] swapext.o 2023-12-20T04:28:46.498 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] sync.o 2023-12-20T04:28:46.599 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] truncate.o 2023-12-20T04:28:46.699 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] utimes.o 2023-12-20T04:28:46.807 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fadvise.o 2023-12-20T04:28:46.922 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] madvise.o 2023-12-20T04:28:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mincore.o 2023-12-20T04:28:47.152 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] sendfile.o 2023-12-20T04:28:47.282 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fiemap.o 2023-12-20T04:28:47.459 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] copy_file_range.o 2023-12-20T04:28:47.586 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] sync_file_range.o 2023-12-20T04:28:47.700 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] readdir.o 2023-12-20T04:28:47.819 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] log_writes.o 2023-12-20T04:28:47.930 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsmap.o 2023-12-20T04:28:48.197 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_io 2023-12-20T04:28:48.466 INFO:teuthology.orchestra.run.smithi081.stdout:Building logprint 2023-12-20T04:28:48.871 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] logprint.o 2023-12-20T04:28:49.039 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] log_copy.o 2023-12-20T04:28:49.182 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] log_dump.o 2023-12-20T04:28:49.334 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] log_misc.o 2023-12-20T04:28:49.893 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] log_print_all.o 2023-12-20T04:28:50.176 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] log_print_trans.o 2023-12-20T04:28:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] log_redo.o 2023-12-20T04:28:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_logprint 2023-12-20T04:28:50.861 INFO:teuthology.orchestra.run.smithi081.stdout:Building mkfs 2023-12-20T04:28:50.987 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] proto.o 2023-12-20T04:28:51.307 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_mkfs.o 2023-12-20T04:28:52.070 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] mkfs.xfs 2023-12-20T04:28:52.333 INFO:teuthology.orchestra.run.smithi081.stdout:Building quota 2023-12-20T04:28:52.875 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] init.o 2023-12-20T04:28:53.001 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] util.o 2023-12-20T04:28:53.206 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] edit.o 2023-12-20T04:28:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] free.o 2023-12-20T04:28:53.609 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] linux.o 2023-12-20T04:28:53.707 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] path.o 2023-12-20T04:28:53.844 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] project.o 2023-12-20T04:28:54.015 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] quot.o 2023-12-20T04:28:54.202 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] quota.o 2023-12-20T04:28:54.404 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] report.o 2023-12-20T04:28:54.660 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] state.o 2023-12-20T04:28:54.863 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_quota 2023-12-20T04:28:55.062 INFO:teuthology.orchestra.run.smithi081.stdout:Building mdrestore 2023-12-20T04:28:55.138 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_mdrestore.o 2023-12-20T04:28:55.337 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_mdrestore 2023-12-20T04:28:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:Building repair 2023-12-20T04:28:57.458 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] agheader.o 2023-12-20T04:28:57.717 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] agbtree.o 2023-12-20T04:28:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attr_repair.o 2023-12-20T04:28:58.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:28:58.067 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:28:58.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:28:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] avl.o 2023-12-20T04:28:58.637 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkload.o 2023-12-20T04:28:58.791 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bmap.o 2023-12-20T04:28:58.963 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] btree.o 2023-12-20T04:28:59.351 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] da_util.o 2023-12-20T04:28:59.589 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dino_chunks.o 2023-12-20T04:29:00.018 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dinode.o 2023-12-20T04:29:00.786 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dir2.o 2023-12-20T04:29:01.227 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] globals.o 2023-12-20T04:29:01.342 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] incore_bmc.o 2023-12-20T04:29:01.464 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] incore.o 2023-12-20T04:29:01.642 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] incore_ext.o 2023-12-20T04:29:01.889 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] incore_ino.o 2023-12-20T04:29:02.201 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] init.o 2023-12-20T04:29:02.360 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase1.o 2023-12-20T04:29:02.516 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase2.o 2023-12-20T04:29:02.732 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase3.o 2023-12-20T04:29:02.900 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase4.o 2023-12-20T04:29:03.126 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase5.o 2023-12-20T04:29:03.435 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase6.o 2023-12-20T04:29:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase7.o 2023-12-20T04:29:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] prefetch.o 2023-12-20T04:29:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] progress.o 2023-12-20T04:29:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] quotacheck.o 2023-12-20T04:29:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] rmap.o 2023-12-20T04:29:05.770 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] rt.o 2023-12-20T04:29:05.958 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] sb.o 2023-12-20T04:29:06.203 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] scan.o 2023-12-20T04:29:07.002 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] slab.o 2023-12-20T04:29:07.205 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] threads.o 2023-12-20T04:29:07.338 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] versions.o 2023-12-20T04:29:07.491 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_repair.o 2023-12-20T04:29:07.836 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_repair 2023-12-20T04:29:08.176 INFO:teuthology.orchestra.run.smithi081.stdout:Building rtcp 2023-12-20T04:29:08.252 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_rtcp.o 2023-12-20T04:29:08.456 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_rtcp 2023-12-20T04:29:08.604 INFO:teuthology.orchestra.run.smithi081.stdout:Building m4 2023-12-20T04:29:08.615 INFO:teuthology.orchestra.run.smithi081.stdout:Building man 2023-12-20T04:29:08.629 INFO:teuthology.orchestra.run.smithi081.stdout:Building man2 2023-12-20T04:29:08.646 INFO:teuthology.orchestra.run.smithi081.stdout:Building man3 2023-12-20T04:29:08.661 INFO:teuthology.orchestra.run.smithi081.stdout:Building man5 2023-12-20T04:29:08.675 INFO:teuthology.orchestra.run.smithi081.stdout:Building man8 2023-12-20T04:29:08.703 INFO:teuthology.orchestra.run.smithi081.stdout: [SED] mkfs.xfs.8 2023-12-20T04:29:08.715 INFO:teuthology.orchestra.run.smithi081.stdout:Building doc 2023-12-20T04:29:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: [ZIP] CHANGES.gz 2023-12-20T04:29:08.748 INFO:teuthology.orchestra.run.smithi081.stdout:Building debian 2023-12-20T04:29:08.760 INFO:teuthology.orchestra.run.smithi081.stdout:Building spaceman 2023-12-20T04:29:09.161 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] info.o 2023-12-20T04:29:09.299 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] init.o 2023-12-20T04:29:09.451 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] file.o 2023-12-20T04:29:09.603 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] health.o 2023-12-20T04:29:09.802 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] prealloc.o 2023-12-20T04:29:09.943 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] trim.o 2023-12-20T04:29:10.097 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] freesp.o 2023-12-20T04:29:10.312 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_spaceman 2023-12-20T04:29:10.506 INFO:teuthology.orchestra.run.smithi081.stdout:Building scrub 2023-12-20T04:29:11.550 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] common.o 2023-12-20T04:29:11.719 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] counter.o 2023-12-20T04:29:11.813 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] descr.o 2023-12-20T04:29:11.926 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] disk.o 2023-12-20T04:29:12.075 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] filemap.o 2023-12-20T04:29:12.195 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fscounters.o 2023-12-20T04:29:12.323 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] inodes.o 2023-12-20T04:29:12.504 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase1.o 2023-12-20T04:29:12.641 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase2.o 2023-12-20T04:29:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase3.o 2023-12-20T04:29:12.921 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase4.o 2023-12-20T04:29:13.049 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase5.o 2023-12-20T04:29:13.228 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase6.o 2023-12-20T04:29:13.452 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] phase7.o 2023-12-20T04:29:13.600 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] progress.o 2023-12-20T04:29:13.732 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] read_verify.o 2023-12-20T04:29:13.887 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] repair.o 2023-12-20T04:29:14.044 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] scrub.o 2023-12-20T04:29:14.293 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] spacemap.o 2023-12-20T04:29:14.440 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] vfs.o 2023-12-20T04:29:14.591 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfs_scrub.o 2023-12-20T04:29:14.825 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] unicrash.o 2023-12-20T04:29:15.045 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] xfs_scrub 2023-12-20T04:29:15.432 INFO:teuthology.orchestra.run.smithi081.stdout: [SED] xfs_scrub_all 2023-12-20T04:29:15.444 INFO:teuthology.orchestra.run.smithi081.stdout: [SED] xfs_scrub@.service 2023-12-20T04:29:15.455 INFO:teuthology.orchestra.run.smithi081.stdout: [SED] xfs_scrub_all.service 2023-12-20T04:29:15.466 INFO:teuthology.orchestra.run.smithi081.stdout: [SED] xfs_scrub_fail@.service 2023-12-20T04:29:15.477 INFO:teuthology.orchestra.run.smithi081.stdout: [SED] xfs_scrub_all.cron 2023-12-20T04:29:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:Building po 2023-12-20T04:29:15.531 INFO:teuthology.orchestra.run.smithi081.stdout: [GETTXT] xfsprogs.pot 2023-12-20T04:29:15.797 INFO:teuthology.orchestra.run.smithi081.stdout: [MSGFMT] de.mo 2023-12-20T04:29:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2345 translated messages. 2023-12-20T04:29:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: [MSGFMT] pl.mo 2023-12-20T04:29:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:3104 translated messages. 2023-12-20T04:29:15.907 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[2]: Nothing to be done for 'include'. 2023-12-20T04:29:15.915 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.GopArGmA0Mxfsprogs-dev && exec sudo make install) 2023-12-20T04:29:16.023 INFO:teuthology.orchestra.run.smithi081.stdout:Installing libfrog-install 2023-12-20T04:29:16.668 INFO:teuthology.orchestra.run.smithi081.stdout:Installing libxfs-install 2023-12-20T04:29:19.052 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-20T04:29:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:Installing libxlog-install 2023-12-20T04:29:19.212 INFO:teuthology.orchestra.run.smithi081.stdout:Installing libxcmd-install 2023-12-20T04:29:19.390 INFO:teuthology.orchestra.run.smithi081.stdout:Installing libhandle-install 2023-12-20T04:29:19.489 INFO:teuthology.orchestra.run.smithi081.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-12-20T04:29:19.614 INFO:teuthology.orchestra.run.smithi081.stdout:Installing copy-install 2023-12-20T04:29:19.687 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:19.717 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-12-20T04:29:19.793 INFO:teuthology.orchestra.run.smithi081.stdout:Installing db-install 2023-12-20T04:29:22.686 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:22.721 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-12-20T04:29:22.803 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-12-20T04:29:22.837 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-12-20T04:29:22.869 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-12-20T04:29:22.905 INFO:teuthology.orchestra.run.smithi081.stdout:Installing estimate-install 2023-12-20T04:29:22.981 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:23.009 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-12-20T04:29:23.085 INFO:teuthology.orchestra.run.smithi081.stdout:Installing fsck-install 2023-12-20T04:29:23.089 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-20T04:29:23.124 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-12-20T04:29:23.158 INFO:teuthology.orchestra.run.smithi081.stdout:Installing fsr-install 2023-12-20T04:29:23.232 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:23.263 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-12-20T04:29:23.338 INFO:teuthology.orchestra.run.smithi081.stdout:Installing growfs-install 2023-12-20T04:29:23.411 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:23.443 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-12-20T04:29:23.523 INFO:teuthology.orchestra.run.smithi081.stdout:Installing io-install 2023-12-20T04:29:25.501 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:25.530 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-12-20T04:29:25.595 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-12-20T04:29:25.661 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-12-20T04:29:25.731 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-12-20T04:29:25.803 INFO:teuthology.orchestra.run.smithi081.stdout:Installing logprint-install 2023-12-20T04:29:26.179 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:26.213 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-12-20T04:29:26.294 INFO:teuthology.orchestra.run.smithi081.stdout:Installing mkfs-install 2023-12-20T04:29:26.418 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-20T04:29:26.451 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-12-20T04:29:26.530 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-12-20T04:29:26.575 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2023-12-20T04:29:26.674 INFO:teuthology.orchestra.run.smithi081.stdout:Installing quota-install 2023-12-20T04:29:27.188 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:27.221 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-12-20T04:29:27.295 INFO:teuthology.orchestra.run.smithi081.stdout:Installing mdrestore-install 2023-12-20T04:29:27.367 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:27.401 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-12-20T04:29:27.480 INFO:teuthology.orchestra.run.smithi081.stdout:Installing repair-install 2023-12-20T04:29:28.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:29:28.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:29:28.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:29:29.351 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-20T04:29:29.381 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-12-20T04:29:29.468 INFO:teuthology.orchestra.run.smithi081.stdout:Installing rtcp-install 2023-12-20T04:29:29.539 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:29.572 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-12-20T04:29:29.647 INFO:teuthology.orchestra.run.smithi081.stdout:Installing m4-install 2023-12-20T04:29:29.652 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-20T04:29:29.655 INFO:teuthology.orchestra.run.smithi081.stdout:Installing man-install 2023-12-20T04:29:29.666 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-20T04:29:29.674 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-20T04:29:29.685 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-12-20T04:29:29.728 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-12-20T04:29:29.766 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-12-20T04:29:29.805 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-12-20T04:29:29.853 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-12-20T04:29:29.895 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-12-20T04:29:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-20T04:29:29.974 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-12-20T04:29:30.015 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-12-20T04:29:30.056 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-12-20T04:29:30.099 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-12-20T04:29:30.141 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-12-20T04:29:30.184 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-12-20T04:29:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-12-20T04:29:30.263 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-12-20T04:29:30.303 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-12-20T04:29:30.345 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-12-20T04:29:30.387 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-12-20T04:29:30.430 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-12-20T04:29:30.471 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-12-20T04:29:30.514 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-12-20T04:29:30.558 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-12-20T04:29:30.599 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-12-20T04:29:30.641 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-12-20T04:29:30.683 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-12-20T04:29:30.725 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-12-20T04:29:30.767 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-12-20T04:29:30.808 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-12-20T04:29:30.851 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-20T04:29:30.889 INFO:teuthology.orchestra.run.smithi081.stdout:Installing doc-install 2023-12-20T04:29:30.894 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-20T04:29:30.926 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-12-20T04:29:30.973 INFO:teuthology.orchestra.run.smithi081.stdout:Installing debian-install 2023-12-20T04:29:30.977 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-20T04:29:30.980 INFO:teuthology.orchestra.run.smithi081.stdout:Installing spaceman-install 2023-12-20T04:29:31.378 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:31.412 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-12-20T04:29:31.485 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-12-20T04:29:31.521 INFO:teuthology.orchestra.run.smithi081.stdout:Installing scrub-install 2023-12-20T04:29:32.552 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-20T04:29:32.587 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-12-20T04:29:32.659 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-12-20T04:29:32.692 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-12-20T04:29:32.724 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-12-20T04:29:32.790 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-20T04:29:32.823 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-12-20T04:29:32.856 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-20T04:29:32.889 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-12-20T04:29:32.923 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/udev/rules.d 2023-12-20T04:29:32.956 INFO:teuthology.orchestra.run.smithi081.stdout:for i in xfs.rules; do \ 2023-12-20T04:29:32.957 INFO:teuthology.orchestra.run.smithi081.stdout: ../install-sh -o root -g root -m 644 $i /usr/lib/udev/rules.d/64-$i; \ 2023-12-20T04:29:32.957 INFO:teuthology.orchestra.run.smithi081.stdout:done 2023-12-20T04:29:32.996 INFO:teuthology.orchestra.run.smithi081.stdout:Installing po-install 2023-12-20T04:29:33.153 INFO:teuthology.orchestra.run.smithi081.stdout:Installing include-install 2023-12-20T04:29:33.158 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-20T04:29:33.190 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-20T04:29:33.224 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-12-20T04:29:33.263 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-12-20T04:29:33.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-20T04:29:33.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.379+0000 7fca80d63640 1 Processor -- start 2023-12-20T04:29:33.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.379+0000 7fca80d63640 1 -- start start 2023-12-20T04:29:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca80d63640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca7c070ff0 0x7fca7c142850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca80d63640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c0b4f90 0x7fca7c0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca80d63640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca7c142d90 0x7fca7c0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca80d63640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0b6d70 con 0x7fca7c142d90 2023-12-20T04:29:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca80d63640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0b56e0 con 0x7fca7c070ff0 2023-12-20T04:29:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca80d63640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0b59c0 con 0x7fca7c0b4f90 2023-12-20T04:29:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca7ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca7c142d90 0x7fca7c0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca7ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca7c142d90 0x7fca7c0b7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41198/0 (socket says 172.21.15.40:41198) 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.380+0000 7fca7ad9d640 1 -- 172.21.15.40:0/2988309889 learned_addr learned my addr 172.21.15.40:0/2988309889 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.381+0000 7fca79d9b640 1 --2- 172.21.15.40:0/2988309889 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c0b4f90 0x7fca7c0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.381+0000 7fca7a59c640 1 --2- 172.21.15.40:0/2988309889 >> v2:172.21.15.69:3300/0 conn(0x7fca7c070ff0 0x7fca7c142850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.381+0000 7fca7ad9d640 1 -- 172.21.15.40:0/2988309889 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c0b4f90 msgr2=0x7fca7c0b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.381+0000 7fca7ad9d640 1 --2- 172.21.15.40:0/2988309889 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c0b4f90 0x7fca7c0b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.381+0000 7fca7ad9d640 1 -- 172.21.15.40:0/2988309889 >> v2:172.21.15.69:3300/0 conn(0x7fca7c070ff0 msgr2=0x7fca7c142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.381+0000 7fca7ad9d640 1 --2- 172.21.15.40:0/2988309889 >> v2:172.21.15.69:3300/0 conn(0x7fca7c070ff0 0x7fca7c142850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.381+0000 7fca7ad9d640 1 -- 172.21.15.40:0/2988309889 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0b5ca0 con 0x7fca7c142d90 2023-12-20T04:29:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca7ad9d640 1 --2- 172.21.15.40:0/2988309889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c142d90 0x7fca7c0b7e00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fca7c070a50 tx=0x7fca6c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e2e87afe8f7e1f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:29:33.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca7959a640 1 -- 172.21.15.40:0/2988309889 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c02cb00 con 0x7fca7c142d90 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca7959a640 1 -- 172.21.15.40:0/2988309889 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c02cc60 con 0x7fca7c142d90 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca7959a640 1 -- 172.21.15.40:0/2988309889 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0343f0 con 0x7fca7c142d90 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 -- 172.21.15.40:0/2988309889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c142d90 msgr2=0x7fca7c0b7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 --2- 172.21.15.40:0/2988309889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c142d90 0x7fca7c0b7e00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fca7c070a50 tx=0x7fca6c02bf60 comp rx=0 tx=0).stop 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 -- 172.21.15.40:0/2988309889 shutdown_connections 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 --2- 172.21.15.40:0/2988309889 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c142d90 0x7fca7c0b7e00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 --2- 172.21.15.40:0/2988309889 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c0b4f90 0x7fca7c0b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 --2- 172.21.15.40:0/2988309889 >> v2:172.21.15.69:3300/0 conn(0x7fca7c070ff0 0x7fca7c142850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 -- 172.21.15.40:0/2988309889 >> 172.21.15.40:0/2988309889 conn(0x7fca7c0be120 msgr2=0x7fca7c0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 -- 172.21.15.40:0/2988309889 shutdown_connections 2023-12-20T04:29:33.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.382+0000 7fca80d63640 1 -- 172.21.15.40:0/2988309889 wait complete. 2023-12-20T04:29:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 Processor -- start 2023-12-20T04:29:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 -- start start 2023-12-20T04:29:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c070ff0 0x7fca7c0bd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c0b4f90 0x7fca7c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7c142d90 0x7fca7c14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0bdb90 con 0x7fca7c0b4f90 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c1d8190 con 0x7fca7c142d90 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca80d63640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c147d60 con 0x7fca7c070ff0 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca79d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c0b4f90 0x7fca7c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca79d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c0b4f90 0x7fca7c14c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41200/0 (socket says 172.21.15.40:41200) 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.384+0000 7fca79d9b640 1 -- 172.21.15.40:0/2640616801 learned_addr learned my addr 172.21.15.40:0/2640616801 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca7a59c640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c070ff0 0x7fca7c0bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca7ad9d640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7c142d90 0x7fca7c14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca79d9b640 1 -- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c070ff0 msgr2=0x7fca7c0bd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca79d9b640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c070ff0 0x7fca7c0bd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca79d9b640 1 -- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7c142d90 msgr2=0x7fca7c14c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca79d9b640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7c142d90 0x7fca7c14c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca79d9b640 1 -- 172.21.15.40:0/2640616801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c009b30 con 0x7fca7c0b4f90 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca79d9b640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c0b4f90 0x7fca7c14c360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fca7000e9b0 tx=0x7fca7000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca6affd640 1 -- 172.21.15.40:0/2640616801 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70009670 con 0x7fca7c0b4f90 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca6affd640 1 -- 172.21.15.40:0/2640616801 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7000c9a0 con 0x7fca7c0b4f90 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c148040 con 0x7fca7c0b4f90 2023-12-20T04:29:33.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca6affd640 1 -- 172.21.15.40:0/2640616801 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000cd50 con 0x7fca7c0b4f90 2023-12-20T04:29:33.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.385+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c148600 con 0x7fca7c0b4f90 2023-12-20T04:29:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.386+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c04e840 con 0x7fca7c0b4f90 2023-12-20T04:29:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.387+0000 7fca6affd640 1 -- 172.21.15.40:0/2640616801 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca70013470 con 0x7fca7c0b4f90 2023-12-20T04:29:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.387+0000 7fca6affd640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5c06a430 0x7fca5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.387+0000 7fca6affd640 1 -- 172.21.15.40:0/2640616801 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca70088af0 con 0x7fca7c0b4f90 2023-12-20T04:29:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.388+0000 7fca7a59c640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5c06a430 0x7fca5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.388+0000 7fca7a59c640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5c06a430 0x7fca5c06c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca74009ac0 tx=0x7fca74009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:29:33.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.392+0000 7fca6affd640 1 -- 172.21.15.40:0/2640616801 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fca70054190 con 0x7fca7c0b4f90 2023-12-20T04:29:33.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.639+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fca7c0b8260 con 0x7fca7c0b4f90 2023-12-20T04:29:33.641 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.639+0000 7fca6affd640 1 -- 172.21.15.40:0/2640616801 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7fca70021510 con 0x7fca7c0b4f90 2023-12-20T04:29:33.641 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T04:29:33.641 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","modified":"2023-12-20T04:22:28.206702Z","created":"2023-12-20T04:22:28.206702Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3301","nonce":0},{"type":"v1","addr":"172.21.15.69:6790","nonce":0}]},"addr":"172.21.15.69:6790/0","public_addr":"172.21.15.69:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-20T04:29:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 1 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5c06a430 msgr2=0x7fca5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5c06a430 0x7fca5c06c8f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fca74009ac0 tx=0x7fca74009190 comp rx=0 tx=0).stop 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c0b4f90 msgr2=0x7fca7c14c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c0b4f90 0x7fca7c14c360 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fca7000e9b0 tx=0x7fca7000ee70 comp rx=0 tx=0).stop 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 shutdown_connections 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fca5c06a430 0x7fca5c06c8f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca7c142d90 0x7fca7c14c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca7c0b4f90 0x7fca7c14c360 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 --2- 172.21.15.40:0/2640616801 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fca7c070ff0 0x7fca7c0bd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 >> 172.21.15.40:0/2640616801 conn(0x7fca7c0be120 msgr2=0x7fca7c141740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:29:33.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 shutdown_connections 2023-12-20T04:29:33.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.641+0000 7fca80d63640 1 -- 172.21.15.40:0/2640616801 wait complete. 2023-12-20T04:29:33.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-20T04:29:33.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b715c640 1 Processor -- start 2023-12-20T04:29:33.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b715c640 1 -- start start 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b715c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b00bcdd0 0x7fb9b00b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b715c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9b0144ea0 0x7fb9b0155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b715c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b00bc6b0 con 0x7fb9b00b64c0 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b715c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b00b6900 con 0x7fb9b0144ea0 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b715c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b00a59f0 con 0x7fb9b00bcdd0 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9b56f9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9b0144ea0 0x7fb9b0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9affff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb9b00b64c0 0x7fb9b0144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53026/0 (socket says 172.21.15.40:53026) 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.760+0000 7fb9affff640 1 -- 172.21.15.40:0/3115754977 learned_addr learned my addr 172.21.15.40:0/3115754977 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.761+0000 7fb9b4ef8640 1 --2- 172.21.15.40:0/3115754977 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b00bcdd0 0x7fb9b00b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.761+0000 7fb9b56f9640 1 -- 172.21.15.40:0/3115754977 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b00bcdd0 msgr2=0x7fb9b00b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.761+0000 7fb9b56f9640 1 --2- 172.21.15.40:0/3115754977 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b00bcdd0 0x7fb9b00b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.761+0000 7fb9b56f9640 1 -- 172.21.15.40:0/3115754977 >> v1:172.21.15.40:6789/0 conn(0x7fb9b00b64c0 legacy=0x7fb9b0144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.761+0000 7fb9b56f9640 1 -- 172.21.15.40:0/3115754977 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b00bc0a0 con 0x7fb9b0144ea0 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.761+0000 7fb9af7fe640 1 -- 172.21.15.40:0/3115754977 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701184115 0 0) 0x7fb9b00bc6b0 con 0x7fb9b00b64c0 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.761+0000 7fb9b4ef8640 1 --2- 172.21.15.40:0/3115754977 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b00bcdd0 0x7fb9b00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b56f9640 1 --2- 172.21.15.40:0/3115754977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b0144ea0 0x7fb9b0155340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009d90 tx=0x7fb9a802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d1f47abece01c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9af7fe640 1 -- 172.21.15.40:0/3115754977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a802cce0 con 0x7fb9b0144ea0 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9af7fe640 1 -- 172.21.15.40:0/3115754977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a802ce40 con 0x7fb9b0144ea0 2023-12-20T04:29:33.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9af7fe640 1 -- 172.21.15.40:0/3115754977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a8034660 con 0x7fb9b0144ea0 2023-12-20T04:29:33.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 -- 172.21.15.40:0/3115754977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b0144ea0 msgr2=0x7fb9b0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 --2- 172.21.15.40:0/3115754977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b0144ea0 0x7fb9b0155340 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009d90 tx=0x7fb9a802bf30 comp rx=0 tx=0).stop 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 -- 172.21.15.40:0/3115754977 shutdown_connections 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 --2- 172.21.15.40:0/3115754977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b0144ea0 0x7fb9b0155340 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 --2- 172.21.15.40:0/3115754977 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b00bcdd0 0x7fb9b00b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 -- 172.21.15.40:0/3115754977 >> 172.21.15.40:0/3115754977 conn(0x7fb9b0071e60 msgr2=0x7fb9b00c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 -- 172.21.15.40:0/3115754977 shutdown_connections 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.762+0000 7fb9b715c640 1 -- 172.21.15.40:0/3115754977 wait complete. 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.763+0000 7fb9b715c640 1 Processor -- start 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.763+0000 7fb9b715c640 1 -- start start 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b715c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b00b64c0 0x7fb9b01455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b715c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9b00bcdd0 0x7fb9b013e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b715c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b0144ea0 0x7fb9b01dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b715c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b00a56a0 con 0x7fb9b00b64c0 2023-12-20T04:29:33.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b715c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0145ae0 con 0x7fb9b00bcdd0 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b715c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01d3d30 con 0x7fb9b0144ea0 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b4ef8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b00b64c0 0x7fb9b01455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b4ef8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b00b64c0 0x7fb9b01455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41230/0 (socket says 172.21.15.40:41230) 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b4ef8640 1 -- 172.21.15.40:0/898588561 learned_addr learned my addr 172.21.15.40:0/898588561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9affff640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9b00bcdd0 0x7fb9b013e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b56f9640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b0144ea0 0x7fb9b01dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.764+0000 7fb9b4ef8640 1 -- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b0144ea0 msgr2=0x7fb9b01dfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b4ef8640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b0144ea0 0x7fb9b01dfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b4ef8640 1 -- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9b00bcdd0 msgr2=0x7fb9b013e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b4ef8640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9b00bcdd0 0x7fb9b013e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b4ef8640 1 -- 172.21.15.40:0/898588561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8009a70 con 0x7fb9b00b64c0 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9affff640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9b00bcdd0 0x7fb9b013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b56f9640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b0144ea0 0x7fb9b01dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b4ef8640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b00b64c0 0x7fb9b01455a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e760 tx=0x7fb9a400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:29:33.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9ad7fa640 1 -- 172.21.15.40:0/898588561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4004230 con 0x7fb9b00b64c0 2023-12-20T04:29:33.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9ad7fa640 1 -- 172.21.15.40:0/898588561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4004390 con 0x7fb9b00b64c0 2023-12-20T04:29:33.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b01d3490 con 0x7fb9b00b64c0 2023-12-20T04:29:33.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9ad7fa640 1 -- 172.21.15.40:0/898588561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a400c8f0 con 0x7fb9b00b64c0 2023-12-20T04:29:33.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.765+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b01d3a50 con 0x7fb9b00b64c0 2023-12-20T04:29:33.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.766+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b01dfb00 con 0x7fb9b00b64c0 2023-12-20T04:29:33.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.766+0000 7fb9ad7fa640 1 -- 172.21.15.40:0/898588561 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9a400ca50 con 0x7fb9b00b64c0 2023-12-20T04:29:33.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.767+0000 7fb9ad7fa640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb99406a460 0x7fb99406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:29:33.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.767+0000 7fb9ad7fa640 1 -- 172.21.15.40:0/898588561 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9a40884d0 con 0x7fb9b00b64c0 2023-12-20T04:29:33.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.767+0000 7fb9affff640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb99406a460 0x7fb99406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:29:33.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.767+0000 7fb9affff640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb99406a460 0x7fb99406c920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00b8320 tx=0x7fb99c007cc0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:29:33.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:33.771+0000 7fb9ad7fa640 1 -- 172.21.15.40:0/898588561 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb9a4053ac0 con 0x7fb9b00b64c0 2023-12-20T04:29:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.018+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fb9b004e840 con 0x7fb9b00b64c0 2023-12-20T04:29:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.018+0000 7fb9ad7fa640 1 -- 172.21.15.40:0/898588561 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7fb9a40570e0 con 0x7fb9b00b64c0 2023-12-20T04:29:34.021 INFO:teuthology.orchestra.run.smithi040.stdout:[client.admin] 2023-12-20T04:29:34.022 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAEbIJl4UNQIBAAiKmukv4UdnsKSNal0x9M9Q== 2023-12-20T04:29:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb99406a460 msgr2=0x7fb99406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb99406a460 0x7fb99406c920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9b00b8320 tx=0x7fb99c007cc0 comp rx=0 tx=0).stop 2023-12-20T04:29:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b00b64c0 msgr2=0x7fb9b01455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:29:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b00b64c0 0x7fb9b01455a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400e760 tx=0x7fb9a400ec20 comp rx=0 tx=0).stop 2023-12-20T04:29:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 shutdown_connections 2023-12-20T04:29:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb99406a460 0x7fb99406c920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb9b0144ea0 0x7fb9b01dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9b00bcdd0 0x7fb9b013e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 --2- 172.21.15.40:0/898588561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9b00b64c0 0x7fb9b01455a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:29:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 >> 172.21.15.40:0/898588561 conn(0x7fb9b0071e60 msgr2=0x7fb9b00b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:29:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 shutdown_connections 2023-12-20T04:29:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T04:29:34.020+0000 7fb9b715c640 1 -- 172.21.15.40:0/898588561 wait complete. 2023-12-20T04:29:34.032 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T04:29:34.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/tmp/tmp.utfXGGFva6xfstests-dev/local.config 2023-12-20T04:29:34.137 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.40:6789:/test export TEST_DIR=/tmp/tmp.ZcYVmbFZ9Btest export SCRATCH_DEV=172.21.15.40:6789:/scratch export SCRATCH_MNT=/tmp/tmp.a4FpERTltXscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAEbIJl4UNQIBAAiKmukv4UdnsKSNal0x9M9Q==,test_dummy_encryption" 2023-12-20T04:29:34.137 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-12-20T04:29:34.137 DEBUG:teuthology.orchestra.run.smithi081:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.utfXGGFva6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-12-20T04:29:36.811 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2023-12-20T04:29:36.826 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 6.6.0-g93572f31db89 #1 SMP PREEMPT_DYNAMIC Wed Dec 20 01:28:06 UTC 2023 2023-12-20T04:29:36.829 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-12-20T04:29:36.831 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAEbIJl4UNQIBAAiKmukv4UdnsKSNal0x9M9Q==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.a4FpERTltXscratch 2023-12-20T04:29:36.831 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T04:29:37.037 INFO:teuthology.orchestra.run.smithi081.stdout:ceph/001 [expunged] 2023-12-20T04:29:37.571 INFO:teuthology.orchestra.run.smithi081.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T04:29:38.084 INFO:teuthology.orchestra.run.smithi081.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T04:29:38.709 INFO:teuthology.orchestra.run.smithi081.stdout:ceph/004 0s 2023-12-20T04:29:39.147 INFO:teuthology.orchestra.run.smithi081.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T04:29:49.388 INFO:teuthology.orchestra.run.smithi081.stdout:generic/001 10s 2023-12-20T04:29:50.281 INFO:teuthology.orchestra.run.smithi081.stdout:generic/002 1s 2023-12-20T04:29:50.731 INFO:teuthology.orchestra.run.smithi081.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-20T04:29:51.172 INFO:teuthology.orchestra.run.smithi081.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-20T04:29:51.975 INFO:teuthology.orchestra.run.smithi081.stdout:generic/005 0s 2023-12-20T04:29:58.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:29:58.334 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:29:58.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:30:14.379 INFO:teuthology.orchestra.run.smithi081.stdout:generic/006 23s 2023-12-20T04:30:28.459 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:30:28.462 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:30:28.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:30:58.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:30:58.611 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:30:58.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:31:02.453 INFO:teuthology.orchestra.run.smithi081.stdout:generic/007 48s 2023-12-20T04:31:04.570 INFO:teuthology.orchestra.run.smithi081.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-20T04:31:06.719 INFO:teuthology.orchestra.run.smithi081.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-20T04:31:28.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:31:28.749 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:31:28.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:31:35.041 INFO:teuthology.orchestra.run.smithi081.stdout:generic/011 29s 2023-12-20T04:31:37.773 INFO:teuthology.orchestra.run.smithi081.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:31:59.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:31:59.088 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:31:59.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:32:14.210 INFO:teuthology.orchestra.run.smithi081.stdout:generic/013 37s 2023-12-20T04:32:29.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:32:29.317 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:32:29.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:32:59.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:32:59.567 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:32:59.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:33:29.835 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:33:29.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:33:29.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:33:29.898 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-20T04:33:29.897+0000 7f2c24931640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101473) UID: 0 2023-12-20T04:33:29.899 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-20T04:33:29.897+0000 7fe2f95e5640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101473) UID: 0 2023-12-20T04:34:39.120 INFO:teuthology.orchestra.run.smithi081.stdout:generic/014 145s 2023-12-20T04:34:39.557 INFO:teuthology.orchestra.run.smithi081.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-20T04:34:44.697 INFO:teuthology.orchestra.run.smithi081.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:34:45.270 INFO:teuthology.orchestra.run.smithi081.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-20T04:34:53.998 INFO:teuthology.orchestra.run.smithi081.stdout:generic/020 8s 2023-12-20T04:34:57.260 INFO:teuthology.orchestra.run.smithi081.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:35:03.461 INFO:teuthology.orchestra.run.smithi081.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:35:05.383 INFO:teuthology.orchestra.run.smithi081.stdout:generic/023 2s 2023-12-20T04:35:05.837 INFO:teuthology.orchestra.run.smithi081.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-20T04:35:06.329 INFO:teuthology.orchestra.run.smithi081.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-20T04:35:06.848 INFO:teuthology.orchestra.run.smithi081.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-20T04:35:12.321 INFO:teuthology.orchestra.run.smithi081.stdout:generic/028 6s 2023-12-20T04:35:13.574 INFO:teuthology.orchestra.run.smithi081.stdout:generic/029 1s 2023-12-20T04:35:18.580 INFO:teuthology.orchestra.run.smithi081.stdout:generic/030 5s 2023-12-20T04:35:23.293 INFO:teuthology.orchestra.run.smithi081.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-20T04:35:23.772 INFO:teuthology.orchestra.run.smithi081.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T04:35:27.927 INFO:teuthology.orchestra.run.smithi081.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-20T04:35:28.441 INFO:teuthology.orchestra.run.smithi081.stdout:generic/034 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:35:29.034 INFO:teuthology.orchestra.run.smithi081.stdout:generic/035 1s 2023-12-20T04:35:36.394 INFO:teuthology.orchestra.run.smithi081.stdout:generic/037 7s 2023-12-20T04:35:36.939 INFO:teuthology.orchestra.run.smithi081.stdout:generic/039 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:35:37.458 INFO:teuthology.orchestra.run.smithi081.stdout:generic/040 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:35:37.964 INFO:teuthology.orchestra.run.smithi081.stdout:generic/041 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:35:38.619 INFO:teuthology.orchestra.run.smithi081.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-20T04:35:39.228 INFO:teuthology.orchestra.run.smithi081.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-20T04:35:39.824 INFO:teuthology.orchestra.run.smithi081.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-20T04:35:40.998 INFO:teuthology.orchestra.run.smithi081.stdout:generic/053 1s 2023-12-20T04:35:41.538 INFO:teuthology.orchestra.run.smithi081.stdout:generic/056 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:35:42.054 INFO:teuthology.orchestra.run.smithi081.stdout:generic/057 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:35:46.182 INFO:teuthology.orchestra.run.smithi081.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:35:46.690 INFO:teuthology.orchestra.run.smithi081.stdout:generic/059 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:35:52.687 INFO:teuthology.orchestra.run.smithi081.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:35:58.546 INFO:teuthology.orchestra.run.smithi081.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:36:01.070 INFO:teuthology.orchestra.run.smithi081.stdout:generic/062 3s 2023-12-20T04:36:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T04:36:07.897 INFO:teuthology.orchestra.run.smithi081.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-20T04:36:08.413 INFO:teuthology.orchestra.run.smithi081.stdout:generic/065 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:36:08.900 INFO:teuthology.orchestra.run.smithi081.stdout:generic/066 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:36:09.431 INFO:teuthology.orchestra.run.smithi081.stdout:generic/067 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:36:20.592 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:36:20.596 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:36:20.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:36:30.649 INFO:teuthology.orchestra.run.smithi081.stdout:generic/069 21s 2023-12-20T04:36:44.019 INFO:teuthology.orchestra.run.smithi081.stdout:generic/070 14s 2023-12-20T04:36:44.506 INFO:teuthology.orchestra.run.smithi081.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-20T04:36:44.981 INFO:teuthology.orchestra.run.smithi081.stdout:generic/073 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:36:50.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:36:50.727 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:36:50.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:37:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:generic/075 22s 2023-12-20T04:37:08.310 INFO:teuthology.orchestra.run.smithi081.stdout:generic/076 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-20T04:37:08.775 INFO:teuthology.orchestra.run.smithi081.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-20T04:37:09.241 INFO:teuthology.orchestra.run.smithi081.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-20T04:37:11.767 INFO:teuthology.orchestra.run.smithi081.stdout:generic/080 2s 2023-12-20T04:37:12.261 INFO:teuthology.orchestra.run.smithi081.stdout:generic/081 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:37:12.772 INFO:teuthology.orchestra.run.smithi081.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T04:37:18.845 INFO:teuthology.orchestra.run.smithi081.stdout:generic/084 6s 2023-12-20T04:37:19.396 INFO:teuthology.orchestra.run.smithi081.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T04:37:20.010 INFO:teuthology.orchestra.run.smithi081.stdout:generic/087 0s 2023-12-20T04:37:20.511 INFO:teuthology.orchestra.run.smithi081.stdout:generic/088 0s 2023-12-20T04:37:20.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:37:20.869 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:37:20.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:37:20.974 INFO:teuthology.orchestra.run.smithi081.stdout:generic/090 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:37:51.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:37:51.039 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:37:51.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:38:21.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:38:21.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:38:21.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:38:26.518 INFO:teuthology.orchestra.run.smithi081.stdout:generic/091 66s 2023-12-20T04:38:26.999 INFO:teuthology.orchestra.run.smithi081.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T04:38:27.517 INFO:teuthology.orchestra.run.smithi081.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-20T04:38:34.775 INFO:teuthology.orchestra.run.smithi081.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-20T04:38:35.615 INFO:teuthology.orchestra.run.smithi081.stdout:generic/097 1s 2023-12-20T04:38:36.911 INFO:teuthology.orchestra.run.smithi081.stdout:generic/098 1s 2023-12-20T04:38:38.524 INFO:teuthology.orchestra.run.smithi081.stdout:generic/099 2s 2023-12-20T04:38:39.028 INFO:teuthology.orchestra.run.smithi081.stdout:generic/101 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:38:39.509 INFO:teuthology.orchestra.run.smithi081.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T04:38:40.034 INFO:teuthology.orchestra.run.smithi081.stdout:generic/104 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:38:40.976 INFO:teuthology.orchestra.run.smithi081.stdout:generic/105 0s 2023-12-20T04:38:41.549 INFO:teuthology.orchestra.run.smithi081.stdout:generic/106 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:38:42.039 INFO:teuthology.orchestra.run.smithi081.stdout:generic/107 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:38:42.664 INFO:teuthology.orchestra.run.smithi081.stdout:generic/108 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T04:38:43.202 INFO:teuthology.orchestra.run.smithi081.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T04:38:43.725 INFO:teuthology.orchestra.run.smithi081.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T04:38:51.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:38:51.327 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:38:51.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:39:09.330 INFO:teuthology.orchestra.run.smithi081.stdout:generic/112 26s 2023-12-20T04:39:21.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:39:21.470 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:39:21.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:39:51.760 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:39:51.764 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:39:51.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:40:22.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:40:22.095 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:40:22.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:40:52.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:40:52.332 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:40:52.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:41:02.654 INFO:teuthology.orchestra.run.smithi081.stdout:generic/113 113s 2023-12-20T04:41:03.163 INFO:teuthology.orchestra.run.smithi081.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-20T04:41:03.657 INFO:teuthology.orchestra.run.smithi081.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T04:41:04.203 INFO:teuthology.orchestra.run.smithi081.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T04:41:11.039 INFO:teuthology.orchestra.run.smithi081.stdout:generic/117 7s 2023-12-20T04:41:11.601 INFO:teuthology.orchestra.run.smithi081.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T04:41:12.103 INFO:teuthology.orchestra.run.smithi081.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T04:41:12.585 INFO:teuthology.orchestra.run.smithi081.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-20T04:41:13.092 INFO:teuthology.orchestra.run.smithi081.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T04:41:13.626 INFO:teuthology.orchestra.run.smithi081.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T04:41:14.807 INFO:teuthology.orchestra.run.smithi081.stdout:generic/123 1s 2023-12-20T04:41:22.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:41:22.654 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:41:22.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:41:46.395 INFO:teuthology.orchestra.run.smithi081.stdout:generic/124 32s 2023-12-20T04:41:47.229 INFO:teuthology.orchestra.run.smithi081.stdout:generic/126 1s 2023-12-20T04:41:52.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:41:52.790 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:41:52.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:41:58.019 INFO:teuthology.orchestra.run.smithi081.stdout:generic/128 11s 2023-12-20T04:42:22.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:22.968 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:22.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:53.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:53.114 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:53.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:23.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:23.251 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:23.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:53.389 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:53.393 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:53.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:23.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:23.521 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:23.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:53.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:53.685 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:53.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:23.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:23.824 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:23.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:53.968 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:53.971 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:53.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:24.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:24.130 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:24.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:54.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:54.320 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:54.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:24.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:24.481 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:24.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:54.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:54.618 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:54.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:24.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:24.757 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:24.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:55.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:55.111 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:55.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:25.256 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:25.259 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:25.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:55.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:55.407 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:55.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:25.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:25.572 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:25.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:55.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:55.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:55.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:25.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:25.897 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:25.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:56.041 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:56.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:56.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:26.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:26.218 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:26.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:56.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:56.372 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:56.374 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:26.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:26.571 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:26.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:56.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:56.741 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:56.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:26.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:27.004 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:27.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:57.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:57.253 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:57.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:55:27.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:55:27.398 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:55:27.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:55:57.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:55:57.578 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:55:57.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:56:27.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:56:27.800 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:56:27.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:56:57.946 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:56:57.951 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:56:57.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:57:28.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:57:28.127 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:57:28.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:57:58.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:57:58.350 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:57:58.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:58:28.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:58:28.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:58:28.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:58:58.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:58:58.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:58:58.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:59:28.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:59:28.980 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:59:28.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:59:59.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:59:59.320 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:59:59.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:00:29.521 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:00:29.525 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:00:29.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:00:59.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:00:59.737 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:00:59.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:01:30.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:01:30.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:01:30.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:02:00.278 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:02:00.281 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:02:00.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:02:30.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:02:30.497 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:02:30.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:02:52.102 INFO:teuthology.orchestra.run.smithi081.stdout:generic/129 1254s 2023-12-20T05:03:00.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:03:00.644 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:03:00.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:03:07.335 INFO:teuthology.orchestra.run.smithi081.stdout:generic/130 15s 2023-12-20T05:03:09.056 INFO:teuthology.orchestra.run.smithi081.stdout:generic/131 2s 2023-12-20T05:03:09.577 INFO:teuthology.orchestra.run.smithi081.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:11.193 INFO:teuthology.orchestra.run.smithi081.stdout:generic/135 2s 2023-12-20T05:03:11.824 INFO:teuthology.orchestra.run.smithi081.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T05:03:12.348 INFO:teuthology.orchestra.run.smithi081.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:12.866 INFO:teuthology.orchestra.run.smithi081.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:13.380 INFO:teuthology.orchestra.run.smithi081.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:15.196 INFO:teuthology.orchestra.run.smithi081.stdout:generic/141 2s 2023-12-20T05:03:15.788 INFO:teuthology.orchestra.run.smithi081.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:16.296 INFO:teuthology.orchestra.run.smithi081.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:16.824 INFO:teuthology.orchestra.run.smithi081.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:17.325 INFO:teuthology.orchestra.run.smithi081.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:17.846 INFO:teuthology.orchestra.run.smithi081.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:18.361 INFO:teuthology.orchestra.run.smithi081.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:18.860 INFO:teuthology.orchestra.run.smithi081.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:19.372 INFO:teuthology.orchestra.run.smithi081.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:19.884 INFO:teuthology.orchestra.run.smithi081.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:20.400 INFO:teuthology.orchestra.run.smithi081.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:20.893 INFO:teuthology.orchestra.run.smithi081.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:21.400 INFO:teuthology.orchestra.run.smithi081.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:21.917 INFO:teuthology.orchestra.run.smithi081.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:22.408 INFO:teuthology.orchestra.run.smithi081.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:22.917 INFO:teuthology.orchestra.run.smithi081.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:23.433 INFO:teuthology.orchestra.run.smithi081.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:23.974 INFO:teuthology.orchestra.run.smithi081.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T05:03:24.462 INFO:teuthology.orchestra.run.smithi081.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-20T05:03:24.973 INFO:teuthology.orchestra.run.smithi081.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-20T05:03:25.773 INFO:teuthology.orchestra.run.smithi081.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:26.468 INFO:teuthology.orchestra.run.smithi081.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-20T05:03:27.266 INFO:teuthology.orchestra.run.smithi081.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-20T05:03:28.681 INFO:teuthology.orchestra.run.smithi081.stdout:generic/169 1s 2023-12-20T05:03:29.523 INFO:teuthology.orchestra.run.smithi081.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:30.336 INFO:teuthology.orchestra.run.smithi081.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:30.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:03:30.854 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:03:30.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:03:31.131 INFO:teuthology.orchestra.run.smithi081.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:31.905 INFO:teuthology.orchestra.run.smithi081.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:43.665 INFO:teuthology.orchestra.run.smithi081.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:03:44.189 INFO:teuthology.orchestra.run.smithi081.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:45.187 INFO:teuthology.orchestra.run.smithi081.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:45.719 INFO:teuthology.orchestra.run.smithi081.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:03:46.292 INFO:teuthology.orchestra.run.smithi081.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T05:03:47.076 INFO:teuthology.orchestra.run.smithi081.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:47.606 INFO:teuthology.orchestra.run.smithi081.stdout:generic/184 0s 2023-12-20T05:03:48.396 INFO:teuthology.orchestra.run.smithi081.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:49.185 INFO:teuthology.orchestra.run.smithi081.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:49.976 INFO:teuthology.orchestra.run.smithi081.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:50.765 INFO:teuthology.orchestra.run.smithi081.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:51.542 INFO:teuthology.orchestra.run.smithi081.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:53.589 INFO:teuthology.orchestra.run.smithi081.stdout:generic/193 2s 2023-12-20T05:03:54.414 INFO:teuthology.orchestra.run.smithi081.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:55.222 INFO:teuthology.orchestra.run.smithi081.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:56.012 INFO:teuthology.orchestra.run.smithi081.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:03:56.737 INFO:teuthology.orchestra.run.smithi081.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:00.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:04:00.959 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:04:00.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:04:01.057 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T05:04:01.057+0000 7fb17bd01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96508) UID: 0 2023-12-20T05:04:01.058 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-20T05:04:01.058+0000 7f957aba7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96508) UID: 0 2023-12-20T05:04:01.060 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T05:04:01.061+0000 7f07fad3f640 -1 Fail to open '/proc/96508/cmdline' error = (2) No such file or directory 2023-12-20T05:04:01.061 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T05:04:01.061+0000 7f07fad3f640 -1 received signal: Hangup from (PID: 96508) UID: 0 2023-12-20T05:04:01.061 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T05:04:01.062+0000 7ff20e230640 -1 Fail to open '/proc/96508/cmdline' error = (2) No such file or directory 2023-12-20T05:04:01.061 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T05:04:01.062+0000 7ff20e230640 -1 received signal: Hangup from (PID: 96508) UID: 0 2023-12-20T05:04:30.297 INFO:teuthology.orchestra.run.smithi081.stdout:generic/198 34s 2023-12-20T05:04:31.074 INFO:teuthology.orchestra.run.smithi081.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:31.812 INFO:teuthology.orchestra.run.smithi081.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:32.617 INFO:teuthology.orchestra.run.smithi081.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:33.402 INFO:teuthology.orchestra.run.smithi081.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:34.213 INFO:teuthology.orchestra.run.smithi081.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:34.995 INFO:teuthology.orchestra.run.smithi081.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:35.794 INFO:teuthology.orchestra.run.smithi081.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:04:53.861 INFO:teuthology.orchestra.run.smithi081.stdout:generic/207 18s 2023-12-20T05:04:54.437 INFO:teuthology.orchestra.run.smithi081.stdout:generic/210 1s 2023-12-20T05:04:55.428 INFO:teuthology.orchestra.run.smithi081.stdout:generic/211 1s 2023-12-20T05:04:55.973 INFO:teuthology.orchestra.run.smithi081.stdout:generic/212 0s 2023-12-20T05:04:56.456 INFO:teuthology.orchestra.run.smithi081.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:04:56.970 INFO:teuthology.orchestra.run.smithi081.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:04:59.567 INFO:teuthology.orchestra.run.smithi081.stdout:generic/215 2s 2023-12-20T05:05:00.357 INFO:teuthology.orchestra.run.smithi081.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:01.149 INFO:teuthology.orchestra.run.smithi081.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:01.925 INFO:teuthology.orchestra.run.smithi081.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:02.393 INFO:teuthology.orchestra.run.smithi081.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:05:03.222 INFO:teuthology.orchestra.run.smithi081.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:04.728 INFO:teuthology.orchestra.run.smithi081.stdout:generic/221 1s 2023-12-20T05:05:05.539 INFO:teuthology.orchestra.run.smithi081.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:06.004 INFO:teuthology.orchestra.run.smithi081.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:05:06.531 INFO:teuthology.orchestra.run.smithi081.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-20T05:05:07.319 INFO:teuthology.orchestra.run.smithi081.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:05:08.677 INFO:teuthology.orchestra.run.smithi081.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:09.122 INFO:teuthology.orchestra.run.smithi081.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:05:09.564 INFO:teuthology.orchestra.run.smithi081.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:05:11.127 INFO:teuthology.orchestra.run.smithi081.stdout:generic/236 2s 2023-12-20T05:05:11.723 INFO:teuthology.orchestra.run.smithi081.stdout:generic/237 0s 2023-12-20T05:05:12.517 INFO:teuthology.orchestra.run.smithi081.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:05:28.205 INFO:teuthology.orchestra.run.smithi081.stdout:generic/240 16s 2023-12-20T05:05:28.623 INFO:teuthology.orchestra.run.smithi081.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:05:29.185 INFO:teuthology.orchestra.run.smithi081.stdout:generic/245 1s 2023-12-20T05:05:29.691 INFO:teuthology.orchestra.run.smithi081.stdout:generic/246 0s 2023-12-20T05:06:44.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:06:44.795 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:06:44.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:06:44.871 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-20T05:06:44.871+0000 7f501e29e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102553) UID: 0 2023-12-20T05:06:44.871 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-20T05:06:44.871+0000 7fbe328ee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102553) UID: 0 2023-12-20T05:06:44.871 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-20T05:06:44.872+0000 7f4e086d9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102553) UID: 0 2023-12-20T05:06:44.873 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-20T05:06:44.871+0000 7fdca0be8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102553) UID: 0 2023-12-20T05:09:44.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:09:44.154 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:09:44.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:10:14.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:10:14.296 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:10:14.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:10:14.334 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T05:10:14.335+0000 7f07fad3f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96571) UID: 0 2023-12-20T05:10:14.334 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T05:10:14.335+0000 7fb17bd01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96571) UID: 0 2023-12-20T05:10:14.334 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T05:10:14.335+0000 7ff20e230640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96571) UID: 0 2023-12-20T05:10:14.334 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-20T05:10:14.335+0000 7f957aba7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96571) UID: 0 2023-12-20T05:11:02.967 INFO:teuthology.orchestra.run.smithi081.stdout:generic/247 333s 2023-12-20T05:11:03.550 INFO:teuthology.orchestra.run.smithi081.stdout:generic/248 1s 2023-12-20T05:11:26.543 INFO:teuthology.orchestra.run.smithi081.stdout:generic/249 23s 2023-12-20T05:11:27.022 INFO:teuthology.orchestra.run.smithi081.stdout:generic/250 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:11:27.509 INFO:teuthology.orchestra.run.smithi081.stdout:generic/252 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:11:28.324 INFO:teuthology.orchestra.run.smithi081.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:11:29.109 INFO:teuthology.orchestra.run.smithi081.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:11:38.472 INFO:teuthology.orchestra.run.smithi081.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:11:44.855 INFO:teuthology.orchestra.run.smithi081.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:11:46.149 INFO:teuthology.orchestra.run.smithi081.stdout:generic/257 2s 2023-12-20T05:11:46.599 INFO:teuthology.orchestra.run.smithi081.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-20T05:11:47.443 INFO:teuthology.orchestra.run.smithi081.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:11:48.161 INFO:teuthology.orchestra.run.smithi081.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.a4FpERTltXscratch 2023-12-20T05:11:48.946 INFO:teuthology.orchestra.run.smithi081.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:11:49.754 INFO:teuthology.orchestra.run.smithi081.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:12:54.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:12:54.458 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:12:54.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:13:08.126 INFO:teuthology.orchestra.run.smithi081.stdout:generic/263 79s 2023-12-20T05:13:08.906 INFO:teuthology.orchestra.run.smithi081.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:10.560 INFO:teuthology.orchestra.run.smithi081.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:11.413 INFO:teuthology.orchestra.run.smithi081.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:12.257 INFO:teuthology.orchestra.run.smithi081.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:13.112 INFO:teuthology.orchestra.run.smithi081.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:13.946 INFO:teuthology.orchestra.run.smithi081.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:14.720 INFO:teuthology.orchestra.run.smithi081.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:15.205 INFO:teuthology.orchestra.run.smithi081.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-20T05:13:16.027 INFO:teuthology.orchestra.run.smithi081.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:16.851 INFO:teuthology.orchestra.run.smithi081.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:17.642 INFO:teuthology.orchestra.run.smithi081.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:18.464 INFO:teuthology.orchestra.run.smithi081.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:19.288 INFO:teuthology.orchestra.run.smithi081.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:20.057 INFO:teuthology.orchestra.run.smithi081.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:20.519 INFO:teuthology.orchestra.run.smithi081.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:13:21.308 INFO:teuthology.orchestra.run.smithi081.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:21.936 INFO:teuthology.orchestra.run.smithi081.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.a4FpERTltXscratch 2023-12-20T05:13:22.723 INFO:teuthology.orchestra.run.smithi081.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:23.513 INFO:teuthology.orchestra.run.smithi081.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:24.275 INFO:teuthology.orchestra.run.smithi081.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:24.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:13:24.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:13:24.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:13:25.020 INFO:teuthology.orchestra.run.smithi081.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:25.776 INFO:teuthology.orchestra.run.smithi081.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:26.801 INFO:teuthology.orchestra.run.smithi081.stdout:generic/294 1s 2023-12-20T05:13:27.669 INFO:teuthology.orchestra.run.smithi081.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:28.452 INFO:teuthology.orchestra.run.smithi081.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:29.257 INFO:teuthology.orchestra.run.smithi081.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:30.028 INFO:teuthology.orchestra.run.smithi081.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:30.580 INFO:teuthology.orchestra.run.smithi081.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:13:31.113 INFO:teuthology.orchestra.run.smithi081.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T05:13:31.916 INFO:teuthology.orchestra.run.smithi081.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:13:32.861 INFO:teuthology.orchestra.run.smithi081.stdout:generic/306 1s 2023-12-20T05:13:35.071 INFO:teuthology.orchestra.run.smithi081.stdout:generic/307 3s 2023-12-20T05:13:35.660 INFO:teuthology.orchestra.run.smithi081.stdout:generic/308 0s 2023-12-20T05:13:37.194 INFO:teuthology.orchestra.run.smithi081.stdout:generic/309 2s 2023-12-20T05:13:37.637 INFO:teuthology.orchestra.run.smithi081.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:13:42.177 INFO:teuthology.orchestra.run.smithi081.stdout:generic/313 5s 2023-12-20T05:13:43.166 INFO:teuthology.orchestra.run.smithi081.stdout:generic/314 1s 2023-12-20T05:13:43.632 INFO:teuthology.orchestra.run.smithi081.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-20T05:13:54.606 INFO:teuthology.orchestra.run.smithi081.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:13:54.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:13:54.781 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:13:54.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:13:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:generic/317 - output mismatch (see /tmp/tmp.utfXGGFva6xfstests-dev/results//generic/317.out.bad) 2023-12-20T05:13:55.813 INFO:teuthology.orchestra.run.smithi081.stdout: --- tests/generic/317.out 2023-12-20 04:24:17.611798784 +0000 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: +++ /tmp/tmp.utfXGGFva6xfstests-dev/results//generic/317.out.bad 2023-12-20 05:13:55.804565001 +0000 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: @@ -4,9 +4,7 @@ 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Filetype: Regular File 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: From user_ns 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: - Size: 0 Filetype: Regular File 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: +execvp: Permission denied 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: *** Remounting *** 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: @@ -15,6 +13,4 @@ 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Filetype: Regular File 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-20T05:13:55.814 INFO:teuthology.orchestra.run.smithi081.stdout: From user_ns 2023-12-20T05:13:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-20T05:13:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: - Size: 0 Filetype: Regular File 2023-12-20T05:13:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-20T05:13:55.815 INFO:teuthology.orchestra.run.smithi081.stdout: +execvp: Permission denied 2023-12-20T05:13:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:generic/318 1s 2023-12-20T05:13:57.593 INFO:teuthology.orchestra.run.smithi081.stdout:generic/319 1s 2023-12-20T05:13:58.129 INFO:teuthology.orchestra.run.smithi081.stdout:generic/321 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:13:58.593 INFO:teuthology.orchestra.run.smithi081.stdout:generic/322 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:13:59.027 INFO:teuthology.orchestra.run.smithi081.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-20T05:13:59.493 INFO:teuthology.orchestra.run.smithi081.stdout:generic/325 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:14:00.296 INFO:teuthology.orchestra.run.smithi081.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:14:01.124 INFO:teuthology.orchestra.run.smithi081.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:14:01.916 INFO:teuthology.orchestra.run.smithi081.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:14:02.708 INFO:teuthology.orchestra.run.smithi081.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:14:03.491 INFO:teuthology.orchestra.run.smithi081.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:14:04.302 INFO:teuthology.orchestra.run.smithi081.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:14:05.074 INFO:teuthology.orchestra.run.smithi081.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:14:05.582 INFO:teuthology.orchestra.run.smithi081.stdout:generic/335 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:14:06.090 INFO:teuthology.orchestra.run.smithi081.stdout:generic/336 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:14:07.150 INFO:teuthology.orchestra.run.smithi081.stdout:generic/337 1s 2023-12-20T05:14:07.663 INFO:teuthology.orchestra.run.smithi081.stdout:generic/338 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:14:08.173 INFO:teuthology.orchestra.run.smithi081.stdout:generic/341 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:14:08.648 INFO:teuthology.orchestra.run.smithi081.stdout:generic/342 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:14:09.176 INFO:teuthology.orchestra.run.smithi081.stdout:generic/343 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:14:24.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:14:24.907 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:14:24.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:14:55.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:14:55.109 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:14:55.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:14:55.154 INFO:tasks.ceph.osd.4.smithi069.stderr:2023-12-20T05:14:55.155+0000 7f957aba7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96673) UID: 0 2023-12-20T05:14:55.154 INFO:tasks.ceph.osd.7.smithi069.stderr:2023-12-20T05:14:55.155+0000 7ff20e230640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96673) UID: 0 2023-12-20T05:14:55.155 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T05:14:55.156+0000 7f07fad3f640 -1 Fail to open '/proc/96673/cmdline' error = (2) No such file or directory 2023-12-20T05:14:55.155 INFO:tasks.ceph.osd.5.smithi069.stderr:2023-12-20T05:14:55.156+0000 7f07fad3f640 -1 received signal: Hangup from (PID: 96673) UID: 0 2023-12-20T05:14:55.155 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T05:14:55.156+0000 7fb17bd01640 -1 Fail to open '/proc/96673/cmdline' error = (2) No such file or directory 2023-12-20T05:14:55.155 INFO:tasks.ceph.osd.6.smithi069.stderr:2023-12-20T05:14:55.156+0000 7fb17bd01640 -1 received signal: Hangup from (PID: 96673) UID: 0 2023-12-20T05:18:02.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:18:02.451 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:18:02.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:18:02.485 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-20T05:18:02.486+0000 7fbe328ee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102718) UID: 0 2023-12-20T05:18:02.485 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-20T05:18:02.486+0000 7f501e29e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102718) UID: 0 2023-12-20T05:18:02.486 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-20T05:18:02.486+0000 7fdca0be8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102718) UID: 0 2023-12-20T05:18:02.486 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-20T05:18:02.486+0000 7f4e086d9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102718) UID: 0 2023-12-20T05:18:22.434 INFO:teuthology.orchestra.run.smithi081.stdout:generic/346 253s 2023-12-20T05:18:23.048 INFO:teuthology.orchestra.run.smithi081.stdout:generic/347 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:18:23.548 INFO:teuthology.orchestra.run.smithi081.stdout:generic/348 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:18:24.331 INFO:teuthology.orchestra.run.smithi081.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:18:25.602 INFO:teuthology.orchestra.run.smithi081.stdout:generic/355 1s 2023-12-20T05:18:26.354 INFO:teuthology.orchestra.run.smithi081.stdout:generic/356 [not run] swapfiles are not supported 2023-12-20T05:18:27.112 INFO:teuthology.orchestra.run.smithi081.stdout:generic/357 [not run] swapfiles are not supported 2023-12-20T05:18:27.886 INFO:teuthology.orchestra.run.smithi081.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:18:28.672 INFO:teuthology.orchestra.run.smithi081.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:18:29.237 INFO:teuthology.orchestra.run.smithi081.stdout:generic/360 1s 2023-12-20T05:18:29.727 INFO:teuthology.orchestra.run.smithi081.stdout:generic/361 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:18:30.164 INFO:teuthology.orchestra.run.smithi081.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:30.622 INFO:teuthology.orchestra.run.smithi081.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:31.056 INFO:teuthology.orchestra.run.smithi081.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:31.484 INFO:teuthology.orchestra.run.smithi081.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:31.929 INFO:teuthology.orchestra.run.smithi081.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:32.368 INFO:teuthology.orchestra.run.smithi081.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:32.811 INFO:teuthology.orchestra.run.smithi081.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi081.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:33.709 INFO:teuthology.orchestra.run.smithi081.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-20T05:18:34.177 INFO:teuthology.orchestra.run.smithi081.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:18:34.949 INFO:teuthology.orchestra.run.smithi081.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:18:35.736 INFO:teuthology.orchestra.run.smithi081.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:18:36.410 INFO:teuthology.orchestra.run.smithi081.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-20T05:18:37.205 INFO:teuthology.orchestra.run.smithi081.stdout:generic/375 1s 2023-12-20T05:18:37.660 INFO:teuthology.orchestra.run.smithi081.stdout:generic/376 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:18:38.687 INFO:teuthology.orchestra.run.smithi081.stdout:generic/377 1s 2023-12-20T05:18:39.735 INFO:teuthology.orchestra.run.smithi081.stdout:generic/378 1s 2023-12-20T05:18:40.172 INFO:teuthology.orchestra.run.smithi081.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:40.633 INFO:teuthology.orchestra.run.smithi081.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:41.085 INFO:teuthology.orchestra.run.smithi081.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:41.547 INFO:teuthology.orchestra.run.smithi081.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:41.984 INFO:teuthology.orchestra.run.smithi081.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:42.436 INFO:teuthology.orchestra.run.smithi081.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:42.920 INFO:teuthology.orchestra.run.smithi081.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:43.371 INFO:teuthology.orchestra.run.smithi081.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:43.840 INFO:teuthology.orchestra.run.smithi081.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-20T05:18:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:18:44.925 INFO:teuthology.orchestra.run.smithi081.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-20T05:18:46.411 INFO:teuthology.orchestra.run.smithi081.stdout:generic/393 2s 2023-12-20T05:18:47.032 INFO:teuthology.orchestra.run.smithi081.stdout:generic/394 1s 2023-12-20T05:18:47.655 INFO:teuthology.orchestra.run.smithi081.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:18:48.285 INFO:teuthology.orchestra.run.smithi081.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:18:48.911 INFO:teuthology.orchestra.run.smithi081.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:18:49.518 INFO:teuthology.orchestra.run.smithi081.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:18:49.941 INFO:teuthology.orchestra.run.smithi081.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:18:50.990 INFO:teuthology.orchestra.run.smithi081.stdout:generic/401 1s 2023-12-20T05:18:51.763 INFO:teuthology.orchestra.run.smithi081.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-20T05:18:53.229 INFO:teuthology.orchestra.run.smithi081.stdout:generic/403 2s 2023-12-20T05:18:53.755 INFO:teuthology.orchestra.run.smithi081.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:18:57.250 INFO:teuthology.orchestra.run.smithi081.stdout:generic/406 4s 2023-12-20T05:18:57.861 INFO:teuthology.orchestra.run.smithi081.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:18:58.435 INFO:teuthology.orchestra.run.smithi081.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T05:18:58.902 INFO:teuthology.orchestra.run.smithi081.stdout:generic/409 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-20T05:18:59.338 INFO:teuthology.orchestra.run.smithi081.stdout:generic/410 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-20T05:18:59.791 INFO:teuthology.orchestra.run.smithi081.stdout:generic/411 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-12-20T05:19:01.162 INFO:teuthology.orchestra.run.smithi081.stdout:generic/412 2s 2023-12-20T05:19:01.865 INFO:teuthology.orchestra.run.smithi081.stdout:generic/413 [not run] mount 172.21.15.40:6789:/scratch with dax failed 2023-12-20T05:19:02.622 INFO:teuthology.orchestra.run.smithi081.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:19:03.275 INFO:teuthology.orchestra.run.smithi081.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-20T05:19:03.930 INFO:teuthology.orchestra.run.smithi081.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:19:12.900 INFO:teuthology.orchestra.run.smithi081.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:19:13.512 INFO:teuthology.orchestra.run.smithi081.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:19:14.002 INFO:teuthology.orchestra.run.smithi081.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-20T05:19:14.611 INFO:teuthology.orchestra.run.smithi081.stdout:generic/423 0s 2023-12-20T05:19:15.113 INFO:teuthology.orchestra.run.smithi081.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-20T05:19:15.639 INFO:teuthology.orchestra.run.smithi081.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-20T05:19:38.120 INFO:teuthology.orchestra.run.smithi081.stdout:generic/426 23s 2023-12-20T05:19:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-20T05:19:39.573 INFO:teuthology.orchestra.run.smithi081.stdout:generic/428 0s 2023-12-20T05:19:40.256 INFO:teuthology.orchestra.run.smithi081.stdout:generic/430 1s 2023-12-20T05:19:40.851 INFO:teuthology.orchestra.run.smithi081.stdout:generic/431 0s 2023-12-20T05:19:41.463 INFO:teuthology.orchestra.run.smithi081.stdout:generic/432 1s 2023-12-20T05:19:42.037 INFO:teuthology.orchestra.run.smithi081.stdout:generic/433 1s 2023-12-20T05:19:42.666 INFO:teuthology.orchestra.run.smithi081.stdout:generic/434 0s 2023-12-20T05:19:43.351 INFO:teuthology.orchestra.run.smithi081.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:19:44.703 INFO:teuthology.orchestra.run.smithi081.stdout:generic/437 1s 2023-12-20T05:19:55.951 INFO:teuthology.orchestra.run.smithi081.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:19:56.572 INFO:teuthology.orchestra.run.smithi081.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:19:57.096 INFO:teuthology.orchestra.run.smithi081.stdout:generic/441 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:19:57.629 INFO:teuthology.orchestra.run.smithi081.stdout:generic/443 0s 2023-12-20T05:19:58.269 INFO:teuthology.orchestra.run.smithi081.stdout:generic/444 1s 2023-12-20T05:19:58.947 INFO:teuthology.orchestra.run.smithi081.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:20:07.673 INFO:teuthology.orchestra.run.smithi081.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:20:08.561 INFO:teuthology.orchestra.run.smithi081.stdout:generic/448 1s 2023-12-20T05:20:09.075 INFO:teuthology.orchestra.run.smithi081.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-20T05:20:14.140 INFO:teuthology.orchestra.run.smithi081.stdout:generic/450 5s 2023-12-20T05:20:39.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:20:39.152 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:20:39.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:20:44.730 INFO:teuthology.orchestra.run.smithi081.stdout:generic/451 30s 2023-12-20T05:20:46.373 INFO:teuthology.orchestra.run.smithi081.stdout:generic/452 2s 2023-12-20T05:20:46.835 INFO:teuthology.orchestra.run.smithi081.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-20T05:20:47.318 INFO:teuthology.orchestra.run.smithi081.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-20T05:20:47.855 INFO:teuthology.orchestra.run.smithi081.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:20:48.685 INFO:teuthology.orchestra.run.smithi081.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:21:09.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:21:09.702 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:21:09.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:21:40.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:21:40.156 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:21:40.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:22:10.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:22:10.375 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:22:10.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:22:40.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:22:40.578 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:22:40.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:23:10.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:23:10.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:23:10.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:23:40.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:23:40.980 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:23:40.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:24:11.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:24:11.168 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:24:11.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:24:41.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:24:41.377 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:24:41.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:25:11.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:25:11.581 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:25:11.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:25:32.640 INFO:teuthology.orchestra.run.smithi081.stdout:generic/460 284s 2023-12-20T05:25:33.349 INFO:teuthology.orchestra.run.smithi081.stdout:generic/462 [not run] mount 172.21.15.40:6789:/scratch with dax failed 2023-12-20T05:25:33.939 INFO:teuthology.orchestra.run.smithi081.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:25:40.528 INFO:teuthology.orchestra.run.smithi081.stdout:generic/465 7s 2023-12-20T05:25:41.017 INFO:teuthology.orchestra.run.smithi081.stdout:generic/466 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:25:41.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:25:41.792 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:25:41.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:25:44.096 INFO:teuthology.orchestra.run.smithi081.stdout:generic/467 3s 2023-12-20T05:25:45.757 INFO:teuthology.orchestra.run.smithi081.stdout:generic/468 [not run] ceph does not support shutdown 2023-12-20T05:25:46.254 INFO:teuthology.orchestra.run.smithi081.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-20T05:25:46.830 INFO:teuthology.orchestra.run.smithi081.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-20T05:26:13.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:26:13.327 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:26:13.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:26:25.269 INFO:teuthology.orchestra.run.smithi081.stdout:generic/471 39s 2023-12-20T05:26:26.202 INFO:teuthology.orchestra.run.smithi081.stdout:generic/472 [not run] swapfiles are not supported 2023-12-20T05:26:26.863 INFO:teuthology.orchestra.run.smithi081.stdout:generic/474 [not run] ceph does not support shutdown 2023-12-20T05:26:32.807 INFO:teuthology.orchestra.run.smithi081.stdout:generic/477 6s 2023-12-20T05:26:43.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:26:43.974 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:26:43.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:26:45.151 INFO:teuthology.orchestra.run.smithi081.stdout:generic/478 13s 2023-12-20T05:26:45.772 INFO:teuthology.orchestra.run.smithi081.stdout:generic/479 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:26:46.311 INFO:teuthology.orchestra.run.smithi081.stdout:generic/480 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:26:46.806 INFO:teuthology.orchestra.run.smithi081.stdout:generic/481 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:26:47.309 INFO:teuthology.orchestra.run.smithi081.stdout:generic/483 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:26:47.812 INFO:teuthology.orchestra.run.smithi081.stdout:generic/484 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:26:48.302 INFO:teuthology.orchestra.run.smithi081.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-20T05:26:49.895 INFO:teuthology.orchestra.run.smithi081.stdout:generic/486 1s 2023-12-20T05:26:50.446 INFO:teuthology.orchestra.run.smithi081.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-12-20T05:26:50.938 INFO:teuthology.orchestra.run.smithi081.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-20T05:26:51.431 INFO:teuthology.orchestra.run.smithi081.stdout:generic/489 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:26:52.269 INFO:teuthology.orchestra.run.smithi081.stdout:generic/490 1s 2023-12-20T05:26:52.771 INFO:teuthology.orchestra.run.smithi081.stdout:generic/491 [not run] ceph does not support freezing 2023-12-20T05:26:53.252 INFO:teuthology.orchestra.run.smithi081.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-12-20T05:26:54.045 INFO:teuthology.orchestra.run.smithi081.stdout:generic/493 [not run] swapfiles are not supported 2023-12-20T05:26:54.812 INFO:teuthology.orchestra.run.smithi081.stdout:generic/494 [not run] swapfiles are not supported 2023-12-20T05:26:55.577 INFO:teuthology.orchestra.run.smithi081.stdout:generic/495 [not run] swapfiles are not supported 2023-12-20T05:26:56.333 INFO:teuthology.orchestra.run.smithi081.stdout:generic/496 [not run] swapfiles are not supported 2023-12-20T05:26:57.125 INFO:teuthology.orchestra.run.smithi081.stdout:generic/497 [not run] swapfiles are not supported 2023-12-20T05:26:57.634 INFO:teuthology.orchestra.run.smithi081.stdout:generic/498 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:26:58.113 INFO:teuthology.orchestra.run.smithi081.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-20T05:26:58.993 INFO:teuthology.orchestra.run.smithi081.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:26:59.505 INFO:teuthology.orchestra.run.smithi081.stdout:generic/502 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:27:00.013 INFO:teuthology.orchestra.run.smithi081.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:27:00.569 INFO:teuthology.orchestra.run.smithi081.stdout:generic/504 0s 2023-12-20T05:27:01.232 INFO:teuthology.orchestra.run.smithi081.stdout:generic/505 [not run] ceph does not support shutdown 2023-12-20T05:27:01.686 INFO:teuthology.orchestra.run.smithi081.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:27:02.188 INFO:teuthology.orchestra.run.smithi081.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-20T05:27:02.628 INFO:teuthology.orchestra.run.smithi081.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-12-20T05:27:03.135 INFO:teuthology.orchestra.run.smithi081.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-12-20T05:27:03.616 INFO:teuthology.orchestra.run.smithi081.stdout:generic/510 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:27:04.085 INFO:teuthology.orchestra.run.smithi081.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-20T05:27:04.582 INFO:teuthology.orchestra.run.smithi081.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:27:05.429 INFO:teuthology.orchestra.run.smithi081.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:27:06.256 INFO:teuthology.orchestra.run.smithi081.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:27:07.077 INFO:teuthology.orchestra.run.smithi081.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:27:07.598 INFO:teuthology.orchestra.run.smithi081.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-20T05:27:08.323 INFO:teuthology.orchestra.run.smithi081.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-20T05:27:09.294 INFO:teuthology.orchestra.run.smithi081.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:27:09.771 INFO:teuthology.orchestra.run.smithi081.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-12-20T05:27:10.256 INFO:teuthology.orchestra.run.smithi081.stdout:generic/520 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:27:11.349 INFO:teuthology.orchestra.run.smithi081.stdout:generic/523 1s 2023-12-20T05:27:14.616 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:27:14.619 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:27:14.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:27:44.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:27:44.755 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:27:44.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:28:14.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:28:14.894 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:28:14.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:28:45.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:28:45.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:28:45.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:29:15.386 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:29:15.389 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:29:15.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:29:45.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:29:45.579 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:29:45.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:30:15.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:30:15.726 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:30:15.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:30:45.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:30:45.932 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:30:45.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:30:58.562 INFO:teuthology.orchestra.run.smithi081.stdout:generic/524 227s 2023-12-20T05:30:59.306 INFO:teuthology.orchestra.run.smithi081.stdout:generic/525 [not run] filesystem does not support huge file size 2023-12-20T05:30:59.800 INFO:teuthology.orchestra.run.smithi081.stdout:generic/526 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:31:00.312 INFO:teuthology.orchestra.run.smithi081.stdout:generic/527 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:31:00.950 INFO:teuthology.orchestra.run.smithi081.stdout:generic/528 0s 2023-12-20T05:31:01.922 INFO:teuthology.orchestra.run.smithi081.stdout:generic/529 1s 2023-12-20T05:31:02.624 INFO:teuthology.orchestra.run.smithi081.stdout:generic/530 [not run] ceph does not support shutdown 2023-12-20T05:31:03.084 INFO:teuthology.orchestra.run.smithi081.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-12-20T05:31:03.635 INFO:teuthology.orchestra.run.smithi081.stdout:generic/532 0s 2023-12-20T05:31:04.693 INFO:teuthology.orchestra.run.smithi081.stdout:generic/533 1s 2023-12-20T05:31:05.158 INFO:teuthology.orchestra.run.smithi081.stdout:generic/534 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:31:05.654 INFO:teuthology.orchestra.run.smithi081.stdout:generic/535 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:31:06.298 INFO:teuthology.orchestra.run.smithi081.stdout:generic/536 [not run] ceph does not support shutdown 2023-12-20T05:31:06.951 INFO:teuthology.orchestra.run.smithi081.stdout:generic/537 [not run] FSTRIM not supported 2023-12-20T05:31:16.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:31:16.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:31:16.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:31:46.360 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:31:46.363 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:31:46.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:32:16.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:32:16.585 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:32:16.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:32:46.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:32:46.815 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:32:46.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:33:17.051 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:33:17.055 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:33:17.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:33:47.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:33:47.201 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:33:47.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:34:17.529 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:34:17.533 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:34:17.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:34:47.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:34:47.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:34:47.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:35:17.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:35:17.907 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:35:17.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:35:48.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:35:48.104 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:35:48.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:36:18.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:36:18.321 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:36:18.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:36:48.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:36:48.544 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:36:48.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:37:18.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:37:18.757 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:37:18.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:37:48.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:37:48.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:37:48.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:38:19.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:38:19.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:38:19.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:38:49.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:38:49.462 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:38:49.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:39:19.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:39:19.754 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:39:19.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:39:49.970 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:39:49.975 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:39:49.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:39:50.007 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-12-20T05:39:50.007+0000 7fbe328ee640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103465) UID: 0 2023-12-20T05:39:50.007 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-12-20T05:39:50.007+0000 7fdca0be8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103465) UID: 0 2023-12-20T05:39:50.008 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-12-20T05:39:50.007+0000 7f4e086d9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103465) UID: 0 2023-12-20T05:39:50.008 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-12-20T05:39:50.007+0000 7f501e29e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103465) UID: 0 2023-12-20T05:42:16.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:42:16.822 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:42:16.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:42:47.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:42:47.134 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:42:47.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:43:17.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:43:17.347 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:43:17.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:43:47.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:43:47.545 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:43:47.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:44:17.755 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:44:17.757 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:44:17.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:44:47.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:44:47.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:44:48.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:45:18.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:45:18.203 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:45:18.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:45:37.668 INFO:teuthology.orchestra.run.smithi081.stdout:generic/538 871s 2023-12-20T05:45:48.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:45:48.407 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:45:48.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:45:48.881 INFO:teuthology.orchestra.run.smithi081.stdout:generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:45:49.711 INFO:teuthology.orchestra.run.smithi081.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:45:50.504 INFO:teuthology.orchestra.run.smithi081.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:45:51.291 INFO:teuthology.orchestra.run.smithi081.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:45:52.084 INFO:teuthology.orchestra.run.smithi081.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:45:52.853 INFO:teuthology.orchestra.run.smithi081.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:45:53.338 INFO:teuthology.orchestra.run.smithi081.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-20T05:45:53.841 INFO:teuthology.orchestra.run.smithi081.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:45:54.356 INFO:teuthology.orchestra.run.smithi081.stdout:generic/547 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:45:54.946 INFO:teuthology.orchestra.run.smithi081.stdout:generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:45:55.533 INFO:teuthology.orchestra.run.smithi081.stdout:generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:45:56.118 INFO:teuthology.orchestra.run.smithi081.stdout:generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:45:56.666 INFO:teuthology.orchestra.run.smithi081.stdout:generic/552 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:45:57.232 INFO:teuthology.orchestra.run.smithi081.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-12-20T05:45:58.085 INFO:teuthology.orchestra.run.smithi081.stdout:generic/554 [not run] swapfiles are not supported 2023-12-20T05:45:58.584 INFO:teuthology.orchestra.run.smithi081.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-12-20T05:45:59.048 INFO:teuthology.orchestra.run.smithi081.stdout:generic/556 [not run] ceph does not support casefold feature 2023-12-20T05:45:59.550 INFO:teuthology.orchestra.run.smithi081.stdout:generic/557 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:46:00.054 INFO:teuthology.orchestra.run.smithi081.stdout:generic/563 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:46:00.825 INFO:teuthology.orchestra.run.smithi081.stdout:generic/564 0s 2023-12-20T05:46:01.779 INFO:teuthology.orchestra.run.smithi081.stdout:generic/565 1s 2023-12-20T05:46:02.192 INFO:teuthology.orchestra.run.smithi081.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:46:11.316 INFO:teuthology.orchestra.run.smithi081.stdout:generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T05:46:11.775 INFO:teuthology.orchestra.run.smithi081.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:46:12.242 INFO:teuthology.orchestra.run.smithi081.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:46:12.693 INFO:teuthology.orchestra.run.smithi081.stdout:generic/570 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:46:13.143 INFO:teuthology.orchestra.run.smithi081.stdout:generic/571 [not run] Require fcntl setlease support 2023-12-20T05:46:13.584 INFO:teuthology.orchestra.run.smithi081.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:14.059 INFO:teuthology.orchestra.run.smithi081.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:14.494 INFO:teuthology.orchestra.run.smithi081.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:14.952 INFO:teuthology.orchestra.run.smithi081.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:15.510 INFO:teuthology.orchestra.run.smithi081.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:15.971 INFO:teuthology.orchestra.run.smithi081.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:16.466 INFO:teuthology.orchestra.run.smithi081.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-20T05:46:17.084 INFO:teuthology.orchestra.run.smithi081.stdout:generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:18.535 INFO:teuthology.orchestra.run.smithi081.stdout:generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:18.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:46:18.545 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:46:18.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:46:19.062 INFO:teuthology.orchestra.run.smithi081.stdout:generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:19.586 INFO:teuthology.orchestra.run.smithi081.stdout:generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:20.093 INFO:teuthology.orchestra.run.smithi081.stdout:generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:20.598 INFO:teuthology.orchestra.run.smithi081.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T05:46:21.124 INFO:teuthology.orchestra.run.smithi081.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:46:22.005 INFO:teuthology.orchestra.run.smithi081.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:46:22.661 INFO:teuthology.orchestra.run.smithi081.stdout:generic/591 0s 2023-12-20T05:46:23.266 INFO:teuthology.orchestra.run.smithi081.stdout:generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:23.909 INFO:teuthology.orchestra.run.smithi081.stdout:generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:24.398 INFO:teuthology.orchestra.run.smithi081.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:46:24.995 INFO:teuthology.orchestra.run.smithi081.stdout:generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:25.551 INFO:teuthology.orchestra.run.smithi081.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-12-20T05:46:26.865 INFO:teuthology.orchestra.run.smithi081.stdout:generic/597 1s 2023-12-20T05:46:28.291 INFO:teuthology.orchestra.run.smithi081.stdout:generic/598 2s 2023-12-20T05:46:28.962 INFO:teuthology.orchestra.run.smithi081.stdout:generic/599 [not run] ceph does not support shutdown 2023-12-20T05:46:29.439 INFO:teuthology.orchestra.run.smithi081.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:46:29.874 INFO:teuthology.orchestra.run.smithi081.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:46:30.468 INFO:teuthology.orchestra.run.smithi081.stdout:generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:30.919 INFO:teuthology.orchestra.run.smithi081.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T05:46:36.217 INFO:teuthology.orchestra.run.smithi081.stdout:generic/604 6s 2023-12-20T05:46:38.169 INFO:teuthology.orchestra.run.smithi081.stdout:generic/605 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed 2023-12-20T05:46:38.759 INFO:teuthology.orchestra.run.smithi081.stdout:generic/606 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed 2023-12-20T05:46:39.370 INFO:teuthology.orchestra.run.smithi081.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-12-20T05:46:39.994 INFO:teuthology.orchestra.run.smithi081.stdout:generic/608 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed 2023-12-20T05:46:40.667 INFO:teuthology.orchestra.run.smithi081.stdout:generic/609 0s 2023-12-20T05:46:48.267 INFO:teuthology.orchestra.run.smithi081.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-20T05:46:48.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:46:48.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:46:48.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:46:49.323 INFO:teuthology.orchestra.run.smithi081.stdout:generic/611 1s 2023-12-20T05:46:49.851 INFO:teuthology.orchestra.run.smithi081.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-12-20T05:46:50.430 INFO:teuthology.orchestra.run.smithi081.stdout:generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:51.095 INFO:teuthology.orchestra.run.smithi081.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-12-20T05:46:52.053 INFO:teuthology.orchestra.run.smithi081.stdout:generic/618 1s 2023-12-20T05:46:52.627 INFO:teuthology.orchestra.run.smithi081.stdout:generic/620 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:46:53.283 INFO:teuthology.orchestra.run.smithi081.stdout:generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T05:46:53.934 INFO:teuthology.orchestra.run.smithi081.stdout:generic/623 [not run] ceph does not support shutdown 2023-12-20T05:46:54.399 INFO:teuthology.orchestra.run.smithi081.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:54.883 INFO:teuthology.orchestra.run.smithi081.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-12-20T05:46:55.402 INFO:teuthology.orchestra.run.smithi081.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-12-20T05:46:56.203 INFO:teuthology.orchestra.run.smithi081.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:46:56.703 INFO:teuthology.orchestra.run.smithi081.stdout:generic/629 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:46:57.402 INFO:teuthology.orchestra.run.smithi081.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-20T05:46:59.555 INFO:teuthology.orchestra.run.smithi081.stdout:generic/632 2s 2023-12-20T05:47:00.811 INFO:teuthology.orchestra.run.smithi081.stdout:generic/633 1s 2023-12-20T05:47:02.826 INFO:teuthology.orchestra.run.smithi081.stdout:generic/634 2s 2023-12-20T05:47:03.530 INFO:teuthology.orchestra.run.smithi081.stdout:generic/635 [not run] ceph does not support shutdown 2023-12-20T05:47:04.282 INFO:teuthology.orchestra.run.smithi081.stdout:generic/636 [not run] swapfiles are not supported 2023-12-20T05:47:05.220 INFO:teuthology.orchestra.run.smithi081.stdout:generic/637 1s 2023-12-20T05:47:05.764 INFO:teuthology.orchestra.run.smithi081.stdout:generic/638 0s 2023-12-20T05:47:06.642 INFO:teuthology.orchestra.run.smithi081.stdout:generic/639 1s 2023-12-20T05:47:07.097 INFO:teuthology.orchestra.run.smithi081.stdout:generic/640 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T05:47:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:generic/641 [not run] swapfiles are not supported 2023-12-20T05:47:08.449 INFO:teuthology.orchestra.run.smithi081.stdout:generic/644 1s 2023-12-20T05:47:18.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:47:18.806 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:47:18.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:47:49.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:47:49.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:47:49.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:47:49.041 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-20T05:47:49.040+0000 7f2c24931640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103694) UID: 0 2023-12-20T05:47:49.041 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-20T05:47:49.040+0000 7fe2f95e5640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103694) UID: 0 2023-12-20T05:49:43.073 INFO:teuthology.orchestra.run.smithi081.stdout:generic/645 155s 2023-12-20T05:49:43.865 INFO:teuthology.orchestra.run.smithi081.stdout:generic/646 [not run] ceph does not support shutdown 2023-12-20T05:49:44.569 INFO:teuthology.orchestra.run.smithi081.stdout:generic/647 1s 2023-12-20T05:49:45.372 INFO:teuthology.orchestra.run.smithi081.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:46.228 INFO:teuthology.orchestra.run.smithi081.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:47.029 INFO:teuthology.orchestra.run.smithi081.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:47.919 INFO:teuthology.orchestra.run.smithi081.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:48.730 INFO:teuthology.orchestra.run.smithi081.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:49.512 INFO:teuthology.orchestra.run.smithi081.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:50.310 INFO:teuthology.orchestra.run.smithi081.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:51.089 INFO:teuthology.orchestra.run.smithi081.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:51.880 INFO:teuthology.orchestra.run.smithi081.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:52.735 INFO:teuthology.orchestra.run.smithi081.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:53.529 INFO:teuthology.orchestra.run.smithi081.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:54.377 INFO:teuthology.orchestra.run.smithi081.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:55.202 INFO:teuthology.orchestra.run.smithi081.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:55.992 INFO:teuthology.orchestra.run.smithi081.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:56.789 INFO:teuthology.orchestra.run.smithi081.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:57.588 INFO:teuthology.orchestra.run.smithi081.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:58.410 INFO:teuthology.orchestra.run.smithi081.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:49:59.192 INFO:teuthology.orchestra.run.smithi081.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:50:00.406 INFO:teuthology.orchestra.run.smithi081.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:50:01.187 INFO:teuthology.orchestra.run.smithi081.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-20T05:50:02.180 INFO:teuthology.orchestra.run.smithi081.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T05:51:28.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:51:28.626 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:51:28.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:51:58.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:51:58.851 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:51:58.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:51:58.882 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-20T05:51:58.882+0000 7f2c24931640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103737) UID: 0 2023-12-20T05:51:58.882 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-20T05:51:58.882+0000 7fe2f95e5640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103737) UID: 0 2023-12-20T05:54:34.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:54:34.136 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:54:34.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:55:04.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:55:04.356 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:55:04.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:55:34.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:55:34.509 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:55:34.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:55:34.540 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-20T05:55:34.539+0000 7f2c24931640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103796) UID: 0 2023-12-20T05:55:34.540 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-20T05:55:34.539+0000 7fe2f95e5640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103796) UID: 0 2023-12-20T05:58:03.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:58:03.443 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:58:03.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:58:33.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:58:33.747 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:58:33.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:59:03.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:59:03.951 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:59:03.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T05:59:03.984 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-20T05:59:03.983+0000 7f2c24931640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103856) UID: 0 2023-12-20T05:59:03.984 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-20T05:59:03.983+0000 7fe2f95e5640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103856) UID: 0 2023-12-20T06:01:26.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:01:26.766 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:01:26.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:01:57.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:01:57.146 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:01:57.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:02:27.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:02:27.334 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:02:27.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:02:27.369 INFO:tasks.ceph.mds.a.smithi040.stderr:2023-12-20T06:02:27.369+0000 7f2c24931640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103927) UID: 0 2023-12-20T06:02:27.369 INFO:tasks.ceph.mds.c.smithi040.stderr:2023-12-20T06:02:27.369+0000 7fe2f95e5640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 103927) UID: 0 2023-12-20T06:03:31.411 INFO:teuthology.orchestra.run.smithi081.stdout:generic/676 809s 2023-12-20T06:03:31.887 INFO:teuthology.orchestra.run.smithi081.stdout:generic/677 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T06:03:32.377 INFO:teuthology.orchestra.run.smithi081.stdout:generic/678 [not run] kernel does not support IO_URING 2023-12-20T06:03:32.883 INFO:teuthology.orchestra.run.smithi081.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T06:03:33.914 INFO:teuthology.orchestra.run.smithi081.stdout:generic/680 1s 2023-12-20T06:03:34.344 INFO:teuthology.orchestra.run.smithi081.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T06:03:34.818 INFO:teuthology.orchestra.run.smithi081.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-20T06:03:35.359 INFO:teuthology.orchestra.run.smithi081.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T06:03:44.356 INFO:teuthology.orchestra.run.smithi081.stdout:generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-20T06:03:56.791 INFO:teuthology.orchestra.run.smithi081.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-20T06:04:06.263 INFO:teuthology.orchestra.run.smithi081.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-20T06:04:15.721 INFO:teuthology.orchestra.run.smithi081.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-20T06:04:16.262 INFO:teuthology.orchestra.run.smithi081.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-20T06:04:16.895 INFO:teuthology.orchestra.run.smithi081.stdout:generic/689 0s 2023-12-20T06:04:17.366 INFO:teuthology.orchestra.run.smithi081.stdout:generic/690 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T06:04:17.828 INFO:teuthology.orchestra.run.smithi081.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-12-20T06:04:18.433 INFO:teuthology.orchestra.run.smithi081.stdout:generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-20T06:04:18.925 INFO:teuthology.orchestra.run.smithi081.stdout:generic/695 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-12-20T06:04:19.690 INFO:teuthology.orchestra.run.smithi081.stdout:generic/696 1s 2023-12-20T06:04:20.227 INFO:teuthology.orchestra.run.smithi081.stdout:generic/697 1s 2023-12-20T06:04:22.111 INFO:teuthology.orchestra.run.smithi081.stdout:generic/698 2s 2023-12-20T06:04:23.241 INFO:teuthology.orchestra.run.smithi081.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2023-12-20T06:04:23.773 INFO:teuthology.orchestra.run.smithi081.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-12-20T06:04:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-20T06:04:25.163 INFO:teuthology.orchestra.run.smithi081.stdout:generic/703 [not run] kernel does not support IO_URING 2023-12-20T06:04:25.721 INFO:teuthology.orchestra.run.smithi081.stdout:generic/704 [not run] require 172.21.15.40:6789:/test to be valid block disk 2023-12-20T06:04:26.679 INFO:teuthology.orchestra.run.smithi081.stdout:generic/706 1s 2023-12-20T06:04:27.279 INFO:teuthology.orchestra.run.smithi081.stdout:generic/708 1s 2023-12-20T06:04:27.768 INFO:teuthology.orchestra.run.smithi081.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:28.298 INFO:teuthology.orchestra.run.smithi081.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:28.796 INFO:teuthology.orchestra.run.smithi081.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:29.265 INFO:teuthology.orchestra.run.smithi081.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:29.752 INFO:teuthology.orchestra.run.smithi081.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2023-12-20T06:04:30.241 INFO:teuthology.orchestra.run.smithi081.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:30.754 INFO:teuthology.orchestra.run.smithi081.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2023-12-20T06:04:31.293 INFO:teuthology.orchestra.run.smithi081.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:31.803 INFO:teuthology.orchestra.run.smithi081.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:32.290 INFO:teuthology.orchestra.run.smithi081.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:32.780 INFO:teuthology.orchestra.run.smithi081.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:33.222 INFO:teuthology.orchestra.run.smithi081.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:33.697 INFO:teuthology.orchestra.run.smithi081.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-12-20T06:04:34.176 INFO:teuthology.orchestra.run.smithi081.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-20T06:04:34.670 INFO:teuthology.orchestra.run.smithi081.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2023-12-20T06:04:35.156 INFO:teuthology.orchestra.run.smithi081.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-20T06:04:35.664 INFO:teuthology.orchestra.run.smithi081.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-20T06:04:36.513 INFO:teuthology.orchestra.run.smithi081.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-20T06:04:37.096 INFO:teuthology.orchestra.run.smithi081.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2023-12-20T06:04:41.655 INFO:teuthology.orchestra.run.smithi081.stdout:generic/728 4s 2023-12-20T06:04:42.332 INFO:teuthology.orchestra.run.smithi081.stdout:generic/729 1s 2023-12-20T06:04:42.788 INFO:teuthology.orchestra.run.smithi081.stdout:generic/730 [not run] require 172.21.15.40:6789:/test to be valid block disk 2023-12-20T06:04:43.254 INFO:teuthology.orchestra.run.smithi081.stdout:generic/731 [not run] require 172.21.15.40:6789:/test to be valid block disk 2023-12-20T06:04:44.476 INFO:teuthology.orchestra.run.smithi081.stdout:generic/732 1s 2023-12-20T06:04:45.005 INFO:teuthology.orchestra.run.smithi081.stdout:shared/002 [not run] not suitable for this filesystem type: ceph 2023-12-20T06:04:45.502 INFO:teuthology.orchestra.run.smithi081.stdout:shared/032 [not run] not suitable for this filesystem type: ceph 2023-12-20T06:04:45.526 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 shared/002 shared/032 2023-12-20T06:04:45.527 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 shared/002 shared/032 2023-12-20T06:04:45.528 INFO:teuthology.orchestra.run.smithi081.stdout:Failures: generic/317 2023-12-20T06:04:45.528 INFO:teuthology.orchestra.run.smithi081.stdout:Failed 1 of 598 tests 2023-12-20T06:04:45.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-12-20T06:04:46.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T06:04:46.202 INFO:tasks.cephfs.test_fscrypt:Command failed. 2023-12-20T06:04:46.202 INFO:tasks.cephfs.test_fscrypt:Command return value: 1 2023-12-20T06:04:46.202 INFO:tasks.cephfs.test_fscrypt:Command stdout - FSTYP -- ceph PLATFORM -- Linux/x86_64 smithi081 6.6.0-g93572f31db89 #1 SMP PREEMPT_DYNAMIC Wed Dec 20 01:28:06 UTC 2023 MKFS_OPTIONS -- 172.21.15.40:6789:/scratch MOUNT_OPTIONS -- -o name=admin,secret=AQAEbIJl4UNQIBAAiKmukv4UdnsKSNal0x9M9Q==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.a4FpERTltXscratch ceph/001 [expunged] ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test ceph/004 0s ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test generic/001 10s generic/002 1s generic/003 [not run] atime not maintained by ceph generic/004 [not run] O_TMPFILE is not supported generic/005 0s generic/006 23s generic/007 48s generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/011 29s generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/013 37s generic/014 145s generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/018 [not run] defragmentation not supported for fstype "ceph" generic/020 8s generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/023 2s generic/024 [not run] kernel doesn't support renameat2 syscall generic/025 [not run] kernel doesn't support renameat2 syscall generic/026 [not run] ceph does not define maximum ACL count generic/028 6s generic/029 1s generic/030 5s generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/034 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/035 1s generic/037 7s generic/039 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/040 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/041 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/042 [not run] ceph does not support shutdown generic/050 [not run] ceph does not support shutdown generic/052 [not run] ceph does not support shutdown generic/053 1s generic/056 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/057 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/059 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/062 3s generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/065 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/066 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/067 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/069 21s generic/070 14s generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/073 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/075 22s generic/076 [not run] require 172.21.15.40:6789:/scratch to be local device generic/078 [not run] kernel doesn't support renameat2 syscall generic/079 [not run] file system doesn't support chattr +ia generic/080 2s generic/081 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/082 [not run] disk quotas not supported by this filesystem type: ceph generic/084 6s generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/087 0s generic/088 0s generic/090 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/091 66s generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/097 1s generic/098 1s generic/099 2s generic/101 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/104 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/105 0s generic/106 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/107 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/108 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/110 [not run] Reflink not supported by test filesystem type: ceph generic/111 [not run] Reflink not supported by test filesystem type: ceph generic/112 26s generic/113 113s generic/114 [not run] device block size: 4096 greater than 512 generic/115 [not run] Reflink not supported by test filesystem type: ceph generic/116 [not run] Reflink not supported by test filesystem type: ceph generic/117 7s generic/118 [not run] Reflink not supported by test filesystem type: ceph generic/119 [not run] Reflink not supported by test filesystem type: ceph generic/120 [not run] atime not maintained by ceph generic/121 [not run] Dedupe not supported by test filesystem type: ceph generic/122 [not run] Dedupe not supported by test filesystem type: ceph generic/123 1s generic/124 32s generic/126 1s generic/128 11s generic/129 1254s generic/130 15s generic/131 2s generic/134 [not run] Reflink not supported by test filesystem type: ceph generic/135 2s generic/136 [not run] Dedupe not supported by test filesystem type: ceph generic/138 [not run] Reflink not supported by test filesystem type: ceph generic/139 [not run] Reflink not supported by test filesystem type: ceph generic/140 [not run] Reflink not supported by test filesystem type: ceph generic/141 2s generic/142 [not run] Reflink not supported by test filesystem type: ceph generic/143 [not run] Reflink not supported by test filesystem type: ceph generic/144 [not run] Reflink not supported by test filesystem type: ceph generic/145 [not run] Reflink not supported by test filesystem type: ceph generic/146 [not run] Reflink not supported by test filesystem type: ceph generic/147 [not run] Reflink not supported by test filesystem type: ceph generic/148 [not run] Reflink not supported by test filesystem type: ceph generic/149 [not run] Reflink not supported by test filesystem type: ceph generic/150 [not run] Reflink not supported by test filesystem type: ceph generic/151 [not run] Reflink not supported by test filesystem type: ceph generic/152 [not run] Reflink not supported by test filesystem type: ceph generic/153 [not run] Reflink not supported by test filesystem type: ceph generic/154 [not run] Reflink not supported by test filesystem type: ceph generic/155 [not run] Reflink not supported by test filesystem type: ceph generic/156 [not run] Reflink not supported by test filesystem type: ceph generic/157 [not run] Reflink not supported by test filesystem type: ceph generic/158 [not run] Dedupe not supported by test filesystem type: ceph generic/159 [not run] file system doesn't support chattr +i generic/160 [not run] file system doesn't support chattr +i generic/161 [not run] Reflink not supported by scratch filesystem type: ceph generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph generic/169 1s generic/171 [not run] Reflink not supported by scratch filesystem type: ceph generic/172 [not run] Reflink not supported by scratch filesystem type: ceph generic/173 [not run] Reflink not supported by scratch filesystem type: ceph generic/174 [not run] Reflink not supported by scratch filesystem type: ceph generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/178 [not run] Reflink not supported by test filesystem type: ceph generic/179 [not run] Reflink not supported by test filesystem type: ceph generic/180 [not run] Reflink not supported by test filesystem type: ceph generic/181 [not run] Reflink not supported by test filesystem type: ceph generic/182 [not run] Dedupe not supported by test filesystem type: ceph generic/183 [not run] Reflink not supported by scratch filesystem type: ceph generic/184 0s generic/185 [not run] Reflink not supported by scratch filesystem type: ceph generic/188 [not run] Reflink not supported by scratch filesystem type: ceph generic/189 [not run] Reflink not supported by scratch filesystem type: ceph generic/190 [not run] Reflink not supported by scratch filesystem type: ceph generic/191 [not run] Reflink not supported by scratch filesystem type: ceph generic/193 2s generic/194 [not run] Reflink not supported by scratch filesystem type: ceph generic/195 [not run] Reflink not supported by scratch filesystem type: ceph generic/196 [not run] Reflink not supported by scratch filesystem type: ceph generic/197 [not run] Reflink not supported by scratch filesystem type: ceph generic/198 34s generic/199 [not run] Reflink not supported by scratch filesystem type: ceph generic/200 [not run] Reflink not supported by scratch filesystem type: ceph generic/201 [not run] Reflink not supported by scratch filesystem type: ceph generic/202 [not run] Reflink not supported by scratch filesystem type: ceph generic/203 [not run] Reflink not supported by scratch filesystem type: ceph generic/205 [not run] Reflink not supported by scratch filesystem type: ceph generic/206 [not run] Reflink not supported by scratch filesystem type: ceph generic/207 18s generic/210 1s generic/211 1s generic/212 0s generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/215 2s generic/216 [not run] Reflink not supported by scratch filesystem type: ceph generic/217 [not run] Reflink not supported by scratch filesystem type: ceph generic/218 [not run] Reflink not supported by scratch filesystem type: ceph generic/219 [not run] disk quotas not supported by this filesystem type: ceph generic/220 [not run] Reflink not supported by scratch filesystem type: ceph generic/221 1s generic/222 [not run] Reflink not supported by scratch filesystem type: ceph generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/227 [not run] Reflink not supported by scratch filesystem type: ceph generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/229 [not run] Reflink not supported by scratch filesystem type: ceph generic/230 [not run] disk quotas not supported by this filesystem type: ceph generic/235 [not run] disk quotas not supported by this filesystem type: ceph generic/236 2s generic/237 0s generic/238 [not run] Reflink not supported by scratch filesystem type: ceph generic/240 16s generic/244 [not run] disk quotas not supported by this filesystem type: ceph generic/245 1s generic/246 0s generic/247 333s generic/248 1s generic/249 23s generic/250 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/252 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/253 [not run] Reflink not supported by scratch filesystem type: ceph generic/254 [not run] Reflink not supported by scratch filesystem type: ceph generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/257 2s generic/258 [not run] ceph does not support negative timestamps generic/259 [not run] Reflink not supported by scratch filesystem type: ceph generic/260 [not run] FITRIM not supported on /tmp/tmp.a4FpERTltXscratch generic/261 [not run] Reflink not supported by scratch filesystem type: ceph generic/262 [not run] Reflink not supported by scratch filesystem type: ceph generic/263 79s generic/264 [not run] Reflink not supported by scratch filesystem type: ceph generic/265 [not run] Reflink not supported by scratch filesystem type: ceph generic/266 [not run] Reflink not supported by scratch filesystem type: ceph generic/267 [not run] Reflink not supported by scratch filesystem type: ceph generic/268 [not run] Reflink not supported by scratch filesystem type: ceph generic/271 [not run] Reflink not supported by scratch filesystem type: ceph generic/272 [not run] Reflink not supported by scratch filesystem type: ceph generic/276 [not run] Reflink not supported by scratch filesystem type: ceph generic/277 [not run] file system doesn't support chattr +A generic/278 [not run] Reflink not supported by scratch filesystem type: ceph generic/279 [not run] Reflink not supported by scratch filesystem type: ceph generic/281 [not run] Reflink not supported by scratch filesystem type: ceph generic/282 [not run] Reflink not supported by scratch filesystem type: ceph generic/283 [not run] Reflink not supported by scratch filesystem type: ceph generic/284 [not run] Reflink not supported by scratch filesystem type: ceph generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/287 [not run] Reflink not supported by scratch filesystem type: ceph generic/288 [not run] FITRIM not supported on /tmp/tmp.a4FpERTltXscratch generic/289 [not run] Reflink not supported by scratch filesystem type: ceph generic/290 [not run] Reflink not supported by scratch filesystem type: ceph generic/291 [not run] Reflink not supported by scratch filesystem type: ceph generic/292 [not run] Reflink not supported by scratch filesystem type: ceph generic/293 [not run] Reflink not supported by scratch filesystem type: ceph generic/294 1s generic/295 [not run] Reflink not supported by scratch filesystem type: ceph generic/296 [not run] Reflink not supported by scratch filesystem type: ceph generic/301 [not run] Reflink not supported by scratch filesystem type: ceph generic/302 [not run] Reflink not supported by scratch filesystem type: ceph generic/303 [not run] Reflink not supported by test filesystem type: ceph generic/304 [not run] Dedupe not supported by test filesystem type: ceph generic/305 [not run] Reflink not supported by scratch filesystem type: ceph generic/306 1s generic/307 3s generic/308 0s generic/309 2s generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/313 5s generic/314 1s generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/317 - output mismatch (see /tmp/tmp.utfXGGFva6xfstests-dev/results//generic/317.out.bad) --- tests/generic/317.out 2023-12-20 04:24:17.611798784 +0000 +++ /tmp/tmp.utfXGGFva6xfstests-dev/results//generic/317.out.bad 2023-12-20 05:13:55.804565001 +0000 @@ -4,9 +4,7 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied *** Remounting *** @@ -15,6 +13,4 @@ Size: 0 Filetype: Regular File Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) From user_ns - File: "$SCRATCH_MNT/file1" - Size: 0 Filetype: Regular File - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) +execvp: Permission denied generic/318 1s generic/319 1s generic/321 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/322 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/324 [not run] defragmentation not supported for fstype "ceph" generic/325 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/326 [not run] Reflink not supported by scratch filesystem type: ceph generic/327 [not run] Reflink not supported by scratch filesystem type: ceph generic/328 [not run] Reflink not supported by scratch filesystem type: ceph generic/329 [not run] Reflink not supported by scratch filesystem type: ceph generic/330 [not run] Reflink not supported by scratch filesystem type: ceph generic/331 [not run] Reflink not supported by scratch filesystem type: ceph generic/332 [not run] Reflink not supported by scratch filesystem type: ceph generic/335 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/336 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/337 1s generic/338 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/341 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/342 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/343 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/346 253s generic/347 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/348 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/353 [not run] Reflink not supported by scratch filesystem type: ceph generic/355 1s generic/356 [not run] swapfiles are not supported generic/357 [not run] swapfiles are not supported generic/358 [not run] Reflink not supported by scratch filesystem type: ceph generic/359 [not run] Reflink not supported by scratch filesystem type: ceph generic/360 1s generic/361 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/362 [not run] this test requires richacl support on $SCRATCH_DEV generic/363 [not run] this test requires richacl support on $SCRATCH_DEV generic/364 [not run] this test requires richacl support on $SCRATCH_DEV generic/365 [not run] this test requires richacl support on $SCRATCH_DEV generic/366 [not run] this test requires richacl support on $SCRATCH_DEV generic/367 [not run] this test requires richacl support on $SCRATCH_DEV generic/368 [not run] this test requires richacl support on $SCRATCH_DEV generic/369 [not run] this test requires richacl support on $SCRATCH_DEV generic/370 [not run] this test requires richacl support on $SCRATCH_DEV generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/372 [not run] Reflink not supported by scratch filesystem type: ceph generic/373 [not run] Reflink not supported by scratch filesystem type: ceph generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph generic/375 1s generic/376 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/377 1s generic/378 1s generic/379 [not run] disk quotas not supported by this filesystem type: ceph generic/380 [not run] disk quotas not supported by this filesystem type: ceph generic/381 [not run] disk quotas not supported by this filesystem type: ceph generic/382 [not run] disk quotas not supported by this filesystem type: ceph generic/383 [not run] disk quotas not supported by this filesystem type: ceph generic/384 [not run] disk quotas not supported by this filesystem type: ceph generic/385 [not run] disk quotas not supported by this filesystem type: ceph generic/386 [not run] disk quotas not supported by this filesystem type: ceph generic/389 [not run] O_TMPFILE is not supported generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/392 [not run] ceph does not support shutdown generic/393 2s generic/394 1s generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test generic/400 [not run] disk quotas not supported by this filesystem type: ceph generic/401 1s generic/402 [not run] filesystem ceph timestamp bounds are unknown generic/403 2s generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/406 4s generic/407 [not run] Reflink not supported by test filesystem type: ceph generic/408 [not run] Dedupe not supported by test filesystem type: ceph generic/409 [not run] require 172.21.15.40:6789:/scratch to be local device generic/410 [not run] require 172.21.15.40:6789:/scratch to be local device generic/411 [not run] require 172.21.15.40:6789:/scratch to be local device generic/412 2s generic/413 [not run] mount 172.21.15.40:6789:/scratch with dax failed generic/414 [not run] Reflink not supported by scratch filesystem type: ceph generic/417 [not run] ceph does not support shutdown generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/423 0s generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) generic/426 23s generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/428 0s generic/430 1s generic/431 0s generic/432 1s generic/433 1s generic/434 0s generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/437 1s generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test generic/441 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/443 0s generic/444 1s generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/448 1s generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/450 5s generic/451 30s generic/452 2s generic/453 [not run] ceph does not allow unrestricted byte streams for names generic/454 [not run] ceph does not allow unrestricted byte streams for names generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/458 [not run] Reflink not supported by scratch filesystem type: ceph generic/460 284s generic/462 [not run] mount 172.21.15.40:6789:/scratch with dax failed generic/463 [not run] Reflink not supported by test filesystem type: ceph generic/465 7s generic/466 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/467 3s generic/468 [not run] ceph does not support shutdown generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/470 [not run] This test requires a valid $LOGWRITES_DEV generic/471 39s generic/472 [not run] swapfiles are not supported generic/474 [not run] ceph does not support shutdown generic/477 6s generic/478 13s generic/479 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/480 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/481 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/483 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/484 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/486 1s generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized generic/489 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/490 1s generic/491 [not run] ceph does not support freezing generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) generic/493 [not run] swapfiles are not supported generic/494 [not run] swapfiles are not supported generic/495 [not run] swapfiles are not supported generic/496 [not run] swapfiles are not supported generic/497 [not run] swapfiles are not supported generic/498 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/501 [not run] Reflink not supported by scratch filesystem type: ceph generic/502 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/504 0s generic/505 [not run] ceph does not support shutdown generic/506 [not run] disk quotas not supported by this filesystem type: ceph generic/507 [not run] file system doesn't support chattr +ASai generic/508 [not run] lsattr not supported by test filesystem type: ceph generic/509 [not run] O_TMPFILE is not supported generic/510 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/513 [not run] Reflink not supported by scratch filesystem type: ceph generic/514 [not run] Reflink not supported by scratch filesystem type: ceph generic/515 [not run] Reflink not supported by scratch filesystem type: ceph generic/516 [not run] Dedupe not supported by test filesystem type: ceph generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph generic/518 [not run] Reflink not supported by scratch filesystem type: ceph generic/519 [not run] FIBMAP not supported by this filesystem generic/520 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/523 1s generic/524 227s generic/525 [not run] filesystem does not support huge file size generic/526 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/527 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/528 0s generic/529 1s generic/530 [not run] ceph does not support shutdown generic/531 [not run] O_TMPFILE is not supported generic/532 0s generic/533 1s generic/534 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/535 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/536 [not run] ceph does not support shutdown generic/537 [not run] FSTRIM not supported generic/538 871s generic/539 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/540 [not run] Reflink not supported by scratch filesystem type: ceph generic/541 [not run] Reflink not supported by scratch filesystem type: ceph generic/542 [not run] Reflink not supported by scratch filesystem type: ceph generic/543 [not run] Reflink not supported by scratch filesystem type: ceph generic/544 [not run] Reflink not supported by scratch filesystem type: ceph generic/545 [not run] file system doesn't support chattr +i generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/547 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/548 [not run] mount option "test_dummy_encryption" not allowed in this test generic/549 [not run] mount option "test_dummy_encryption" not allowed in this test generic/550 [not run] mount option "test_dummy_encryption" not allowed in this test generic/552 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) generic/554 [not run] swapfiles are not supported generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) generic/556 [not run] ceph does not support casefold feature generic/557 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/563 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/564 0s generic/565 1s generic/566 [not run] disk quotas not supported by this filesystem type: ceph generic/567 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/570 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/571 [not run] Require fcntl setlease support generic/572 [not run] fsverity utility required, skipped this test generic/573 [not run] fsverity utility required, skipped this test generic/574 [not run] fsverity utility required, skipped this test generic/575 [not run] fsverity utility required, skipped this test generic/576 [not run] fsverity utility required, skipped this test generic/577 [not run] fsverity utility required, skipped this test generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) generic/580 [not run] mount option "test_dummy_encryption" not allowed in this test generic/581 [not run] mount option "test_dummy_encryption" not allowed in this test generic/582 [not run] mount option "test_dummy_encryption" not allowed in this test generic/583 [not run] mount option "test_dummy_encryption" not allowed in this test generic/584 [not run] mount option "test_dummy_encryption" not allowed in this test generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/587 [not run] disk quotas not supported by this filesystem type: ceph generic/588 [not run] Reflink not supported by scratch filesystem type: ceph generic/591 0s generic/592 [not run] mount option "test_dummy_encryption" not allowed in this test generic/593 [not run] mount option "test_dummy_encryption" not allowed in this test generic/594 [not run] disk quotas not supported by this filesystem type: ceph generic/595 [not run] mount option "test_dummy_encryption" not allowed in this test generic/596 [not run] file system doesn't support chattr +S generic/597 1s generic/598 2s generic/599 [not run] ceph does not support shutdown generic/600 [not run] disk quotas not supported by this filesystem type: ceph generic/601 [not run] disk quotas not supported by this filesystem type: ceph generic/602 [not run] mount option "test_dummy_encryption" not allowed in this test generic/603 [not run] disk quotas not supported by this filesystem type: ceph generic/604 6s generic/605 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed generic/606 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) generic/608 [not run] mount 172.21.15.40:6789:/scratch with dax=always failed generic/609 0s generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/611 1s generic/612 [not run] Reflink not supported by test filesystem type: ceph generic/613 [not run] mount option "test_dummy_encryption" not allowed in this test generic/614 [not run] test requires delayed allocation buffered writes generic/618 1s generic/620 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/621 [not run] mount option "test_dummy_encryption" not allowed in this test generic/623 [not run] ceph does not support shutdown generic/624 [not run] fsverity utility required, skipped this test generic/625 [not run] fsverity utility required, skipped this test generic/626 [not run] kernel doesn't support renameat2 syscall generic/628 [not run] Reflink not supported by scratch filesystem type: ceph generic/629 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph generic/632 2s generic/633 1s generic/634 2s generic/635 [not run] ceph does not support shutdown generic/636 [not run] swapfiles are not supported generic/637 1s generic/638 0s generic/639 1s generic/640 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/641 [not run] swapfiles are not supported generic/644 1s generic/645 155s generic/646 [not run] ceph does not support shutdown generic/647 1s generic/651 [not run] Reflink not supported by scratch filesystem type: ceph generic/652 [not run] Reflink not supported by scratch filesystem type: ceph generic/653 [not run] Reflink not supported by scratch filesystem type: ceph generic/654 [not run] Reflink not supported by scratch filesystem type: ceph generic/655 [not run] Reflink not supported by scratch filesystem type: ceph generic/657 [not run] Reflink not supported by scratch filesystem type: ceph generic/658 [not run] Reflink not supported by scratch filesystem type: ceph generic/659 [not run] Reflink not supported by scratch filesystem type: ceph generic/660 [not run] Reflink not supported by scratch filesystem type: ceph generic/661 [not run] Reflink not supported by scratch filesystem type: ceph generic/662 [not run] Reflink not supported by scratch filesystem type: ceph generic/663 [not run] Reflink not supported by scratch filesystem type: ceph generic/664 [not run] Reflink not supported by scratch filesystem type: ceph generic/665 [not run] Reflink not supported by scratch filesystem type: ceph generic/666 [not run] Reflink not supported by scratch filesystem type: ceph generic/667 [not run] Reflink not supported by scratch filesystem type: ceph generic/668 [not run] Reflink not supported by scratch filesystem type: ceph generic/669 [not run] Reflink not supported by scratch filesystem type: ceph generic/673 [not run] Reflink not supported by scratch filesystem type: ceph generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph generic/675 [not run] Reflink not supported by scratch filesystem type: ceph generic/676 809s generic/677 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/678 [not run] kernel does not support IO_URING generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/680 1s generic/681 [not run] disk quotas not supported by this filesystem type: ceph generic/682 [not run] disk quotas not supported by this filesystem type: ceph generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/684 [not run] xfs_io fpunch failed (old kernel/wrong fs?) generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) generic/689 0s generic/690 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/692 [not run] fsverity utility required, skipped this test generic/693 [not run] mount option "test_dummy_encryption" not allowed in this test generic/695 [not run] require 172.21.15.40:6789:/scratch to be valid block disk generic/696 1s generic/697 1s generic/698 2s generic/699 [not run] overlayfs doesn't support idmappped layers generic/700 [not run] kernel doesn't support renameat2 syscall generic/702 [not run] Reflink not supported by scratch filesystem type: ceph generic/703 [not run] kernel does not support IO_URING generic/704 [not run] require 172.21.15.40:6789:/test to be valid block disk generic/706 1s generic/708 1s generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph generic/721 [not run] xfs_io startupdate support is missing generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph generic/728 4s generic/729 1s generic/730 [not run] require 172.21.15.40:6789:/test to be valid block disk generic/731 [not run] require 172.21.15.40:6789:/test to be valid block disk generic/732 1s shared/002 [not run] not suitable for this filesystem type: ceph shared/032 [not run] not suitable for this filesystem type: ceph Ran: ceph/002 ceph/003 ceph/004 ceph/005 generic/001 generic/002 generic/003 generic/004 generic/005 generic/006 generic/007 generic/008 generic/009 generic/011 generic/012 generic/013 generic/014 generic/015 generic/016 generic/018 generic/020 generic/021 generic/022 generic/023 generic/024 generic/025 generic/026 generic/028 generic/029 generic/030 generic/031 generic/032 generic/033 generic/034 generic/035 generic/037 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/053 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/062 generic/063 generic/064 generic/065 generic/066 generic/067 generic/069 generic/070 generic/071 generic/073 generic/075 generic/076 generic/078 generic/079 generic/080 generic/081 generic/082 generic/084 generic/086 generic/087 generic/088 generic/090 generic/091 generic/092 generic/094 generic/096 generic/097 generic/098 generic/099 generic/101 generic/103 generic/104 generic/105 generic/106 generic/107 generic/108 generic/110 generic/111 generic/112 generic/113 generic/114 generic/115 generic/116 generic/117 generic/118 generic/119 generic/120 generic/121 generic/122 generic/123 generic/124 generic/126 generic/128 generic/129 generic/130 generic/131 generic/134 generic/135 generic/136 generic/138 generic/139 generic/140 generic/141 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/169 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/184 generic/185 generic/188 generic/189 generic/190 generic/191 generic/193 generic/194 generic/195 generic/196 generic/197 generic/198 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/207 generic/210 generic/211 generic/212 generic/213 generic/214 generic/215 generic/216 generic/217 generic/218 generic/219 generic/220 generic/221 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/236 generic/237 generic/238 generic/240 generic/244 generic/245 generic/246 generic/247 generic/248 generic/249 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/257 generic/258 generic/259 generic/260 generic/261 generic/262 generic/263 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/294 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/306 generic/307 generic/308 generic/309 generic/312 generic/313 generic/314 generic/315 generic/316 generic/317 generic/318 generic/319 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/337 generic/338 generic/341 generic/342 generic/343 generic/346 generic/347 generic/348 generic/353 generic/355 generic/356 generic/357 generic/358 generic/359 generic/360 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/375 generic/376 generic/377 generic/378 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/393 generic/394 generic/395 generic/396 generic/397 generic/398 generic/400 generic/401 generic/402 generic/403 generic/404 generic/406 generic/407 generic/408 generic/409 generic/410 generic/411 generic/412 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/423 generic/424 generic/425 generic/426 generic/427 generic/428 generic/430 generic/431 generic/432 generic/433 generic/434 generic/436 generic/437 generic/439 generic/440 generic/441 generic/443 generic/444 generic/445 generic/446 generic/448 generic/449 generic/450 generic/451 generic/452 generic/453 generic/454 generic/456 generic/458 generic/460 generic/462 generic/463 generic/465 generic/466 generic/467 generic/468 generic/469 generic/470 generic/471 generic/472 generic/474 generic/477 generic/478 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/486 generic/487 generic/488 generic/489 generic/490 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/504 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/523 generic/524 generic/525 generic/526 generic/527 generic/528 generic/529 generic/530 generic/531 generic/532 generic/533 generic/534 generic/535 generic/536 generic/537 generic/538 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/564 generic/565 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/591 generic/592 generic/593 generic/594 generic/595 generic/596 generic/597 generic/598 generic/599 generic/600 generic/601 generic/602 generic/603 generic/604 generic/605 generic/606 generic/607 generic/608 generic/609 generic/610 generic/611 generic/612 generic/613 generic/614 generic/618 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/632 generic/633 generic/634 generic/635 generic/636 generic/637 generic/638 generic/639 generic/640 generic/641 generic/644 generic/645 generic/646 generic/647 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/676 generic/677 generic/678 generic/679 generic/680 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/689 generic/690 generic/692 generic/693 generic/695 generic/696 generic/697 generic/698 generic/699 generic/700 generic/702 generic/703 generic/704 generic/706 generic/708 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/728 generic/729 generic/730 generic/731 generic/732 shared/002 shared/032 Not run: ceph/002 ceph/003 ceph/005 generic/003 generic/004 generic/008 generic/009 generic/012 generic/015 generic/016 generic/018 generic/021 generic/022 generic/024 generic/025 generic/026 generic/031 generic/032 generic/033 generic/034 generic/039 generic/040 generic/041 generic/042 generic/050 generic/052 generic/056 generic/057 generic/058 generic/059 generic/060 generic/061 generic/063 generic/064 generic/065 generic/066 generic/067 generic/071 generic/073 generic/076 generic/078 generic/079 generic/081 generic/082 generic/086 generic/090 generic/092 generic/094 generic/096 generic/101 generic/103 generic/104 generic/106 generic/107 generic/108 generic/110 generic/111 generic/114 generic/115 generic/116 generic/118 generic/119 generic/120 generic/121 generic/122 generic/134 generic/136 generic/138 generic/139 generic/140 generic/142 generic/143 generic/144 generic/145 generic/146 generic/147 generic/148 generic/149 generic/150 generic/151 generic/152 generic/153 generic/154 generic/155 generic/156 generic/157 generic/158 generic/159 generic/160 generic/161 generic/162 generic/163 generic/171 generic/172 generic/173 generic/174 generic/177 generic/178 generic/179 generic/180 generic/181 generic/182 generic/183 generic/185 generic/188 generic/189 generic/190 generic/191 generic/194 generic/195 generic/196 generic/197 generic/199 generic/200 generic/201 generic/202 generic/203 generic/205 generic/206 generic/213 generic/214 generic/216 generic/217 generic/218 generic/219 generic/220 generic/222 generic/223 generic/225 generic/227 generic/228 generic/229 generic/230 generic/235 generic/238 generic/244 generic/250 generic/252 generic/253 generic/254 generic/255 generic/256 generic/258 generic/259 generic/260 generic/261 generic/262 generic/264 generic/265 generic/266 generic/267 generic/268 generic/271 generic/272 generic/276 generic/277 generic/278 generic/279 generic/281 generic/282 generic/283 generic/284 generic/286 generic/287 generic/288 generic/289 generic/290 generic/291 generic/292 generic/293 generic/295 generic/296 generic/301 generic/302 generic/303 generic/304 generic/305 generic/312 generic/315 generic/316 generic/321 generic/322 generic/324 generic/325 generic/326 generic/327 generic/328 generic/329 generic/330 generic/331 generic/332 generic/335 generic/336 generic/338 generic/341 generic/342 generic/343 generic/347 generic/348 generic/353 generic/356 generic/357 generic/358 generic/359 generic/361 generic/362 generic/363 generic/364 generic/365 generic/366 generic/367 generic/368 generic/369 generic/370 generic/371 generic/372 generic/373 generic/374 generic/376 generic/379 generic/380 generic/381 generic/382 generic/383 generic/384 generic/385 generic/386 generic/389 generic/391 generic/392 generic/395 generic/396 generic/397 generic/398 generic/400 generic/402 generic/404 generic/407 generic/408 generic/409 generic/410 generic/411 generic/413 generic/414 generic/417 generic/419 generic/420 generic/421 generic/422 generic/424 generic/425 generic/427 generic/436 generic/439 generic/440 generic/441 generic/445 generic/446 generic/449 generic/453 generic/454 generic/456 generic/458 generic/462 generic/463 generic/466 generic/468 generic/469 generic/470 generic/472 generic/474 generic/479 generic/480 generic/481 generic/483 generic/484 generic/485 generic/487 generic/488 generic/489 generic/491 generic/492 generic/493 generic/494 generic/495 generic/496 generic/497 generic/498 generic/499 generic/501 generic/502 generic/503 generic/505 generic/506 generic/507 generic/508 generic/509 generic/510 generic/511 generic/512 generic/513 generic/514 generic/515 generic/516 generic/517 generic/518 generic/519 generic/520 generic/525 generic/526 generic/527 generic/530 generic/531 generic/534 generic/535 generic/536 generic/537 generic/539 generic/540 generic/541 generic/542 generic/543 generic/544 generic/545 generic/546 generic/547 generic/548 generic/549 generic/550 generic/552 generic/553 generic/554 generic/555 generic/556 generic/557 generic/563 generic/566 generic/567 generic/568 generic/569 generic/570 generic/571 generic/572 generic/573 generic/574 generic/575 generic/576 generic/577 generic/578 generic/580 generic/581 generic/582 generic/583 generic/584 generic/586 generic/587 generic/588 generic/592 generic/593 generic/594 generic/595 generic/596 generic/599 generic/600 generic/601 generic/602 generic/603 generic/605 generic/606 generic/607 generic/608 generic/610 generic/612 generic/613 generic/614 generic/620 generic/621 generic/623 generic/624 generic/625 generic/626 generic/628 generic/629 generic/630 generic/635 generic/636 generic/640 generic/641 generic/646 generic/651 generic/652 generic/653 generic/654 generic/655 generic/657 generic/658 generic/659 generic/660 generic/661 generic/662 generic/663 generic/664 generic/665 generic/666 generic/667 generic/668 generic/669 generic/673 generic/674 generic/675 generic/677 generic/678 generic/679 generic/681 generic/682 generic/683 generic/684 generic/685 generic/686 generic/687 generic/688 generic/690 generic/692 generic/693 generic/695 generic/699 generic/700 generic/702 generic/703 generic/704 generic/709 generic/710 generic/711 generic/712 generic/713 generic/714 generic/715 generic/716 generic/717 generic/718 generic/719 generic/720 generic/721 generic/722 generic/723 generic/724 generic/725 generic/726 generic/727 generic/730 generic/731 shared/002 shared/032 Failures: generic/317 Failed 1 of 598 tests 2023-12-20T06:04:46.203 INFO:tasks.cephfs.test_fscrypt:Command stderr - 2023-12-20T06:04:46.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo userdel --force --remove fsgqa 2023-12-20T06:04:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:userdel: user fsgqa is currently used by process 307136 2023-12-20T06:04:47.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo userdel --force --remove 123456-fsgqa 2023-12-20T06:04:47.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo groupdel fsgqa 2023-12-20T06:04:47.856 INFO:teuthology.orchestra.run.smithi081.stderr:groupdel: group 'fsgqa' does not exist 2023-12-20T06:04:47.860 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-12-20T06:04:47.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:47.861 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.utfXGGFva6xfstests-dev/results) 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: File: /tmp/tmp.utfXGGFva6xfstests-dev/results 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 801h/2049d Inode: 547713 Links: 5 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-12-20 04:29:36.757752459 +0000 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-12-20 06:04:45.522235036 +0000 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-12-20 06:04:45.522235036 +0000 2023-12-20T06:04:47.949 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2023-12-20 04:29:36.757752459 +0000 2023-12-20T06:04:47.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:47.953 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-12-20T06:04:48.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:48.045 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.utfXGGFva6xfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-12-20T06:04:48.532 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.utfXGGFva6xfstests-dev to /var/log/ceph. 2023-12-20T06:04:48.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf /tmp/tmp.utfXGGFva6xfstests-dev 2023-12-20T06:04:49.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf /tmp/tmp.GopArGmA0Mxfsprogs-dev 2023-12-20T06:04:49.286 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T06:04:49.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T06:04:49.467 DEBUG:teuthology.orchestra.run.smithi069:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T06:04:49.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T06:04:49.695 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T06:04:49.695 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T06:04:49.696 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T06:04:49.760 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T06:04:49.760 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T06:04:49.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T06:04:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.161+0000 7fb374269640 1 Processor -- start 2023-12-20T06:04:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.161+0000 7fb374269640 1 -- start start 2023-12-20T06:04:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb374269640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb36c0bcdd0 0x7fb36c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb374269640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb374269640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36c0bc6b0 con 0x7fb36c144cd0 2023-12-20T06:04:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb374269640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36c0b6900 con 0x7fb36c0bcdd0 2023-12-20T06:04:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb374269640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c0a59f0 con 0x7fb36c0b64c0 2023-12-20T06:04:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb372806640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb36c144cd0 0x7fb36c14e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44056/0 (socket says 172.21.15.40:44056) 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb372806640 1 -- 172.21.15.40:0/399780126 learned_addr learned my addr 172.21.15.40:0/399780126 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb372005640 1 --2- 172.21.15.40:0/399780126 >> v2:172.21.15.69:3300/0 conn(0x7fb36c0bcdd0 0x7fb36c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb371804640 1 --2- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb371003640 1 -- 172.21.15.40:0/399780126 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565340408 0 0) 0x7fb36c0bc6b0 con 0x7fb36c144cd0 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.162+0000 7fb371003640 1 -- 172.21.15.40:0/399780126 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb358003520 con 0x7fb36c144cd0 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.163+0000 7fb372005640 1 -- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 msgr2=0x7fb36c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.163+0000 7fb372005640 1 --2- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.163+0000 7fb372005640 1 -- 172.21.15.40:0/399780126 >> v1:172.21.15.40:6789/0 conn(0x7fb36c144cd0 legacy=0x7fb36c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.163+0000 7fb372005640 1 -- 172.21.15.40:0/399780126 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0bc0a0 con 0x7fb36c0bcdd0 2023-12-20T06:04:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.163+0000 7fb371804640 1 --2- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T06:04:50.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.164+0000 7fb372005640 1 --2- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 0x7fb36c0b5f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb3680097a0 tx=0x7fb36802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0caecc791d7aa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.164+0000 7fb371003640 1 -- 172.21.15.40:0/399780126 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368030610 con 0x7fb36c0bcdd0 2023-12-20T06:04:50.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.164+0000 7fb371003640 1 -- 172.21.15.40:0/399780126 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368030770 con 0x7fb36c0bcdd0 2023-12-20T06:04:50.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.164+0000 7fb371003640 1 -- 172.21.15.40:0/399780126 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368030b00 con 0x7fb36c0bcdd0 2023-12-20T06:04:50.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.164+0000 7fb374269640 1 -- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 msgr2=0x7fb36c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.164+0000 7fb374269640 1 --2- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 0x7fb36c0b5f80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb3680097a0 tx=0x7fb36802b960 comp rx=0 tx=0).stop 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.165+0000 7fb374269640 1 -- 172.21.15.40:0/399780126 shutdown_connections 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.165+0000 7fb374269640 1 --2- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.165+0000 7fb374269640 1 --2- 172.21.15.40:0/399780126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 0x7fb36c0b5f80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.165+0000 7fb374269640 1 -- 172.21.15.40:0/399780126 >> 172.21.15.40:0/399780126 conn(0x7fb36c071e60 msgr2=0x7fb36c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.165+0000 7fb374269640 1 -- 172.21.15.40:0/399780126 shutdown_connections 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.165+0000 7fb374269640 1 -- 172.21.15.40:0/399780126 wait complete. 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.166+0000 7fb374269640 1 Processor -- start 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.166+0000 7fb374269640 1 -- start start 2023-12-20T06:04:50.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb374269640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c1d2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb374269640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 0x7fb36c147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb374269640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb36c144cd0 0x7fb36c1477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb374269640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1d2880 con 0x7fb36c144cd0 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb374269640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1d4740 con 0x7fb36c0bcdd0 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb374269640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c1d30d0 con 0x7fb36c0b64c0 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb36c144cd0 0x7fb36c1477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372005640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c1d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb36c144cd0 0x7fb36c1477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53728/0 (socket says 172.21.15.40:53728) 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 -- 172.21.15.40:0/290714254 learned_addr learned my addr 172.21.15.40:0/290714254 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:50.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb371804640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 0x7fb36c147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 -- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 msgr2=0x7fb36c1d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c1d2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 -- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 msgr2=0x7fb36c147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 0x7fb36c147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 -- 172.21.15.40:0/290714254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c009400 con 0x7fb36c144cd0 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb372806640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb36c144cd0 0x7fb36c1477a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb36400caa0 tx=0x7fb36400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.167+0000 7fb362ffd640 1 -- 172.21.15.40:0/290714254 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36400ac00 con 0x7fb36c144cd0 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.168+0000 7fb362ffd640 1 -- 172.21.15.40:0/290714254 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36400ad60 con 0x7fb36c144cd0 2023-12-20T06:04:50.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.168+0000 7fb362ffd640 1 -- 172.21.15.40:0/290714254 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb364012620 con 0x7fb36c144cd0 2023-12-20T06:04:50.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.168+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb368009400 con 0x7fb36c144cd0 2023-12-20T06:04:50.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.168+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c1d4460 con 0x7fb36c144cd0 2023-12-20T06:04:50.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.169+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c04e840 con 0x7fb36c144cd0 2023-12-20T06:04:50.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.169+0000 7fb362ffd640 1 -- 172.21.15.40:0/290714254 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb364007070 con 0x7fb36c144cd0 2023-12-20T06:04:50.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.170+0000 7fb362ffd640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb35006a430 0x7fb35006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.170+0000 7fb362ffd640 1 -- 172.21.15.40:0/290714254 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb364088860 con 0x7fb36c144cd0 2023-12-20T06:04:50.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.170+0000 7fb372005640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb35006a430 0x7fb35006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.171+0000 7fb372005640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb35006a430 0x7fb35006c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb368036000 tx=0x7fb368008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.175+0000 7fb362ffd640 1 -- 172.21.15.40:0/290714254 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb364053f00 con 0x7fb36c144cd0 2023-12-20T06:04:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.352+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb36c0b9120 con 0x7fb36c144cd0 2023-12-20T06:04:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.353+0000 7fb362ffd640 1 -- 172.21.15.40:0/290714254 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7fb364017020 con 0x7fb36c144cd0 2023-12-20T06:04:50.355 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:50.355 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:24:06.929899+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:24:03.672943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:24:04.910865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb35006a430 msgr2=0x7fb35006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb35006a430 0x7fb35006c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb368036000 tx=0x7fb368008030 comp rx=0 tx=0).stop 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb36c144cd0 msgr2=0x7fb36c1477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb36c144cd0 0x7fb36c1477a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb36400caa0 tx=0x7fb36400cf60 comp rx=0 tx=0).stop 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 shutdown_connections 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb35006a430 0x7fb35006c8f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb36c144cd0 0x7fb36c1477a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb36c0bcdd0 0x7fb36c147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 --2- 172.21.15.40:0/290714254 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb36c0b64c0 0x7fb36c1d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 >> 172.21.15.40:0/290714254 conn(0x7fb36c071e60 msgr2=0x7fb36c0b8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 shutdown_connections 2023-12-20T06:04:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.355+0000 7fb374269640 1 -- 172.21.15.40:0/290714254 wait complete. 2023-12-20T06:04:50.368 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:24:03.672943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:24:04.910865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T06:04:50.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T06:04:50.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.478+0000 7f95e72af640 1 Processor -- start 2023-12-20T06:04:50.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.478+0000 7f95e72af640 1 -- start start 2023-12-20T06:04:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e72af640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f95e006a950 0x7f95e00be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e72af640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e00bfa50 con 0x7f95e00bb140 2023-12-20T06:04:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e72af640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e006b040 con 0x7f95e00bf510 2023-12-20T06:04:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e72af640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e00bbda0 con 0x7f95e006a950 2023-12-20T06:04:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e504b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f95e00bb140 0x7f95e00bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44060/0 (socket says 172.21.15.40:44060) 2023-12-20T06:04:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e504b640 1 -- 172.21.15.40:0/2489307396 learned_addr learned my addr 172.21.15.40:0/2489307396 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:50.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e584c640 1 --2- 172.21.15.40:0/2489307396 >> v2:172.21.15.69:3300/0 conn(0x7f95e006a950 0x7f95e00be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95d7fff640 1 -- 172.21.15.40:0/2489307396 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036242255 0 0) 0x7f95e00bfa50 con 0x7f95e00bb140 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95d7fff640 1 -- 172.21.15.40:0/2489307396 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95cc003520 con 0x7f95e00bb140 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95d7fff640 1 -- 172.21.15.40:0/2489307396 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756399721 0 0) 0x7f95e006b040 con 0x7f95e00bf510 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95d7fff640 1 -- 172.21.15.40:0/2489307396 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e00bfa50 con 0x7f95e00bf510 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e584c640 1 -- 172.21.15.40:0/2489307396 >> v1:172.21.15.69:6789/0 conn(0x7f95e00bf510 legacy=0x7f95e01534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e584c640 1 -- 172.21.15.40:0/2489307396 >> v1:172.21.15.40:6789/0 conn(0x7f95e00bb140 legacy=0x7f95e00bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.479+0000 7f95e584c640 1 -- 172.21.15.40:0/2489307396 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00bb520 con 0x7f95e006a950 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.480+0000 7f95e584c640 1 --2- 172.21.15.40:0/2489307396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e006a950 0x7f95e00be350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009d90 tx=0x7f95d802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5355c0aaf89033f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.480+0000 7f95d7fff640 1 -- 172.21.15.40:0/2489307396 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d802cd00 con 0x7f95e006a950 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.480+0000 7f95d7fff640 1 -- 172.21.15.40:0/2489307396 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d802ce60 con 0x7f95e006a950 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.480+0000 7f95d7fff640 1 -- 172.21.15.40:0/2489307396 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8034640 con 0x7f95e006a950 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.481+0000 7f95e72af640 1 -- 172.21.15.40:0/2489307396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e006a950 msgr2=0x7f95e00be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.481+0000 7f95e72af640 1 --2- 172.21.15.40:0/2489307396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e006a950 0x7f95e00be350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009d90 tx=0x7f95d802bf50 comp rx=0 tx=0).stop 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.481+0000 7f95e72af640 1 -- 172.21.15.40:0/2489307396 shutdown_connections 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.481+0000 7f95e72af640 1 --2- 172.21.15.40:0/2489307396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e006a950 0x7f95e00be350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.481+0000 7f95e72af640 1 -- 172.21.15.40:0/2489307396 >> 172.21.15.40:0/2489307396 conn(0x7f95e00bcfd0 msgr2=0x7f95e00bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.481+0000 7f95e72af640 1 -- 172.21.15.40:0/2489307396 shutdown_connections 2023-12-20T06:04:50.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.481+0000 7f95e72af640 1 -- 172.21.15.40:0/2489307396 wait complete. 2023-12-20T06:04:50.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.482+0000 7f95e72af640 1 Processor -- start 2023-12-20T06:04:50.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.482+0000 7f95e72af640 1 -- start start 2023-12-20T06:04:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e72af640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e006a950 0x7f95e01460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e72af640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f95e00bb140 0x7f95e014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e72af640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e00bf510 0x7f95e014ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e72af640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00a2b00 con 0x7f95e006a950 2023-12-20T06:04:50.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e72af640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0146e40 con 0x7f95e00bf510 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e72af640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00b3450 con 0x7f95e00bb140 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e006a950 0x7f95e01460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e006a950 0x7f95e01460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53744/0 (socket says 172.21.15.40:53744) 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 -- 172.21.15.40:0/1568185337 learned_addr learned my addr 172.21.15.40:0/1568185337 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e484a640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f95e00bb140 0x7f95e014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e584c640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e00bf510 0x7f95e014ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 -- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f95e00bb140 msgr2=0x7f95e014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f95e00bb140 0x7f95e014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 -- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e00bf510 msgr2=0x7f95e014ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e00bf510 0x7f95e014ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 -- 172.21.15.40:0/1568185337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8009a70 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e504b640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e006a950 0x7f95e01460d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c500 tx=0x7f95dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95d5ffb640 1 -- 172.21.15.40:0/1568185337 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc005ce0 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95d5ffb640 1 -- 172.21.15.40:0/1568185337 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc005e40 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e0146610 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.483+0000 7f95d5ffb640 1 -- 172.21.15.40:0/1568185337 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0072f0 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.484+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e01df8d0 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.484+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e01469a0 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.485+0000 7f95d5ffb640 1 -- 172.21.15.40:0/1568185337 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95dc007450 con 0x7f95e006a950 2023-12-20T06:04:50.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.485+0000 7f95d5ffb640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f95c406a430 0x7f95c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.485+0000 7f95d5ffb640 1 -- 172.21.15.40:0/1568185337 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95dc087f10 con 0x7f95e006a950 2023-12-20T06:04:50.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.485+0000 7f95e484a640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f95c406a430 0x7f95c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.486+0000 7f95e484a640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f95c406a430 0x7f95c406c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f95e006b220 tx=0x7f95d0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.489+0000 7f95d5ffb640 1 -- 172.21.15.40:0/1568185337 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f95dc056fb0 con 0x7f95e006a950 2023-12-20T06:04:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.664+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95e01467a0 con 0x7f95e006a950 2023-12-20T06:04:50.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.664+0000 7f95d5ffb640 1 -- 172.21.15.40:0/1568185337 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95e01467a0 con 0x7f95e006a950 2023-12-20T06:04:50.666 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T06:04:50.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f95c406a430 msgr2=0x7f95c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f95c406a430 0x7f95c406c8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f95e006b220 tx=0x7f95d0009040 comp rx=0 tx=0).stop 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e006a950 msgr2=0x7f95e01460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e006a950 0x7f95e01460d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00c500 tx=0x7f95dc00c9c0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 shutdown_connections 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f95c406a430 0x7f95c406c8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e00bf510 0x7f95e014ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f95e00bb140 0x7f95e014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 --2- 172.21.15.40:0/1568185337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95e006a950 0x7f95e01460d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 >> 172.21.15.40:0/1568185337 conn(0x7f95e00bcfd0 msgr2=0x7f95e00a5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 shutdown_connections 2023-12-20T06:04:50.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.666+0000 7f95e72af640 1 -- 172.21.15.40:0/1568185337 wait complete. 2023-12-20T06:04:50.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T06:04:50.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.787+0000 7f916408f640 1 Processor -- start 2023-12-20T06:04:50.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.787+0000 7f916408f640 1 -- start start 2023-12-20T06:04:50.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916408f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f915c06a950 0x7f915c0be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916408f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c0bfa50 con 0x7f915c0bf510 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916408f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c06b040 con 0x7f915c0bb140 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916408f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915c0bbda0 con 0x7f915c06a950 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916262c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f915c06a950 0x7f915c0be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916262c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f915c06a950 0x7f915c0be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53756/0 (socket says 172.21.15.40:53756) 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916262c640 1 -- 172.21.15.40:0/2972034472 learned_addr learned my addr 172.21.15.40:0/2972034472 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916162a640 1 --1- 172.21.15.40:0/2972034472 >> v1:172.21.15.40:6789/0 conn(0x7f915c0bf510 0x7f915c1534f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44068/0 (socket says 172.21.15.40:44068) 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916262c640 1 -- 172.21.15.40:0/2972034472 >> v1:172.21.15.69:6789/0 conn(0x7f915c0bb140 legacy=0x7f915c0bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:50.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916262c640 1 -- 172.21.15.40:0/2972034472 >> v1:172.21.15.40:6789/0 conn(0x7f915c0bf510 legacy=0x7f915c1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.788+0000 7f916262c640 1 -- 172.21.15.40:0/2972034472 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0bb520 con 0x7f915c06a950 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.789+0000 7f916262c640 1 --2- 172.21.15.40:0/2972034472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c06a950 0x7f915c0be350 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9154009e50 tx=0x7f915402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef282f6331e12311 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.789+0000 7f9160e29640 1 -- 172.21.15.40:0/2972034472 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915402cb20 con 0x7f915c06a950 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.789+0000 7f9160e29640 1 -- 172.21.15.40:0/2972034472 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915402cc80 con 0x7f915c06a950 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.789+0000 7f9160e29640 1 -- 172.21.15.40:0/2972034472 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540343f0 con 0x7f915c06a950 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.789+0000 7f916408f640 1 -- 172.21.15.40:0/2972034472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c06a950 msgr2=0x7f915c0be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.789+0000 7f916408f640 1 --2- 172.21.15.40:0/2972034472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c06a950 0x7f915c0be350 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9154009e50 tx=0x7f915402bf80 comp rx=0 tx=0).stop 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.789+0000 7f916408f640 1 -- 172.21.15.40:0/2972034472 shutdown_connections 2023-12-20T06:04:50.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.790+0000 7f916408f640 1 --2- 172.21.15.40:0/2972034472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c06a950 0x7f915c0be350 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.790+0000 7f916408f640 1 -- 172.21.15.40:0/2972034472 >> 172.21.15.40:0/2972034472 conn(0x7f915c0bcfd0 msgr2=0x7f915c0bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.790+0000 7f916408f640 1 -- 172.21.15.40:0/2972034472 shutdown_connections 2023-12-20T06:04:50.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.790+0000 7f916408f640 1 -- 172.21.15.40:0/2972034472 wait complete. 2023-12-20T06:04:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 Processor -- start 2023-12-20T06:04:50.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 -- start start 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f915c06a950 0x7f915c0ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f915c0bb140 0x7f915c146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c0bf510 0x7f915c0a2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0a0dc0 con 0x7f915c0bf510 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c1e0c40 con 0x7f915c0bb140 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916408f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0a0930 con 0x7f915c06a950 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916262c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c0bf510 0x7f915c0a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916262c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c0bf510 0x7f915c0a2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53764/0 (socket says 172.21.15.40:53764) 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f916262c640 1 -- 172.21.15.40:0/979737080 learned_addr learned my addr 172.21.15.40:0/979737080 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.791+0000 7f9161e2b640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f915c06a950 0x7f915c0ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916162a640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f915c0bb140 0x7f915c146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916262c640 1 -- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f915c06a950 msgr2=0x7f915c0ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916262c640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f915c06a950 0x7f915c0ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916262c640 1 -- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f915c0bb140 msgr2=0x7f915c146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916262c640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f915c0bb140 0x7f915c146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916262c640 1 -- 172.21.15.40:0/979737080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9154009b30 con 0x7f915c0bf510 2023-12-20T06:04:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f9161e2b640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f915c06a950 0x7f915c0ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916162a640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f915c0bb140 0x7f915c146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916262c640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c0bf510 0x7f915c0a2740 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9154009f70 tx=0x7f9154004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f91527fc640 1 -- 172.21.15.40:0/979737080 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154009510 con 0x7f915c0bf510 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f91527fc640 1 -- 172.21.15.40:0/979737080 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915403e450 con 0x7f915c0bf510 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915c0a0070 con 0x7f915c0bf510 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f91527fc640 1 -- 172.21.15.40:0/979737080 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915403e800 con 0x7f915c0bf510 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.792+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915c0a05c0 con 0x7f915c0bf510 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.793+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915c0740a0 con 0x7f915c0bf510 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.793+0000 7f91527fc640 1 -- 172.21.15.40:0/979737080 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f915403e960 con 0x7f915c0bf510 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.794+0000 7f91527fc640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f914006a430 0x7f914006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.794+0000 7f91527fc640 1 -- 172.21.15.40:0/979737080 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91540ab5c0 con 0x7f915c0bf510 2023-12-20T06:04:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.794+0000 7f9161e2b640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f914006a430 0x7f914006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.794+0000 7f9161e2b640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f914006a430 0x7f914006c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f915800a830 tx=0x7f9158008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.798+0000 7f91527fc640 1 -- 172.21.15.40:0/979737080 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9154076c70 con 0x7f915c0bf510 2023-12-20T06:04:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.974+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f915c0a0a70 con 0x7f915c0bf510 2023-12-20T06:04:50.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.974+0000 7f91527fc640 1 -- 172.21.15.40:0/979737080 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f915407a290 con 0x7f915c0bf510 2023-12-20T06:04:50.975 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f914006a430 msgr2=0x7f914006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f914006a430 0x7f914006c8f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f915800a830 tx=0x7f9158008040 comp rx=0 tx=0).stop 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c0bf510 msgr2=0x7f915c0a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c0bf510 0x7f915c0a2740 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9154009f70 tx=0x7f9154004a40 comp rx=0 tx=0).stop 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 shutdown_connections 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f914006a430 0x7f914006c8f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f915c0bf510 0x7f915c0a2740 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f915c0bb140 0x7f915c146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 --2- 172.21.15.40:0/979737080 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f915c06a950 0x7f915c0ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 >> 172.21.15.40:0/979737080 conn(0x7f915c0bcfd0 msgr2=0x7f915c0a38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 shutdown_connections 2023-12-20T06:04:50.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:50.976+0000 7f916408f640 1 -- 172.21.15.40:0/979737080 wait complete. 2023-12-20T06:04:50.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T06:04:51.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.097+0000 7fd7d7fec640 1 Processor -- start 2023-12-20T06:04:51.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.098+0000 7fd7d7fec640 1 -- start start 2023-12-20T06:04:51.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.098+0000 7fd7d7fec640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d006a950 0x7fd7d00be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.098+0000 7fd7d7fec640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d00bfa50 con 0x7fd7d00bf510 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.098+0000 7fd7d7fec640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d006b040 con 0x7fd7d00bb140 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.098+0000 7fd7d7fec640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d00bbda0 con 0x7fd7d006a950 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.098+0000 7fd7d6589640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d006a950 0x7fd7d00be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.099+0000 7fd7d6589640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7d006a950 0x7fd7d00be350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53772/0 (socket says 172.21.15.40:53772) 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.099+0000 7fd7d6589640 1 -- 172.21.15.40:0/2506387724 learned_addr learned my addr 172.21.15.40:0/2506387724 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.099+0000 7fd7d6589640 1 -- 172.21.15.40:0/2506387724 >> v1:172.21.15.69:6789/0 conn(0x7fd7d00bb140 legacy=0x7fd7d00bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.099+0000 7fd7d6589640 1 -- 172.21.15.40:0/2506387724 >> v1:172.21.15.40:6789/0 conn(0x7fd7d00bf510 legacy=0x7fd7d01534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.099+0000 7fd7d6589640 1 -- 172.21.15.40:0/2506387724 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d00bb520 con 0x7fd7d006a950 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d6589640 1 --2- 172.21.15.40:0/2506387724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006a950 0x7fd7d00be350 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009e50 tx=0x7fd7c802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c33e763366b3908 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d4d86640 1 -- 172.21.15.40:0/2506387724 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c802cbb0 con 0x7fd7d006a950 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d4d86640 1 -- 172.21.15.40:0/2506387724 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c802cd10 con 0x7fd7d006a950 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d4d86640 1 -- 172.21.15.40:0/2506387724 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8034610 con 0x7fd7d006a950 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d7fec640 1 -- 172.21.15.40:0/2506387724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006a950 msgr2=0x7fd7d00be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/2506387724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006a950 0x7fd7d00be350 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009e50 tx=0x7fd7c802c010 comp rx=0 tx=0).stop 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d7fec640 1 -- 172.21.15.40:0/2506387724 shutdown_connections 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/2506387724 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d006a950 0x7fd7d00be350 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d7fec640 1 -- 172.21.15.40:0/2506387724 >> 172.21.15.40:0/2506387724 conn(0x7fd7d00bcfd0 msgr2=0x7fd7d00bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d7fec640 1 -- 172.21.15.40:0/2506387724 shutdown_connections 2023-12-20T06:04:51.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.100+0000 7fd7d7fec640 1 -- 172.21.15.40:0/2506387724 wait complete. 2023-12-20T06:04:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.101+0000 7fd7d7fec640 1 Processor -- start 2023-12-20T06:04:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.101+0000 7fd7d7fec640 1 -- start start 2023-12-20T06:04:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d7fec640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd7d006a950 0x7fd7d014e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d7fec640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00bb140 0x7fd7d00b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d7fec640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7d00bf510 0x7fd7d00b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d7fec640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d014ee60 con 0x7fd7d00bb140 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d7fec640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d00a2a70 con 0x7fd7d00bf510 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d7fec640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d01e0d80 con 0x7fd7d006a950 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00bb140 0x7fd7d00b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00bb140 0x7fd7d00b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53784/0 (socket says 172.21.15.40:53784) 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 -- 172.21.15.40:0/344073072 learned_addr learned my addr 172.21.15.40:0/344073072 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d6589640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7d00bf510 0x7fd7d00b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5d88640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd7d006a950 0x7fd7d014e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 -- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd7d006a950 msgr2=0x7fd7d014e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd7d006a950 0x7fd7d014e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 -- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7d00bf510 msgr2=0x7fd7d00b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7d00bf510 0x7fd7d00b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 -- 172.21.15.40:0/344073072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8009b30 con 0x7fd7d00bb140 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5d88640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd7d006a950 0x7fd7d014e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d6589640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7d00bf510 0x7fd7d00b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.102+0000 7fd7d5587640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00bb140 0x7fd7d00b2fc0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c400 tx=0x7fd7c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.103+0000 7fd7c67fc640 1 -- 172.21.15.40:0/344073072 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c00052d0 con 0x7fd7d00bb140 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.103+0000 7fd7c67fc640 1 -- 172.21.15.40:0/344073072 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c0005430 con 0x7fd7d00bb140 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.103+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d01e1060 con 0x7fd7d00bb140 2023-12-20T06:04:51.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.103+0000 7fd7c67fc640 1 -- 172.21.15.40:0/344073072 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0003830 con 0x7fd7d00bb140 2023-12-20T06:04:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.103+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d00a2790 con 0x7fd7d00bb140 2023-12-20T06:04:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.104+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d00740a0 con 0x7fd7d00bb140 2023-12-20T06:04:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.104+0000 7fd7c67fc640 1 -- 172.21.15.40:0/344073072 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd7c0003990 con 0x7fd7d00bb140 2023-12-20T06:04:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.104+0000 7fd7c67fc640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd7b406a430 0x7fd7b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.105+0000 7fd7c67fc640 1 -- 172.21.15.40:0/344073072 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7c0087f70 con 0x7fd7d00bb140 2023-12-20T06:04:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.105+0000 7fd7d5d88640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd7b406a430 0x7fd7b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.105+0000 7fd7d5d88640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd7b406a430 0x7fd7b406c8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0015e0 tx=0x7fd7cc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.109+0000 7fd7c67fc640 1 -- 172.21.15.40:0/344073072 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd7c00534c0 con 0x7fd7d00bb140 2023-12-20T06:04:51.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.288+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd7d01450a0 con 0x7fd7d00bb140 2023-12-20T06:04:51.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.288+0000 7fd7c67fc640 1 -- 172.21.15.40:0/344073072 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd7c0017020 con 0x7fd7d00bb140 2023-12-20T06:04:51.290 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T06:04:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd7b406a430 msgr2=0x7fd7b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd7b406a430 0x7fd7b406c8f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0015e0 tx=0x7fd7cc009040 comp rx=0 tx=0).stop 2023-12-20T06:04:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00bb140 msgr2=0x7fd7d00b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00bb140 0x7fd7d00b2fc0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c400 tx=0x7fd7c000c8c0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 shutdown_connections 2023-12-20T06:04:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd7b406a430 0x7fd7b406c8f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7d00bf510 0x7fd7d00b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7d00bb140 0x7fd7d00b2fc0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 --2- 172.21.15.40:0/344073072 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd7d006a950 0x7fd7d014e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 >> 172.21.15.40:0/344073072 conn(0x7fd7d00bcfd0 msgr2=0x7fd7d00a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 shutdown_connections 2023-12-20T06:04:51.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.291+0000 7fd7d7fec640 1 -- 172.21.15.40:0/344073072 wait complete. 2023-12-20T06:04:51.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T06:04:51.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.409+0000 7f5944163640 1 Processor -- start 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5944163640 1 -- start start 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5944163640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f593c144e30 0x7f593c0b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5944163640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f593c0bab80 0x7f593c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5944163640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0b6da0 con 0x7f593c0b8b40 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5944163640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c0b8090 con 0x7f593c144e30 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5944163640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c14afe0 con 0x7f593c0bab80 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5941eff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f593c144e30 0x7f593c0b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5941eff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f593c144e30 0x7f593c0b7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53794/0 (socket says 172.21.15.40:53794) 2023-12-20T06:04:51.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.410+0000 7f5941eff640 1 -- 172.21.15.40:0/2625872197 learned_addr learned my addr 172.21.15.40:0/2625872197 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.411+0000 7f59416fe640 1 --2- 172.21.15.40:0/2625872197 >> v2:172.21.15.69:3300/0 conn(0x7f593c0bab80 0x7f593c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.411+0000 7f5941eff640 1 -- 172.21.15.40:0/2625872197 >> v2:172.21.15.69:3300/0 conn(0x7f593c0bab80 msgr2=0x7f593c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.411+0000 7f5941eff640 1 --2- 172.21.15.40:0/2625872197 >> v2:172.21.15.69:3300/0 conn(0x7f593c0bab80 0x7f593c14b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.411+0000 7f5941eff640 1 -- 172.21.15.40:0/2625872197 >> v1:172.21.15.69:6789/0 conn(0x7f593c0b8b40 legacy=0x7f593c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.411+0000 7f5941eff640 1 -- 172.21.15.40:0/2625872197 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c145210 con 0x7f593c144e30 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.411+0000 7f5941eff640 1 --2- 172.21.15.40:0/2625872197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c144e30 0x7f593c0b7600 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f593c069ec0 tx=0x7f593802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef222b6b9c1c5700 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5940efd640 1 -- 172.21.15.40:0/2625872197 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593802f850 con 0x7f593c144e30 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5940efd640 1 -- 172.21.15.40:0/2625872197 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593802f9b0 con 0x7f593c144e30 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5940efd640 1 -- 172.21.15.40:0/2625872197 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593802fd40 con 0x7f593c144e30 2023-12-20T06:04:51.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 -- 172.21.15.40:0/2625872197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c144e30 msgr2=0x7f593c0b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 --2- 172.21.15.40:0/2625872197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c144e30 0x7f593c0b7600 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f593c069ec0 tx=0x7f593802ba30 comp rx=0 tx=0).stop 2023-12-20T06:04:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 -- 172.21.15.40:0/2625872197 shutdown_connections 2023-12-20T06:04:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 --2- 172.21.15.40:0/2625872197 >> v2:172.21.15.69:3300/0 conn(0x7f593c0bab80 0x7f593c14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 --2- 172.21.15.40:0/2625872197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c144e30 0x7f593c0b7600 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 -- 172.21.15.40:0/2625872197 >> 172.21.15.40:0/2625872197 conn(0x7f593c0c0200 msgr2=0x7f593c0c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 -- 172.21.15.40:0/2625872197 shutdown_connections 2023-12-20T06:04:51.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.412+0000 7f5944163640 1 -- 172.21.15.40:0/2625872197 wait complete. 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.413+0000 7f5944163640 1 Processor -- start 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.413+0000 7f5944163640 1 -- start start 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5944163640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f593c0b8b40 0x7f593c1459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5944163640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c0bab80 0x7f593c146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5944163640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f593c144e30 0x7f593c0ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5944163640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0ae660 con 0x7f593c0bab80 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5944163640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c146290 con 0x7f593c144e30 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5944163640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1476d0 con 0x7f593c0b8b40 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c0bab80 0x7f593c146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c0bab80 0x7f593c146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53796/0 (socket says 172.21.15.40:53796) 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 -- 172.21.15.40:0/1886972950 learned_addr learned my addr 172.21.15.40:0/1886972950 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5941eff640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f593c0b8b40 0x7f593c1459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f5942700640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f593c144e30 0x7f593c0ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 -- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f593c0b8b40 msgr2=0x7f593c1459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f593c0b8b40 0x7f593c1459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 -- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f593c144e30 msgr2=0x7f593c0ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f593c144e30 0x7f593c0ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.414+0000 7f59416fe640 1 -- 172.21.15.40:0/1886972950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380094d0 con 0x7f593c0bab80 2023-12-20T06:04:51.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.415+0000 7f5942700640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f593c144e30 0x7f593c0ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.415+0000 7f59416fe640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c0bab80 0x7f593c146bc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f592c00d800 tx=0x7f592c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.415+0000 7f59327fc640 1 -- 172.21.15.40:0/1886972950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00b6c0 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.415+0000 7f59327fc640 1 -- 172.21.15.40:0/1886972950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00b820 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.415+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c1472b0 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.415+0000 7f59327fc640 1 -- 172.21.15.40:0/1886972950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00bbd0 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.415+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c147990 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.416+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c04e840 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.416+0000 7f59327fc640 1 -- 172.21.15.40:0/1886972950 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f592c00bd30 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.417+0000 7f59327fc640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f592006a430 0x7f592006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.417+0000 7f59327fc640 1 -- 172.21.15.40:0/1886972950 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f592c088e80 con 0x7f593c0bab80 2023-12-20T06:04:51.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.417+0000 7f5941eff640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f592006a430 0x7f592006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.417+0000 7f5941eff640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f592006a430 0x7f592006c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5938036000 tx=0x7f5938008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.421+0000 7f59327fc640 1 -- 172.21.15.40:0/1886972950 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f592c0543e0 con 0x7f593c0bab80 2023-12-20T06:04:51.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.610+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f593c145790 con 0x7f593c0bab80 2023-12-20T06:04:51.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.611+0000 7f59327fc640 1 -- 172.21.15.40:0/1886972950 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f592c057a00 con 0x7f593c0bab80 2023-12-20T06:04:51.612 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-12-20T06:04:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f592006a430 msgr2=0x7f592006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f592006a430 0x7f592006c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5938036000 tx=0x7f5938008030 comp rx=0 tx=0).stop 2023-12-20T06:04:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c0bab80 msgr2=0x7f593c146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c0bab80 0x7f593c146bc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f592c00d800 tx=0x7f592c00dcc0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 shutdown_connections 2023-12-20T06:04:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f592006a430 0x7f592006c8f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f593c144e30 0x7f593c0ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f593c0bab80 0x7f593c146bc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 --2- 172.21.15.40:0/1886972950 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f593c0b8b40 0x7f593c1459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.612+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 >> 172.21.15.40:0/1886972950 conn(0x7f593c0c0200 msgr2=0x7f593c0b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:51.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.613+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 shutdown_connections 2023-12-20T06:04:51.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.613+0000 7f5944163640 1 -- 172.21.15.40:0/1886972950 wait complete. 2023-12-20T06:04:51.624 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-20T06:04:51.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:51.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-20T06:04:51.729 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-12-20T06:04:51.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:51.730 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T06:04:51.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T06:04:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.888+0000 7fbf6e828640 1 Processor -- start 2023-12-20T06:04:51.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.888+0000 7fbf6e828640 1 -- start start 2023-12-20T06:04:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6e828640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf680b3900 0x7fbf680bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6e828640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf6814abd0 0x7fbf68155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6e828640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf680bae20 con 0x7fbf6806a470 2023-12-20T06:04:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6e828640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf680c1220 con 0x7fbf6814abd0 2023-12-20T06:04:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6e828640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf680bf900 con 0x7fbf680b3900 2023-12-20T06:04:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6cdc5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf6814abd0 0x7fbf68155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6cdc5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf6814abd0 0x7fbf68155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53804/0 (socket says 172.21.15.40:53804) 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6cdc5640 1 -- 172.21.15.40:0/3941392215 learned_addr learned my addr 172.21.15.40:0/3941392215 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf677fe640 1 --2- 172.21.15.40:0/3941392215 >> v2:172.21.15.69:3300/0 conn(0x7fbf680b3900 0x7fbf680bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6cdc5640 1 -- 172.21.15.40:0/3941392215 >> v2:172.21.15.69:3300/0 conn(0x7fbf680b3900 msgr2=0x7fbf680bb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6cdc5640 1 --2- 172.21.15.40:0/3941392215 >> v2:172.21.15.69:3300/0 conn(0x7fbf680b3900 0x7fbf680bb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6cdc5640 1 -- 172.21.15.40:0/3941392215 >> v1:172.21.15.40:6789/0 conn(0x7fbf6806a470 legacy=0x7fbf68148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.889+0000 7fbf6cdc5640 1 -- 172.21.15.40:0/3941392215 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf680bfba0 con 0x7fbf6814abd0 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.890+0000 7fbf677fe640 1 --2- 172.21.15.40:0/3941392215 >> v2:172.21.15.69:3300/0 conn(0x7fbf680b3900 0x7fbf680bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.890+0000 7fbf6cdc5640 1 --2- 172.21.15.40:0/3941392215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6814abd0 0x7fbf68155400 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009e50 tx=0x7fbf6002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5ae6ec0a749650 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.890+0000 7fbf66ffd640 1 -- 172.21.15.40:0/3941392215 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6002cb20 con 0x7fbf6814abd0 2023-12-20T06:04:51.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.890+0000 7fbf66ffd640 1 -- 172.21.15.40:0/3941392215 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6002cc80 con 0x7fbf6814abd0 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.890+0000 7fbf66ffd640 1 -- 172.21.15.40:0/3941392215 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf600343f0 con 0x7fbf6814abd0 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 -- 172.21.15.40:0/3941392215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6814abd0 msgr2=0x7fbf68155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 --2- 172.21.15.40:0/3941392215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6814abd0 0x7fbf68155400 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbf60009e50 tx=0x7fbf6002bf80 comp rx=0 tx=0).stop 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 -- 172.21.15.40:0/3941392215 shutdown_connections 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 --2- 172.21.15.40:0/3941392215 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6814abd0 0x7fbf68155400 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 --2- 172.21.15.40:0/3941392215 >> v2:172.21.15.69:3300/0 conn(0x7fbf680b3900 0x7fbf680bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 -- 172.21.15.40:0/3941392215 >> 172.21.15.40:0/3941392215 conn(0x7fbf680c0270 msgr2=0x7fbf680c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 -- 172.21.15.40:0/3941392215 shutdown_connections 2023-12-20T06:04:51.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.891+0000 7fbf6e828640 1 -- 172.21.15.40:0/3941392215 wait complete. 2023-12-20T06:04:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.892+0000 7fbf6e828640 1 Processor -- start 2023-12-20T06:04:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.892+0000 7fbf6e828640 1 -- start start 2023-12-20T06:04:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf6e828640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6806a470 0x7fbf6814d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf6e828640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf680b3900 0x7fbf6814df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf6e828640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf6814abd0 0x7fbf681e3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf6e828640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6814a260 con 0x7fbf6806a470 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf6e828640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6814cdf0 con 0x7fbf6814abd0 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf6e828640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf680a3ad0 con 0x7fbf680b3900 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6806a470 0x7fbf6814d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6806a470 0x7fbf6814d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53810/0 (socket says 172.21.15.40:53810) 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 -- 172.21.15.40:0/907066007 learned_addr learned my addr 172.21.15.40:0/907066007 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf677fe640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf680b3900 0x7fbf6814df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf6cdc5640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf6814abd0 0x7fbf681e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 -- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf680b3900 msgr2=0x7fbf6814df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf680b3900 0x7fbf6814df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 -- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf6814abd0 msgr2=0x7fbf681e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf6814abd0 0x7fbf681e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:51.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 -- 172.21.15.40:0/907066007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf60009b30 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.893+0000 7fbf67fff640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6806a470 0x7fbf6814d280 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c480 tx=0x7fbf5800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.894+0000 7fbf64ff9640 1 -- 172.21.15.40:0/907066007 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf580052d0 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.894+0000 7fbf64ff9640 1 -- 172.21.15.40:0/907066007 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf58005430 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.894+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6814bcc0 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.894+0000 7fbf64ff9640 1 -- 172.21.15.40:0/907066007 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58012870 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.894+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6814ca80 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.895+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6804e840 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.895+0000 7fbf64ff9640 1 -- 172.21.15.40:0/907066007 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf580129d0 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.896+0000 7fbf64ff9640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf5406a460 0x7fbf5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.896+0000 7fbf64ff9640 1 -- 172.21.15.40:0/907066007 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf580884c0 con 0x7fbf6806a470 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.896+0000 7fbf677fe640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf5406a460 0x7fbf5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:51.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.896+0000 7fbf677fe640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf5406a460 0x7fbf5406c920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbf68148640 tx=0x7fbf5c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:51.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:51.900+0000 7fbf64ff9640 1 -- 172.21.15.40:0/907066007 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbf58053aa0 con 0x7fbf6806a470 2023-12-20T06:04:52.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.111+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf680a61f0 con 0x7fbf6806a470 2023-12-20T06:04:52.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.112+0000 7fbf64ff9640 1 -- 172.21.15.40:0/907066007 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3952 (secure 0 0 0) 0x7fbf580570c0 con 0x7fbf6806a470 2023-12-20T06:04:52.113 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:52.113 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1306717467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1306717467},{"type":"v1","addr":"172.21.15.40:6835","nonce":1306717467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4625,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1583424120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1583424120},{"type":"v1","addr":"172.21.15.69:6835","nonce":1583424120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:24:05.927869+0000","modified":"2023-12-20T04:24:08.263654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/3041271085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3041271085},{"type":"v1","addr":"172.21.15.40:6834","nonce":3041271085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T06:04:52.113 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2023-12-20T06:04:52.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf5406a460 msgr2=0x7fbf5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf5406a460 0x7fbf5406c920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbf68148640 tx=0x7fbf5c008040 comp rx=0 tx=0).stop 2023-12-20T06:04:52.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6806a470 msgr2=0x7fbf6814d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6806a470 0x7fbf6814d280 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800c480 tx=0x7fbf5800c940 comp rx=0 tx=0).stop 2023-12-20T06:04:52.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 shutdown_connections 2023-12-20T06:04:52.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf5406a460 0x7fbf5406c920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf6814abd0 0x7fbf681e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf680b3900 0x7fbf6814df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 --2- 172.21.15.40:0/907066007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf6806a470 0x7fbf6814d280 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 >> 172.21.15.40:0/907066007 conn(0x7fbf680c0270 msgr2=0x7fbf680beb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 shutdown_connections 2023-12-20T06:04:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.114+0000 7fbf6e828640 1 -- 172.21.15.40:0/907066007 wait complete. 2023-12-20T06:04:52.126 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T06:04:52.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.232+0000 7f843a500640 1 Processor -- start 2023-12-20T06:04:52.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.232+0000 7f843a500640 1 -- start start 2023-12-20T06:04:52.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.232+0000 7f843a500640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8434150820 0x7f8434152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.232+0000 7f843a500640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843406fb80 con 0x7f8434070010 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.232+0000 7f843a500640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84340b2900 con 0x7f843414a760 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.232+0000 7f843a500640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843406ef70 con 0x7f8434150820 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.232+0000 7f8438a9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8434150820 0x7f8434152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.233+0000 7f8438a9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8434150820 0x7f8434152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53824/0 (socket says 172.21.15.40:53824) 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.233+0000 7f8438a9d640 1 -- 172.21.15.40:0/3285489339 learned_addr learned my addr 172.21.15.40:0/3285489339 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.233+0000 7f84337fe640 1 --1- 172.21.15.40:0/3285489339 >> v1:172.21.15.40:6789/0 conn(0x7f8434070010 0x7f8434070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44106/0 (socket says 172.21.15.40:44106) 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.233+0000 7f8438a9d640 1 -- 172.21.15.40:0/3285489339 >> v1:172.21.15.69:6789/0 conn(0x7f843414a760 legacy=0x7f8434144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.233+0000 7f8438a9d640 1 -- 172.21.15.40:0/3285489339 >> v1:172.21.15.40:6789/0 conn(0x7f8434070010 legacy=0x7f8434070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.233+0000 7f8438a9d640 1 -- 172.21.15.40:0/3285489339 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843414af80 con 0x7f8434150820 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f8438a9d640 1 --2- 172.21.15.40:0/3285489339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434152c10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f842c00af60 tx=0x7f842c02d1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aaae9772ae0000d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f8432ffd640 1 -- 172.21.15.40:0/3285489339 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c02db40 con 0x7f8434150820 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f8432ffd640 1 -- 172.21.15.40:0/3285489339 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c02dca0 con 0x7f8434150820 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f8432ffd640 1 -- 172.21.15.40:0/3285489339 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c008720 con 0x7f8434150820 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f843a500640 1 -- 172.21.15.40:0/3285489339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 msgr2=0x7f8434152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f843a500640 1 --2- 172.21.15.40:0/3285489339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434152c10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f842c00af60 tx=0x7f842c02d1a0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f843a500640 1 -- 172.21.15.40:0/3285489339 shutdown_connections 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f843a500640 1 --2- 172.21.15.40:0/3285489339 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434152c10 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f843a500640 1 -- 172.21.15.40:0/3285489339 >> 172.21.15.40:0/3285489339 conn(0x7f84340bc220 msgr2=0x7f84340bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:52.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f843a500640 1 -- 172.21.15.40:0/3285489339 shutdown_connections 2023-12-20T06:04:52.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.234+0000 7f843a500640 1 -- 172.21.15.40:0/3285489339 wait complete. 2023-12-20T06:04:52.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.235+0000 7f843a500640 1 Processor -- start 2023-12-20T06:04:52.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f843a500640 1 -- start start 2023-12-20T06:04:52.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f843a500640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434070010 0x7f84341408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f843a500640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f843414a760 0x7f8434139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f843a500640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434137db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f843a500640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8434140e00 con 0x7f8434150820 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f843a500640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843413ab10 con 0x7f8434070010 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f843a500640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843413b9b0 con 0x7f843414a760 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f8438a9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434137db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f8438a9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434137db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53828/0 (socket says 172.21.15.40:53828) 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f8438a9d640 1 -- 172.21.15.40:0/2688183967 learned_addr learned my addr 172.21.15.40:0/2688183967 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f84337fe640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f843414a760 0x7f8434139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.236+0000 7f8433fff640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434070010 0x7f84341408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8438a9d640 1 -- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f843414a760 msgr2=0x7f8434139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8438a9d640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f843414a760 0x7f8434139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8438a9d640 1 -- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434070010 msgr2=0x7f84341408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8438a9d640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434070010 0x7f84341408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8438a9d640 1 -- 172.21.15.40:0/2688183967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c00ac40 con 0x7f8434150820 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8433fff640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434070010 0x7f84341408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8438a9d640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434137db0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f842c037040 tx=0x7f842c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8430ff9640 1 -- 172.21.15.40:0/2688183967 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c040670 con 0x7f8434150820 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8430ff9640 1 -- 172.21.15.40:0/2688183967 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c040810 con 0x7f8434150820 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84340b5a80 con 0x7f8434150820 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f8430ff9640 1 -- 172.21.15.40:0/2688183967 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c040bc0 con 0x7f8434150820 2023-12-20T06:04:52.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.237+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843413b5d0 con 0x7f8434150820 2023-12-20T06:04:52.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.238+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843413b790 con 0x7f8434150820 2023-12-20T06:04:52.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.239+0000 7f8430ff9640 1 -- 172.21.15.40:0/2688183967 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f842c040d20 con 0x7f8434150820 2023-12-20T06:04:52.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.239+0000 7f8430ff9640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f842006a430 0x7f842006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.239+0000 7f8430ff9640 1 -- 172.21.15.40:0/2688183967 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f842c0abeb0 con 0x7f8434150820 2023-12-20T06:04:52.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.239+0000 7f8433fff640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f842006a430 0x7f842006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.240+0000 7f8433fff640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f842006a430 0x7f842006c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8424007fd0 tx=0x7f8424009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.243+0000 7f8430ff9640 1 -- 172.21.15.40:0/2688183967 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f842c0774a0 con 0x7f8434150820 2023-12-20T06:04:52.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.419+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84340b58e0 con 0x7f8434150820 2023-12-20T06:04:52.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.420+0000 7f8430ff9640 1 -- 172.21.15.40:0/2688183967 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f84340b58e0 con 0x7f8434150820 2023-12-20T06:04:52.421 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:52.422 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:24:06.929899+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:24:03.672943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:24:04.910865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T06:04:52.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f842006a430 msgr2=0x7f842006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f842006a430 0x7f842006c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8424007fd0 tx=0x7f8424009040 comp rx=0 tx=0).stop 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 msgr2=0x7f8434137db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434137db0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f842c037040 tx=0x7f842c004a40 comp rx=0 tx=0).stop 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 shutdown_connections 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f842006a430 0x7f842006c8f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8434150820 0x7f8434137db0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f843414a760 0x7f8434139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 --2- 172.21.15.40:0/2688183967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8434070010 0x7f84341408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 >> 172.21.15.40:0/2688183967 conn(0x7f84340bc220 msgr2=0x7f8434149510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 shutdown_connections 2023-12-20T06:04:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.422+0000 7f843a500640 1 -- 172.21.15.40:0/2688183967 wait complete. 2023-12-20T06:04:52.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:23:14.584861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:24:03.672943+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:24:04.910865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T06:04:52.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T06:04:52.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.543+0000 7f0aa4a43640 1 Processor -- start 2023-12-20T06:04:52.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.543+0000 7f0aa4a43640 1 -- start start 2023-12-20T06:04:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0aa4a43640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0aa00b9b00 0x7f0aa00b9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0aa4a43640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0aa006fc30 0x7f0aa01416f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0aa4a43640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa0070ef0 con 0x7f0aa014ac60 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0aa4a43640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa0071190 con 0x7f0aa006fc30 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0aa4a43640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa0071470 con 0x7f0aa00b9b00 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0a9dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0aa006fc30 0x7f0aa01416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0a9dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0aa006fc30 0x7f0aa01416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53844/0 (socket says 172.21.15.40:53844) 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0a9dd9b640 1 -- 172.21.15.40:0/1568900892 learned_addr learned my addr 172.21.15.40:0/1568900892 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.544+0000 7f0a9e59c640 1 --2- 172.21.15.40:0/1568900892 >> v2:172.21.15.69:3300/0 conn(0x7f0aa00b9b00 0x7f0aa00b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.545+0000 7f0a9dd9b640 1 -- 172.21.15.40:0/1568900892 >> v2:172.21.15.69:3300/0 conn(0x7f0aa00b9b00 msgr2=0x7f0aa00b9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.545+0000 7f0a9dd9b640 1 --2- 172.21.15.40:0/1568900892 >> v2:172.21.15.69:3300/0 conn(0x7f0aa00b9b00 0x7f0aa00b9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.545+0000 7f0a9dd9b640 1 -- 172.21.15.40:0/1568900892 >> v1:172.21.15.40:6789/0 conn(0x7f0aa014ac60 legacy=0x7f0aa014b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.545+0000 7f0a9dd9b640 1 -- 172.21.15.40:0/1568900892 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0070150 con 0x7f0aa006fc30 2023-12-20T06:04:52.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.545+0000 7f0a9dd9b640 1 --2- 172.21.15.40:0/1568900892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa006fc30 0x7f0aa01416f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00ba370 tx=0x7f0a9402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf99519ad7173ce server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0a9d59a640 1 -- 172.21.15.40:0/1568900892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94030860 con 0x7f0aa006fc30 2023-12-20T06:04:52.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0a9d59a640 1 -- 172.21.15.40:0/1568900892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a940309c0 con 0x7f0aa006fc30 2023-12-20T06:04:52.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0a9d59a640 1 -- 172.21.15.40:0/1568900892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94030d50 con 0x7f0aa006fc30 2023-12-20T06:04:52.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 -- 172.21.15.40:0/1568900892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa006fc30 msgr2=0x7f0aa01416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/1568900892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa006fc30 0x7f0aa01416f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00ba370 tx=0x7f0a9402b9a0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 -- 172.21.15.40:0/1568900892 shutdown_connections 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/1568900892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa006fc30 0x7f0aa01416f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/1568900892 >> v2:172.21.15.69:3300/0 conn(0x7f0aa00b9b00 0x7f0aa00b9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 -- 172.21.15.40:0/1568900892 >> 172.21.15.40:0/1568900892 conn(0x7f0aa00bcfe0 msgr2=0x7f0aa00bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 -- 172.21.15.40:0/1568900892 shutdown_connections 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.546+0000 7f0aa4a43640 1 -- 172.21.15.40:0/1568900892 wait complete. 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.547+0000 7f0aa4a43640 1 Processor -- start 2023-12-20T06:04:52.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.547+0000 7f0aa4a43640 1 -- start start 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0aa4a43640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0aa006fc30 0x7f0aa01d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0aa4a43640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0aa00b9b00 0x7f0aa00bc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0aa4a43640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa014ac60 0x7f0aa0149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0aa4a43640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa01d44d0 con 0x7f0aa014ac60 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0aa4a43640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00bc9a0 con 0x7f0aa00b9b00 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0aa4a43640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00bb9c0 con 0x7f0aa006fc30 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa014ac60 0x7f0aa0149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa014ac60 0x7f0aa0149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53846/0 (socket says 172.21.15.40:53846) 2023-12-20T06:04:52.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 -- 172.21.15.40:0/935619560 learned_addr learned my addr 172.21.15.40:0/935619560 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9dd9b640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0aa00b9b00 0x7f0aa00bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9e59c640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0aa006fc30 0x7f0aa01d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 -- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0aa006fc30 msgr2=0x7f0aa01d3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0aa006fc30 0x7f0aa01d3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 -- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0aa00b9b00 msgr2=0x7f0aa00bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0aa00b9b00 0x7f0aa00bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9ed9d640 1 -- 172.21.15.40:0/935619560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940094d0 con 0x7f0aa014ac60 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.548+0000 7f0a9dd9b640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0aa00b9b00 0x7f0aa00bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.549+0000 7f0a9ed9d640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa014ac60 0x7f0aa0149bf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c6b0 tx=0x7f0a9800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.549+0000 7f0a8effd640 1 -- 172.21.15.40:0/935619560 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98003b70 con 0x7f0aa014ac60 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.549+0000 7f0a8effd640 1 -- 172.21.15.40:0/935619560 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98003cf0 con 0x7f0aa014ac60 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.549+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa00bcba0 con 0x7f0aa014ac60 2023-12-20T06:04:52.553 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.549+0000 7f0a8effd640 1 -- 172.21.15.40:0/935619560 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98005310 con 0x7f0aa014ac60 2023-12-20T06:04:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.549+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa00bb1c0 con 0x7f0aa014ac60 2023-12-20T06:04:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.550+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa00740a0 con 0x7f0aa014ac60 2023-12-20T06:04:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.550+0000 7f0a8effd640 1 -- 172.21.15.40:0/935619560 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a98005470 con 0x7f0aa014ac60 2023-12-20T06:04:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.551+0000 7f0a8effd640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0a8006a460 0x7f0a8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.551+0000 7f0a8effd640 1 -- 172.21.15.40:0/935619560 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a98088750 con 0x7f0aa014ac60 2023-12-20T06:04:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.551+0000 7f0a9e59c640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0a8006a460 0x7f0a8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.552+0000 7f0a9e59c640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0a8006a460 0x7f0a8006c920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009ad0 tx=0x7f0a90008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.555+0000 7f0a8effd640 1 -- 172.21.15.40:0/935619560 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0a98053cb0 con 0x7f0aa014ac60 2023-12-20T06:04:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.730+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0aa0070390 con 0x7f0aa014ac60 2023-12-20T06:04:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.730+0000 7f0a8effd640 1 -- 172.21.15.40:0/935619560 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a98003e60 con 0x7f0aa014ac60 2023-12-20T06:04:52.732 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0a8006a460 msgr2=0x7f0a8006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0a8006a460 0x7f0a8006c920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009ad0 tx=0x7f0a90008040 comp rx=0 tx=0).stop 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa014ac60 msgr2=0x7f0aa0149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa014ac60 0x7f0aa0149bf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c6b0 tx=0x7f0a9800cb70 comp rx=0 tx=0).stop 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 shutdown_connections 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f0a8006a460 0x7f0a8006c920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa014ac60 0x7f0aa0149bf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0aa00b9b00 0x7f0aa00bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 --2- 172.21.15.40:0/935619560 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f0aa006fc30 0x7f0aa01d3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 >> 172.21.15.40:0/935619560 conn(0x7f0aa00bcfe0 msgr2=0x7f0aa00b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 shutdown_connections 2023-12-20T06:04:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.732+0000 7f0aa4a43640 1 -- 172.21.15.40:0/935619560 wait complete. 2023-12-20T06:04:52.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T06:04:52.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.853+0000 7f1c48028640 1 Processor -- start 2023-12-20T06:04:52.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.853+0000 7f1c48028640 1 -- start start 2023-12-20T06:04:52.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.853+0000 7f1c48028640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1c400bb140 0x7f1c400be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c48028640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c400bf510 0x7f1c400bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c48028640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400bfa50 con 0x7f1c4006a950 2023-12-20T06:04:52.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c48028640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400bbda0 con 0x7f1c400bf510 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c48028640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4006b040 con 0x7f1c400bb140 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c465c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c400bf510 0x7f1c400bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c465c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c400bf510 0x7f1c400bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53858/0 (socket says 172.21.15.40:53858) 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c465c5640 1 -- 172.21.15.40:0/156251871 learned_addr learned my addr 172.21.15.40:0/156251871 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c45dc4640 1 --2- 172.21.15.40:0/156251871 >> v2:172.21.15.69:3300/0 conn(0x7f1c400bb140 0x7f1c400be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c465c5640 1 -- 172.21.15.40:0/156251871 >> v2:172.21.15.69:3300/0 conn(0x7f1c400bb140 msgr2=0x7f1c400be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c465c5640 1 --2- 172.21.15.40:0/156251871 >> v2:172.21.15.69:3300/0 conn(0x7f1c400bb140 0x7f1c400be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c465c5640 1 -- 172.21.15.40:0/156251871 >> v1:172.21.15.40:6789/0 conn(0x7f1c4006a950 legacy=0x7f1c400bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.854+0000 7f1c465c5640 1 -- 172.21.15.40:0/156251871 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400bb520 con 0x7f1c400bf510 2023-12-20T06:04:52.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c465c5640 1 --2- 172.21.15.40:0/156251871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400bf510 0x7f1c400bfee0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1c40067620 tx=0x7f1c3802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e54084b848ad226 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c44dc2640 1 -- 172.21.15.40:0/156251871 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3802ca80 con 0x7f1c400bf510 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c44dc2640 1 -- 172.21.15.40:0/156251871 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3802cbe0 con 0x7f1c400bf510 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c44dc2640 1 -- 172.21.15.40:0/156251871 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c380343f0 con 0x7f1c400bf510 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c48028640 1 -- 172.21.15.40:0/156251871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400bf510 msgr2=0x7f1c400bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c48028640 1 --2- 172.21.15.40:0/156251871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400bf510 0x7f1c400bfee0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1c40067620 tx=0x7f1c3802bee0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c48028640 1 -- 172.21.15.40:0/156251871 shutdown_connections 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c48028640 1 --2- 172.21.15.40:0/156251871 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400bf510 0x7f1c400bfee0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c48028640 1 --2- 172.21.15.40:0/156251871 >> v2:172.21.15.69:3300/0 conn(0x7f1c400bb140 0x7f1c400be350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c48028640 1 -- 172.21.15.40:0/156251871 >> 172.21.15.40:0/156251871 conn(0x7f1c400bcfd0 msgr2=0x7f1c400bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:52.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.855+0000 7f1c48028640 1 -- 172.21.15.40:0/156251871 shutdown_connections 2023-12-20T06:04:52.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.856+0000 7f1c48028640 1 -- 172.21.15.40:0/156251871 wait complete. 2023-12-20T06:04:52.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.856+0000 7f1c48028640 1 Processor -- start 2023-12-20T06:04:52.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c48028640 1 -- start start 2023-12-20T06:04:52.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c48028640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4006a950 0x7f1c401461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c48028640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c400bb140 0x7f1c400a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c48028640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c400bf510 0x7f1c400b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c48028640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400b43b0 con 0x7f1c4006a950 2023-12-20T06:04:52.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c48028640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c401e0110 con 0x7f1c400bf510 2023-12-20T06:04:52.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c48028640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400b5080 con 0x7f1c400bb140 2023-12-20T06:04:52.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4006a950 0x7f1c401461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4006a950 0x7f1c401461b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53866/0 (socket says 172.21.15.40:53866) 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 -- 172.21.15.40:0/3762514314 learned_addr learned my addr 172.21.15.40:0/3762514314 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c465c5640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c400bf510 0x7f1c400b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c455c3640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c400bb140 0x7f1c400a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 -- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c400bb140 msgr2=0x7f1c400a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c400bb140 0x7f1c400a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 -- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c400bf510 msgr2=0x7f1c400b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c400bf510 0x7f1c400b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.857+0000 7f1c45dc4640 1 -- 172.21.15.40:0/3762514314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38009b30 con 0x7f1c4006a950 2023-12-20T06:04:52.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.858+0000 7f1c45dc4640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4006a950 0x7f1c401461b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00d620 tx=0x7f1c3c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.858+0000 7f1c367fc640 1 -- 172.21.15.40:0/3762514314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00b620 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.858+0000 7f1c367fc640 1 -- 172.21.15.40:0/3762514314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c00b780 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.858+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c401e0360 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.858+0000 7f1c367fc640 1 -- 172.21.15.40:0/3762514314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00bb30 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.858+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c401e0920 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.859+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4009fbb0 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.859+0000 7f1c367fc640 1 -- 172.21.15.40:0/3762514314 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c3c00bc90 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.860+0000 7f1c367fc640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1c2406a430 0x7f1c2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.860+0000 7f1c367fc640 1 -- 172.21.15.40:0/3762514314 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c3c088de0 con 0x7f1c4006a950 2023-12-20T06:04:52.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.860+0000 7f1c455c3640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1c2406a430 0x7f1c2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:52.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.860+0000 7f1c455c3640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1c2406a430 0x7f1c2406c8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1c400bbc50 tx=0x7f1c30009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:52.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:52.864+0000 7f1c367fc640 1 -- 172.21.15.40:0/3762514314 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1c3c0543c0 con 0x7f1c4006a950 2023-12-20T06:04:53.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.038+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c400740a0 con 0x7f1c4006a950 2023-12-20T06:04:53.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.039+0000 7f1c367fc640 1 -- 172.21.15.40:0/3762514314 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c3c0579e0 con 0x7f1c4006a950 2023-12-20T06:04:53.040 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-12-20T06:04:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1c2406a430 msgr2=0x7f1c2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1c2406a430 0x7f1c2406c8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1c400bbc50 tx=0x7f1c30009040 comp rx=0 tx=0).stop 2023-12-20T06:04:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4006a950 msgr2=0x7f1c401461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4006a950 0x7f1c401461b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00d620 tx=0x7f1c3c00dae0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 shutdown_connections 2023-12-20T06:04:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f1c2406a430 0x7f1c2406c8f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c400bf510 0x7f1c400b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f1c400bb140 0x7f1c400a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 --2- 172.21.15.40:0/3762514314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4006a950 0x7f1c401461b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 >> 172.21.15.40:0/3762514314 conn(0x7f1c400bcfd0 msgr2=0x7f1c400a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:53.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 shutdown_connections 2023-12-20T06:04:53.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.041+0000 7f1c48028640 1 -- 172.21.15.40:0/3762514314 wait complete. 2023-12-20T06:04:53.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T06:04:53.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.162+0000 7fc0d7b99640 1 Processor -- start 2023-12-20T06:04:53.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.162+0000 7fc0d7b99640 1 -- start start 2023-12-20T06:04:53.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d7b99640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc0d00bf510 0x7fc0d00be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d7b99640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 0x7fc0d00bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d7b99640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d00bfa50 con 0x7fc0d00bb140 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d7b99640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d00bbda0 con 0x7fc0d00bf510 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d7b99640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d006b040 con 0x7fc0d006a950 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d5935640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc0d00bb140 0x7fc0d00bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44138/0 (socket says 172.21.15.40:44138) 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d5935640 1 -- 172.21.15.40:0/1427071926 learned_addr learned my addr 172.21.15.40:0/1427071926 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441124449 0 0) 0x7fc0d00bfa50 con 0x7fc0d00bb140 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0bc003520 con 0x7fc0d00bb140 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1427071926 >> v2:172.21.15.69:3300/0 conn(0x7fc0d00bf510 0x7fc0d00be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d6136640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 0x7fc0d00bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097659077 0 0) 0x7fc0bc003520 con 0x7fc0d00bb140 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 msgr2=0x7fc0d00bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 0x7fc0d00bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 >> v2:172.21.15.69:3300/0 conn(0x7fc0d00bf510 msgr2=0x7fc0d00be350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 --2- 172.21.15.40:0/1427071926 >> v2:172.21.15.69:3300/0 conn(0x7fc0d00bf510 0x7fc0d00be350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d00bb520 con 0x7fc0d00bb140 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7fc0cc001670 con 0x7fc0d00bb140 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d6136640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 0x7fc0d00bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:53.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 >> v1:172.21.15.40:6789/0 conn(0x7fc0d00bb140 legacy=0x7fc0d00bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 0x7fc0bc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0bc004d00 0x7fc0bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d006b040 con 0x7fc0bc003eb0 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc00b9b0 con 0x7fc0bc004d00 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc00bb70 con 0x7fc0d006a950 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.163+0000 7fc0d5935640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 0x7fc0bc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.164+0000 7fc0d6136640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0bc004d00 0x7fc0bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.164+0000 7fc0d5134640 1 -- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 msgr2=0x7fc0bc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.164+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d006a950 0x7fc0bc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.164+0000 7fc0d5134640 1 -- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0bc004d00 msgr2=0x7fc0bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.164+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0bc004d00 0x7fc0bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.164+0000 7fc0d5134640 1 -- 172.21.15.40:0/1427071926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc003520 con 0x7fc0bc003eb0 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.164+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0bc0047c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc0d006bb10 tx=0x7fc0bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119c0c327159b1d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c002c680 con 0x7fc0bc003eb0 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c002c7e0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d4933640 1 -- 172.21.15.40:0/1427071926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c002cb90 con 0x7fc0bc003eb0 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1427071926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 msgr2=0x7fc0bc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d7b99640 1 --2- 172.21.15.40:0/1427071926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0bc0047c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc0d006bb10 tx=0x7fc0bc0057f0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d6136640 1 -- 172.21.15.40:0/1427071926 reap_dead start 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1427071926 shutdown_connections 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1427071926 >> 172.21.15.40:0/1427071926 conn(0x7fc0d00bcfd0 msgr2=0x7fc0d00bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1427071926 shutdown_connections 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.165+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1427071926 wait complete. 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.166+0000 7fc0d7b99640 1 Processor -- start 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.166+0000 7fc0d7b99640 1 -- start start 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d7b99640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0d01e3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d7b99640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d00b5aa0 0x7fc0d00b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d7b99640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d014e4a0 0x7fc0d0147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d7b99640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00b4080 con 0x7fc0bc003eb0 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d7b99640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d014e930 con 0x7fc0d014e4a0 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d7b99640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00b6d50 con 0x7fc0d00b5aa0 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0d01e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0d01e3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53876/0 (socket says 172.21.15.40:53876) 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 -- 172.21.15.40:0/1374966611 learned_addr learned my addr 172.21.15.40:0/1374966611 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d00b5aa0 0x7fc0d00b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d6136640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d014e4a0 0x7fc0d0147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 -- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d00b5aa0 msgr2=0x7fc0d00b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d00b5aa0 0x7fc0d00b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 -- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d014e4a0 msgr2=0x7fc0d0147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d014e4a0 0x7fc0d0147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 -- 172.21.15.40:0/1374966611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d00b42d0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d6136640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d014e4a0 0x7fc0d0147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0d5935640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0d01e3100 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc007340 tx=0x7fc0cc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.167+0000 7fc0c67fc640 1 -- 172.21.15.40:0/1374966611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00f940 con 0x7fc0bc003eb0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.168+0000 7fc0c67fc640 1 -- 172.21.15.40:0/1374966611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00faa0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.168+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d00b45b0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.168+0000 7fc0c67fc640 1 -- 172.21.15.40:0/1374966611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00fe30 con 0x7fc0bc003eb0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.168+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d00b6980 con 0x7fc0bc003eb0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.168+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d00b47a0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.169+0000 7fc0c67fc640 1 -- 172.21.15.40:0/1374966611 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0cc01d460 con 0x7fc0bc003eb0 2023-12-20T06:04:53.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.169+0000 7fc0c67fc640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc0b406a460 0x7fc0b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.169+0000 7fc0c67fc640 1 -- 172.21.15.40:0/1374966611 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0cc088bb0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.170+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc0b406a460 0x7fc0b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.170+0000 7fc0d5134640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc0b406a460 0x7fc0b406c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0036000 tx=0x7fc0c0030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.174+0000 7fc0c67fc640 1 -- 172.21.15.40:0/1374966611 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc0cc054190 con 0x7fc0bc003eb0 2023-12-20T06:04:53.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.348+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0d00740a0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.349+0000 7fc0c67fc640 1 -- 172.21.15.40:0/1374966611 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0cc0577b0 con 0x7fc0bc003eb0 2023-12-20T06:04:53.350 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-12-20T06:04:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc0b406a460 msgr2=0x7fc0b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc0b406a460 0x7fc0b406c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0036000 tx=0x7fc0c0030000 comp rx=0 tx=0).stop 2023-12-20T06:04:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 msgr2=0x7fc0d01e3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0d01e3100 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc007340 tx=0x7fc0cc007800 comp rx=0 tx=0).stop 2023-12-20T06:04:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 shutdown_connections 2023-12-20T06:04:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc0b406a460 0x7fc0b406c920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0d014e4a0 0x7fc0d0147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc0d00b5aa0 0x7fc0d00b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 --2- 172.21.15.40:0/1374966611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0bc003eb0 0x7fc0d01e3100 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.350+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 >> 172.21.15.40:0/1374966611 conn(0x7fc0d00bcfd0 msgr2=0x7fc0d00a42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.351+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 shutdown_connections 2023-12-20T06:04:53.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.351+0000 7fc0d7b99640 1 -- 172.21.15.40:0/1374966611 wait complete. 2023-12-20T06:04:53.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T06:04:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.468+0000 7f9c1a3b1640 1 Processor -- start 2023-12-20T06:04:53.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.468+0000 7f9c1a3b1640 1 -- start start 2023-12-20T06:04:53.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c1a3b1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c140bcdd0 0x7f9c140b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c1a3b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c14144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c1a3b1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c140bc6b0 con 0x7f9c14144cd0 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c1a3b1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c140b6900 con 0x7f9c140bcdd0 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c1a3b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140a59f0 con 0x7f9c140b64c0 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c13fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c140bcdd0 0x7f9c140b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c1894e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9c14144cd0 0x7f9c1414e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44148/0 (socket says 172.21.15.40:44148) 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c13fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9c140bcdd0 0x7f9c140b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53884/0 (socket says 172.21.15.40:53884) 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c1894e640 1 -- 172.21.15.40:0/2534370641 learned_addr learned my addr 172.21.15.40:0/2534370641 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:53.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c137fe640 1 --2- 172.21.15.40:0/2534370641 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c14144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c13fff640 1 -- 172.21.15.40:0/2534370641 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 msgr2=0x7f9c14144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c13fff640 1 --2- 172.21.15.40:0/2534370641 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c14144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c13fff640 1 -- 172.21.15.40:0/2534370641 >> v1:172.21.15.40:6789/0 conn(0x7f9c14144cd0 legacy=0x7f9c1414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.469+0000 7f9c13fff640 1 -- 172.21.15.40:0/2534370641 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140bc0a0 con 0x7f9c140bcdd0 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.470+0000 7f9c13fff640 1 --2- 172.21.15.40:0/2534370641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c140b5f80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9c080097a0 tx=0x7f9c0802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a7c3d2bdb3e8c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.470+0000 7f9c12ffd640 1 -- 172.21.15.40:0/2534370641 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08030610 con 0x7f9c140bcdd0 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.470+0000 7f9c12ffd640 1 -- 172.21.15.40:0/2534370641 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08030770 con 0x7f9c140bcdd0 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.470+0000 7f9c12ffd640 1 -- 172.21.15.40:0/2534370641 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08030b00 con 0x7f9c140bcdd0 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/2534370641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 msgr2=0x7f9c140b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/2534370641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c140b5f80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9c080097a0 tx=0x7f9c0802b960 comp rx=0 tx=0).stop 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/2534370641 shutdown_connections 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/2534370641 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c14144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/2534370641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c140b5f80 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/2534370641 >> 172.21.15.40:0/2534370641 conn(0x7f9c14071e60 msgr2=0x7f9c140c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/2534370641 shutdown_connections 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.471+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/2534370641 wait complete. 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.472+0000 7f9c1a3b1640 1 Processor -- start 2023-12-20T06:04:53.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.472+0000 7f9c1a3b1640 1 -- start start 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c1413fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c14146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c14144cd0 0x7f9c14147a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1413ff80 con 0x7f9c140bcdd0 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c14142600 con 0x7f9c14144cd0 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1414aa00 con 0x7f9c140b64c0 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c14146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c14146650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53892/0 (socket says 172.21.15.40:53892) 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 -- 172.21.15.40:0/522326540 learned_addr learned my addr 172.21.15.40:0/522326540 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:53.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1894e640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c14144cd0 0x7f9c14147a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c13fff640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c1413fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 -- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 msgr2=0x7f9c1413fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c1413fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 -- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c14144cd0 msgr2=0x7f9c14147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c14144cd0 0x7f9c14147a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 -- 172.21.15.40:0/522326540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c08009400 con 0x7f9c140bcdd0 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1894e640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c14144cd0 0x7f9c14147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c137fe640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c14146650 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400e9b0 tx=0x7f9c0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c10ff9640 1 -- 172.21.15.40:0/522326540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04009670 con 0x7f9c140bcdd0 2023-12-20T06:04:53.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c10ff9640 1 -- 172.21.15.40:0/522326540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0400c9a0 con 0x7f9c140bcdd0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c10ff9640 1 -- 172.21.15.40:0/522326540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400cd50 con 0x7f9c140bcdd0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1414b820 con 0x7f9c140bcdd0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.473+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c14145790 con 0x7f9c140bcdd0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.474+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c140b8d00 con 0x7f9c140bcdd0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.475+0000 7f9c10ff9640 1 -- 172.21.15.40:0/522326540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c04013470 con 0x7f9c140bcdd0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.475+0000 7f9c10ff9640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c0006a430 0x7f9c0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.475+0000 7f9c10ff9640 1 -- 172.21.15.40:0/522326540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c04088b50 con 0x7f9c140bcdd0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.475+0000 7f9c13fff640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c0006a430 0x7f9c0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.476+0000 7f9c13fff640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c0006a430 0x7f9c0006c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c08036000 tx=0x7f9c0803b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.479+0000 7f9c10ff9640 1 -- 172.21.15.40:0/522326540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9c040541d0 con 0x7f9c140bcdd0 2023-12-20T06:04:53.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.695+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c1404e840 con 0x7f9c140bcdd0 2023-12-20T06:04:53.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.696+0000 7f9c10ff9640 1 -- 172.21.15.40:0/522326540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3952 (secure 0 0 0) 0x7f9c04017090 con 0x7f9c140bcdd0 2023-12-20T06:04:53.697 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:53.697 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1306717467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1306717467},{"type":"v1","addr":"172.21.15.40:6835","nonce":1306717467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4625,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1583424120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1583424120},{"type":"v1","addr":"172.21.15.69:6835","nonce":1583424120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:24:05.927869+0000","modified":"2023-12-20T04:24:08.263654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/3041271085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3041271085},{"type":"v1","addr":"172.21.15.40:6834","nonce":3041271085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T06:04:53.698 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2023-12-20T06:04:53.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c0006a430 msgr2=0x7f9c0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c0006a430 0x7f9c0006c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c08036000 tx=0x7f9c0803b040 comp rx=0 tx=0).stop 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 msgr2=0x7f9c14146650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c14146650 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400e9b0 tx=0x7f9c0400ee70 comp rx=0 tx=0).stop 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 shutdown_connections 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c0006a430 0x7f9c0006c8f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c14144cd0 0x7f9c14147a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c140bcdd0 0x7f9c14146650 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 --2- 172.21.15.40:0/522326540 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c140b64c0 0x7f9c1413fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 >> 172.21.15.40:0/522326540 conn(0x7f9c14071e60 msgr2=0x7f9c140b85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 shutdown_connections 2023-12-20T06:04:53.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.698+0000 7f9c1a3b1640 1 -- 172.21.15.40:0/522326540 wait complete. 2023-12-20T06:04:53.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T06:04:53.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.816+0000 7f3fa4b3e640 1 Processor -- start 2023-12-20T06:04:53.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.816+0000 7f3fa4b3e640 1 -- start start 2023-12-20T06:04:53.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.816+0000 7f3fa4b3e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fa006acb0 0x7f3fa006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.816+0000 7f3fa4b3e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa00b9a60 0x7f3fa0155430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.816+0000 7f3fa4b3e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa00b7e40 con 0x7f3fa00b9600 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.816+0000 7f3fa4b3e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa0144ff0 con 0x7f3fa006acb0 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.816+0000 7f3fa4b3e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa014f000 con 0x7f3fa00b9a60 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fa006acb0 0x7f3fa006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3fa006acb0 0x7f3fa006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53898/0 (socket says 172.21.15.40:53898) 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9e59c640 1 -- 172.21.15.40:0/873640086 learned_addr learned my addr 172.21.15.40:0/873640086 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9ed9d640 1 --2- 172.21.15.40:0/873640086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa00b9a60 0x7f3fa0155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9e59c640 1 -- 172.21.15.40:0/873640086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa00b9a60 msgr2=0x7f3fa0155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:53.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9e59c640 1 --2- 172.21.15.40:0/873640086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa00b9a60 0x7f3fa0155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9e59c640 1 -- 172.21.15.40:0/873640086 >> v1:172.21.15.69:6789/0 conn(0x7f3fa00b9600 legacy=0x7f3fa014aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.817+0000 7f3f9e59c640 1 -- 172.21.15.40:0/873640086 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa014e240 con 0x7f3fa006acb0 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3f9e59c640 1 --2- 172.21.15.40:0/873640086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa006acb0 0x7f3fa006b090 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3f940098a0 tx=0x7f3f9402ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97eb2c8541fc774 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3f9d59a640 1 -- 172.21.15.40:0/873640086 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9402f830 con 0x7f3fa006acb0 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3f9d59a640 1 -- 172.21.15.40:0/873640086 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9402f990 con 0x7f3fa006acb0 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3f9d59a640 1 -- 172.21.15.40:0/873640086 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9402fd20 con 0x7f3fa006acb0 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/873640086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa006acb0 msgr2=0x7f3fa006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/873640086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa006acb0 0x7f3fa006b090 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3f940098a0 tx=0x7f3f9402ba10 comp rx=0 tx=0).stop 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/873640086 shutdown_connections 2023-12-20T06:04:53.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/873640086 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa00b9a60 0x7f3fa0155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/873640086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa006acb0 0x7f3fa006b090 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/873640086 >> 172.21.15.40:0/873640086 conn(0x7f3fa0069ba0 msgr2=0x7f3fa0069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:53.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/873640086 shutdown_connections 2023-12-20T06:04:53.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.818+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/873640086 wait complete. 2023-12-20T06:04:53.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 Processor -- start 2023-12-20T06:04:53.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 -- start start 2023-12-20T06:04:53.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa006acb0 0x7f3fa014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fa00b9600 0x7f3fa0146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa00b9a60 0x7f3fa0147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa014d8b0 con 0x7f3fa00b9a60 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0147690 con 0x7f3fa00b9600 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3fa4b3e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0147820 con 0x7f3fa006acb0 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3f9ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa00b9a60 0x7f3fa0147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3f9ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa00b9a60 0x7f3fa0147cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53902/0 (socket says 172.21.15.40:53902) 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3f9ed9d640 1 -- 172.21.15.40:0/2332278978 learned_addr learned my addr 172.21.15.40:0/2332278978 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3f9e59c640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa006acb0 0x7f3fa014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.820+0000 7f3f9dd9b640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fa00b9600 0x7f3fa0146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f9ed9d640 1 -- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa006acb0 msgr2=0x7f3fa014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f9ed9d640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa006acb0 0x7f3fa014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f9ed9d640 1 -- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fa00b9600 msgr2=0x7f3fa0146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f9ed9d640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fa00b9600 0x7f3fa0146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f9ed9d640 1 -- 172.21.15.40:0/2332278978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940094d0 con 0x7f3fa00b9a60 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f9ed9d640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa00b9a60 0x7f3fa0147cb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800efc0 tx=0x7f3f9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f8effd640 1 -- 172.21.15.40:0/2332278978 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98009b20 con 0x7f3fa00b9a60 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f8effd640 1 -- 172.21.15.40:0/2332278978 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9800f040 con 0x7f3fa00b9a60 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa0146ff0 con 0x7f3fa00b9a60 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3f8effd640 1 -- 172.21.15.40:0/2332278978 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980146c0 con 0x7f3fa00b9a60 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.821+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa0145d50 con 0x7f3fa00b9a60 2023-12-20T06:04:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.822+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa004e840 con 0x7f3fa00b9a60 2023-12-20T06:04:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.822+0000 7f3f8effd640 1 -- 172.21.15.40:0/2332278978 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f98014820 con 0x7f3fa00b9a60 2023-12-20T06:04:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.823+0000 7f3f8effd640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f8006a430 0x7f3f8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.823+0000 7f3f8effd640 1 -- 172.21.15.40:0/2332278978 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f98089570 con 0x7f3fa00b9a60 2023-12-20T06:04:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.823+0000 7f3f9e59c640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f8006a430 0x7f3f8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.824+0000 7f3f9e59c640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f8006a430 0x7f3f8006c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f94036000 tx=0x7f3f94008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:53.827+0000 7f3f8effd640 1 -- 172.21.15.40:0/2332278978 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f98054c10 con 0x7f3fa00b9a60 2023-12-20T06:04:54.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.005+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fa0147960 con 0x7f3fa00b9a60 2023-12-20T06:04:54.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.006+0000 7f3f8effd640 1 -- 172.21.15.40:0/2332278978 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f3f98009e60 con 0x7f3fa00b9a60 2023-12-20T06:04:54.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:54.007 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:24:06.929899+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:24:03.672943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:24:04.910865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f8006a430 msgr2=0x7f3f8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f8006a430 0x7f3f8006c8f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f94036000 tx=0x7f3f94008030 comp rx=0 tx=0).stop 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa00b9a60 msgr2=0x7f3fa0147cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa00b9a60 0x7f3fa0147cb0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800efc0 tx=0x7f3f9800c490 comp rx=0 tx=0).stop 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 shutdown_connections 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3f8006a430 0x7f3f8006c8f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3fa00b9a60 0x7f3fa0147cb0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fa00b9600 0x7f3fa0146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 --2- 172.21.15.40:0/2332278978 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3fa006acb0 0x7f3fa014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 >> 172.21.15.40:0/2332278978 conn(0x7f3fa0069ba0 msgr2=0x7f3fa00b9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 shutdown_connections 2023-12-20T06:04:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.008+0000 7f3fa4b3e640 1 -- 172.21.15.40:0/2332278978 wait complete. 2023-12-20T06:04:54.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T06:04:54.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T06:04:54.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.126+0000 7f426beaf640 1 Processor -- start 2023-12-20T06:04:54.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.126+0000 7f426beaf640 1 -- start start 2023-12-20T06:04:54.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f426beaf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 0x7f426414aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f426beaf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640b7e40 con 0x7f42640b9a60 2023-12-20T06:04:54.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f426beaf640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426414e240 con 0x7f426406acb0 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f426beaf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4264144ff0 con 0x7f42640b9600 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f426a44c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f42640b9a60 0x7f4264155430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44162/0 (socket says 172.21.15.40:44162) 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f426a44c640 1 -- 172.21.15.40:0/2268943309 learned_addr learned my addr 172.21.15.40:0/2268943309 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f426944a640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 0x7f426414aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567239715 0 0) 0x7f42640b7e40 con 0x7f42640b9a60 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4250003520 con 0x7f42640b9a60 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171903883 0 0) 0x7f4250003520 con 0x7f42640b9a60 2023-12-20T06:04:54.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 msgr2=0x7f426414aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 0x7f426414aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 >> v1:172.21.15.69:6789/0 conn(0x7f426406acb0 legacy=0x7f426406b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426414e520 con 0x7f42640b9a60 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f425c0019f0 con 0x7f42640b9a60 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 >> v1:172.21.15.40:6789/0 conn(0x7f42640b9a60 legacy=0x7f4264155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.127+0000 7f4268c49640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42500039a0 0x7f4250003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f4268c49640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 0x7f42500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f4268c49640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4250004d00 0x7f4250005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4264144ff0 con 0x7f4250004d00 2023-12-20T06:04:54.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425000bac0 con 0x7f42500039a0 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425000bc80 con 0x7f42640b9600 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426a44c640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4250004d00 0x7f4250005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f4269c4b640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42500039a0 0x7f4250003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426944a640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 0x7f42500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426a44c640 1 -- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 msgr2=0x7f42500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426a44c640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 0x7f42500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426a44c640 1 -- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42500039a0 msgr2=0x7f4250003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426a44c640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42500039a0 0x7f4250003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426a44c640 1 -- 172.21.15.40:0/2268943309 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250003520 con 0x7f4250004d00 2023-12-20T06:04:54.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.128+0000 7f426944a640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42640b9600 0x7f42500047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426a44c640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4250004d00 0x7f4250005180 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f425c00a800 tx=0x7f42500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfcae958861374c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0072d0 con 0x7f4250004d00 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c02f070 con 0x7f4250004d00 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f4268c49640 1 -- 172.21.15.40:0/2268943309 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0076b0 con 0x7f4250004d00 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426beaf640 1 -- 172.21.15.40:0/2268943309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4250004d00 msgr2=0x7f4250005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426beaf640 1 --2- 172.21.15.40:0/2268943309 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4250004d00 0x7f4250005180 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f425c00a800 tx=0x7f42500057f0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426a44c640 1 -- 172.21.15.40:0/2268943309 reap_dead start 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426beaf640 1 -- 172.21.15.40:0/2268943309 shutdown_connections 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426beaf640 1 -- 172.21.15.40:0/2268943309 >> 172.21.15.40:0/2268943309 conn(0x7f4264069ba0 msgr2=0x7f4264069fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:54.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426beaf640 1 -- 172.21.15.40:0/2268943309 shutdown_connections 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.129+0000 7f426beaf640 1 -- 172.21.15.40:0/2268943309 wait complete. 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 Processor -- start 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 -- start start 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4264147c10 0x7f4264147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42641d48a0 0x7f42641d5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42641d4d20 0x7f4264143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42641d7d10 con 0x7f42641d4d20 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42641d7ac0 con 0x7f4264147c10 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426beaf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42641d70c0 con 0x7f42641d48a0 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426a44c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42641d4d20 0x7f4264143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426a44c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42641d4d20 0x7f4264143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53920/0 (socket says 172.21.15.40:53920) 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426a44c640 1 -- 172.21.15.40:0/3185054572 learned_addr learned my addr 172.21.15.40:0/3185054572 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f4269c4b640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4264147c10 0x7f4264147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.131+0000 7f426944a640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42641d48a0 0x7f42641d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426a44c640 1 -- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42641d48a0 msgr2=0x7f42641d5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426a44c640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42641d48a0 0x7f42641d5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426a44c640 1 -- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4264147c10 msgr2=0x7f4264147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426a44c640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4264147c10 0x7f4264147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426a44c640 1 -- 172.21.15.40:0/3185054572 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264146d10 con 0x7f42641d4d20 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426a44c640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42641d4d20 0x7f4264143ba0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f425c001cb0 tx=0x7f425c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f425a7fc640 1 -- 172.21.15.40:0/3185054572 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c044070 con 0x7f42641d4d20 2023-12-20T06:04:54.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42641d4530 con 0x7f42641d4d20 2023-12-20T06:04:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f425a7fc640 1 -- 172.21.15.40:0/3185054572 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c02ce90 con 0x7f42641d4d20 2023-12-20T06:04:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.132+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42641d61b0 con 0x7f42641d4d20 2023-12-20T06:04:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.133+0000 7f425a7fc640 1 -- 172.21.15.40:0/3185054572 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0074e0 con 0x7f42641d4d20 2023-12-20T06:04:54.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.133+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42641d4390 con 0x7f42641d4d20 2023-12-20T06:04:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.134+0000 7f425a7fc640 1 -- 172.21.15.40:0/3185054572 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f425c031030 con 0x7f42641d4d20 2023-12-20T06:04:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.134+0000 7f425a7fc640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f424806a430 0x7f424806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.134+0000 7f425a7fc640 1 -- 172.21.15.40:0/3185054572 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f425c0aa1c0 con 0x7f42641d4d20 2023-12-20T06:04:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.135+0000 7f4269c4b640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f424806a430 0x7f424806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.135+0000 7f4269c4b640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f424806a430 0x7f424806c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4260001760 tx=0x7f4260009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.138+0000 7f425a7fc640 1 -- 172.21.15.40:0/3185054572 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f42641d4390 con 0x7f42641d4d20 2023-12-20T06:04:54.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.353+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42641d72b0 con 0x7f42641d4d20 2023-12-20T06:04:54.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.353+0000 7f425a7fc640 1 -- 172.21.15.40:0/3185054572 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3952 (secure 0 0 0) 0x7f42641d72b0 con 0x7f42641d4d20 2023-12-20T06:04:54.354 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:54.354 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1306717467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1306717467},{"type":"v1","addr":"172.21.15.40:6835","nonce":1306717467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4625,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1583424120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1583424120},{"type":"v1","addr":"172.21.15.69:6835","nonce":1583424120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:24:05.927869+0000","modified":"2023-12-20T04:24:08.263654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/3041271085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3041271085},{"type":"v1","addr":"172.21.15.40:6834","nonce":3041271085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T06:04:54.355 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2023-12-20T06:04:54.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f424806a430 msgr2=0x7f424806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f424806a430 0x7f424806c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4260001760 tx=0x7f4260009040 comp rx=0 tx=0).stop 2023-12-20T06:04:54.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42641d4d20 msgr2=0x7f4264143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42641d4d20 0x7f4264143ba0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f425c001cb0 tx=0x7f425c001d80 comp rx=0 tx=0).stop 2023-12-20T06:04:54.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 shutdown_connections 2023-12-20T06:04:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f424806a430 0x7f424806c8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42641d4d20 0x7f4264143ba0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f42641d48a0 0x7f42641d5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 --2- 172.21.15.40:0/3185054572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4264147c10 0x7f4264147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 >> 172.21.15.40:0/3185054572 conn(0x7f4264069ba0 msgr2=0x7f42640bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 shutdown_connections 2023-12-20T06:04:54.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.355+0000 7f426beaf640 1 -- 172.21.15.40:0/3185054572 wait complete. 2023-12-20T06:04:54.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T06:04:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.473+0000 7fcbf2bea640 1 Processor -- start 2023-12-20T06:04:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.473+0000 7fcbf2bea640 1 -- start start 2023-12-20T06:04:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf2bea640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6730 0x7fcbec14aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf2bea640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbec0b6b10 0x7fcbec069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf2bea640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcbec0710b0 0x7fcbec06a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf2bea640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0b4110 con 0x7fcbec0b6b10 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf2bea640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec14b010 con 0x7fcbec0710b0 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf2bea640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec06b800 con 0x7fcbec0b6730 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbebfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbec0b6b10 0x7fcbec069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbebfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbec0b6b10 0x7fcbec069ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53924/0 (socket says 172.21.15.40:53924) 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbebfff640 1 -- 172.21.15.40:0/3604056653 learned_addr learned my addr 172.21.15.40:0/3604056653 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf0986640 1 --2- 172.21.15.40:0/3604056653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6730 0x7fcbec14aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.474+0000 7fcbf1187640 1 --2- 172.21.15.40:0/3604056653 >> v2:172.21.15.69:3300/0 conn(0x7fcbec0710b0 0x7fcbec06a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.475+0000 7fcbebfff640 1 -- 172.21.15.40:0/3604056653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6730 msgr2=0x7fcbec14aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.475+0000 7fcbebfff640 1 --2- 172.21.15.40:0/3604056653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6730 0x7fcbec14aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.475+0000 7fcbebfff640 1 -- 172.21.15.40:0/3604056653 >> v2:172.21.15.69:3300/0 conn(0x7fcbec0710b0 msgr2=0x7fcbec06a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.475+0000 7fcbebfff640 1 --2- 172.21.15.40:0/3604056653 >> v2:172.21.15.69:3300/0 conn(0x7fcbec0710b0 0x7fcbec06a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.475+0000 7fcbebfff640 1 -- 172.21.15.40:0/3604056653 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0b3b50 con 0x7fcbec0b6b10 2023-12-20T06:04:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.475+0000 7fcbebfff640 1 --2- 172.21.15.40:0/3604056653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0b6b10 0x7fcbec069ba0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009870 tx=0x7fcbe002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a4d167c0cd1c05 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbeb7fe640 1 -- 172.21.15.40:0/3604056653 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0030840 con 0x7fcbec0b6b10 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbeb7fe640 1 -- 172.21.15.40:0/3604056653 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00309a0 con 0x7fcbec0b6b10 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbeb7fe640 1 -- 172.21.15.40:0/3604056653 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0030d30 con 0x7fcbec0b6b10 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 -- 172.21.15.40:0/3604056653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0b6b10 msgr2=0x7fcbec069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/3604056653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0b6b10 0x7fcbec069ba0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0009870 tx=0x7fcbe002b980 comp rx=0 tx=0).stop 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 -- 172.21.15.40:0/3604056653 shutdown_connections 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/3604056653 >> v2:172.21.15.69:3300/0 conn(0x7fcbec0710b0 0x7fcbec06a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/3604056653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0b6b10 0x7fcbec069ba0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/3604056653 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6730 0x7fcbec14aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 -- 172.21.15.40:0/3604056653 >> 172.21.15.40:0/3604056653 conn(0x7fcbec0bcf60 msgr2=0x7fcbec0bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 -- 172.21.15.40:0/3604056653 shutdown_connections 2023-12-20T06:04:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.476+0000 7fcbf2bea640 1 -- 172.21.15.40:0/3604056653 wait complete. 2023-12-20T06:04:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.477+0000 7fcbf2bea640 1 Processor -- start 2023-12-20T06:04:54.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.477+0000 7fcbf2bea640 1 -- start start 2023-12-20T06:04:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf2bea640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0710b0 0x7fcbec13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf2bea640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbec0b6730 0x7fcbec1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf2bea640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6b10 0x7fcbec13d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf2bea640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec146630 con 0x7fcbec0710b0 2023-12-20T06:04:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf2bea640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec13f960 con 0x7fcbec0b6730 2023-12-20T06:04:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf2bea640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec145f60 con 0x7fcbec0b6b10 2023-12-20T06:04:54.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0710b0 0x7fcbec13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0710b0 0x7fcbec13f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53938/0 (socket says 172.21.15.40:53938) 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 -- 172.21.15.40:0/4124765391 learned_addr learned my addr 172.21.15.40:0/4124765391 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbebfff640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbec0b6730 0x7fcbec1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf1187640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6b10 0x7fcbec13d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 -- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6b10 msgr2=0x7fcbec13d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6b10 0x7fcbec13d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 -- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbec0b6730 msgr2=0x7fcbec1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbec0b6730 0x7fcbec1473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbf0986640 1 -- 172.21.15.40:0/4124765391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00094d0 con 0x7fcbec0710b0 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.478+0000 7fcbebfff640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbec0b6730 0x7fcbec1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.479+0000 7fcbf0986640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0710b0 0x7fcbec13f420 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00e9b0 tx=0x7fcbdc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.479+0000 7fcbe97fa640 1 -- 172.21.15.40:0/4124765391 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc009670 con 0x7fcbec0710b0 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.479+0000 7fcbe97fa640 1 -- 172.21.15.40:0/4124765391 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00c9a0 con 0x7fcbec0710b0 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.479+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec14e720 con 0x7fcbec0710b0 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.479+0000 7fcbe97fa640 1 -- 172.21.15.40:0/4124765391 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00cd50 con 0x7fcbec0710b0 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.479+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec14dbb0 con 0x7fcbec0710b0 2023-12-20T06:04:54.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.480+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec04e840 con 0x7fcbec0710b0 2023-12-20T06:04:54.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.480+0000 7fcbe97fa640 1 -- 172.21.15.40:0/4124765391 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbdc013470 con 0x7fcbec0710b0 2023-12-20T06:04:54.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.481+0000 7fcbe97fa640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbd806a460 0x7fcbd806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.481+0000 7fcbe97fa640 1 -- 172.21.15.40:0/4124765391 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbdc0889b0 con 0x7fcbec0710b0 2023-12-20T06:04:54.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.481+0000 7fcbebfff640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbd806a460 0x7fcbd806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.481+0000 7fcbebfff640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbd806a460 0x7fcbd806c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0036000 tx=0x7fcbe0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.485+0000 7fcbe97fa640 1 -- 172.21.15.40:0/4124765391 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcbdc053f90 con 0x7fcbec0710b0 2023-12-20T06:04:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.700+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbec14e720 con 0x7fcbec0710b0 2023-12-20T06:04:54.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.701+0000 7fcbe97fa640 1 -- 172.21.15.40:0/4124765391 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3952 (secure 0 0 0) 0x7fcbec14e720 con 0x7fcbec0710b0 2023-12-20T06:04:54.702 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:54.702 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1306717467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1306717467},{"type":"v1","addr":"172.21.15.40:6835","nonce":1306717467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4625,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1583424120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1583424120},{"type":"v1","addr":"172.21.15.69:6835","nonce":1583424120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:24:05.927869+0000","modified":"2023-12-20T04:24:08.263654+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6834/3041271085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":3041271085},{"type":"v1","addr":"172.21.15.40:6834","nonce":3041271085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T06:04:54.703 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 13 2023-12-20T06:04:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbd806a460 msgr2=0x7fcbd806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbd806a460 0x7fcbd806c920 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0036000 tx=0x7fcbe0008030 comp rx=0 tx=0).stop 2023-12-20T06:04:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0710b0 msgr2=0x7fcbec13f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0710b0 0x7fcbec13f420 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00e9b0 tx=0x7fcbdc00ee70 comp rx=0 tx=0).stop 2023-12-20T06:04:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 shutdown_connections 2023-12-20T06:04:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcbd806a460 0x7fcbd806c920 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcbec0b6b10 0x7fcbec13d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbec0b6730 0x7fcbec1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 --2- 172.21.15.40:0/4124765391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbec0710b0 0x7fcbec13f420 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 >> 172.21.15.40:0/4124765391 conn(0x7fcbec0bcf60 msgr2=0x7fcbec0b5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 shutdown_connections 2023-12-20T06:04:54.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.703+0000 7fcbf2bea640 1 -- 172.21.15.40:0/4124765391 wait complete. 2023-12-20T06:04:54.715 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T06:04:54.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff9a2042640 1 Processor -- start 2023-12-20T06:04:54.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff9a2042640 1 -- start start 2023-12-20T06:04:54.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff9a2042640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff99c0bcdd0 0x7ff99c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff9a2042640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff99c0b64c0 0x7ff99c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff9a2042640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0bc6b0 con 0x7ff99c144cd0 2023-12-20T06:04:54.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff9a2042640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0b6900 con 0x7ff99c0b64c0 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff9a2042640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0a59f0 con 0x7ff99c0bcdd0 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff99affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff99c0b64c0 0x7ff99c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff99affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff99c0b64c0 0x7ff99c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53942/0 (socket says 172.21.15.40:53942) 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.822+0000 7ff99affd640 1 -- 172.21.15.40:0/486336322 learned_addr learned my addr 172.21.15.40:0/486336322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.823+0000 7ff99b7fe640 1 --2- 172.21.15.40:0/486336322 >> v2:172.21.15.69:3300/0 conn(0x7ff99c0bcdd0 0x7ff99c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.823+0000 7ff99affd640 1 -- 172.21.15.40:0/486336322 >> v2:172.21.15.69:3300/0 conn(0x7ff99c0bcdd0 msgr2=0x7ff99c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.823+0000 7ff99affd640 1 --2- 172.21.15.40:0/486336322 >> v2:172.21.15.69:3300/0 conn(0x7ff99c0bcdd0 0x7ff99c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.823+0000 7ff99affd640 1 -- 172.21.15.40:0/486336322 >> v1:172.21.15.69:6789/0 conn(0x7ff99c144cd0 legacy=0x7ff99c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.823+0000 7ff99affd640 1 -- 172.21.15.40:0/486336322 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0bc0a0 con 0x7ff99c0b64c0 2023-12-20T06:04:54.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.823+0000 7ff99b7fe640 1 --2- 172.21.15.40:0/486336322 >> v2:172.21.15.69:3300/0 conn(0x7ff99c0bcdd0 0x7ff99c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.823+0000 7ff99affd640 1 --2- 172.21.15.40:0/486336322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c144790 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0c10f0 tx=0x7ff99002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d2e9031e36ea3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff99a7fc640 1 -- 172.21.15.40:0/486336322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99002f850 con 0x7ff99c0b64c0 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff99a7fc640 1 -- 172.21.15.40:0/486336322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99002f9b0 con 0x7ff99c0b64c0 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff99a7fc640 1 -- 172.21.15.40:0/486336322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99002fd40 con 0x7ff99c0b64c0 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 -- 172.21.15.40:0/486336322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 msgr2=0x7ff99c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 --2- 172.21.15.40:0/486336322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c144790 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0c10f0 tx=0x7ff99002ba30 comp rx=0 tx=0).stop 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 -- 172.21.15.40:0/486336322 shutdown_connections 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 --2- 172.21.15.40:0/486336322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c144790 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 --2- 172.21.15.40:0/486336322 >> v2:172.21.15.69:3300/0 conn(0x7ff99c0bcdd0 0x7ff99c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 -- 172.21.15.40:0/486336322 >> 172.21.15.40:0/486336322 conn(0x7ff99c071e60 msgr2=0x7ff99c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:54.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 -- 172.21.15.40:0/486336322 shutdown_connections 2023-12-20T06:04:54.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.824+0000 7ff9a2042640 1 -- 172.21.15.40:0/486336322 wait complete. 2023-12-20T06:04:54.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.825+0000 7ff9a2042640 1 Processor -- start 2023-12-20T06:04:54.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.825+0000 7ff9a2042640 1 -- start start 2023-12-20T06:04:54.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff9a2042640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff9a2042640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff99c0bcdd0 0x7ff99c148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff9a2042640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff99c144cd0 0x7ff99c13e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff9a2042640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c13eb60 con 0x7ff99c0b64c0 2023-12-20T06:04:54.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff9a2042640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c147480 con 0x7ff99c0bcdd0 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff9a2042640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c147740 con 0x7ff99c144cd0 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53956/0 (socket says 172.21.15.40:53956) 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 -- 172.21.15.40:0/1650871146 learned_addr learned my addr 172.21.15.40:0/1650871146 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99affd640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff99c0bcdd0 0x7ff99c148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99bfff640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff99c144cd0 0x7ff99c13e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 -- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff99c144cd0 msgr2=0x7ff99c13e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff99c144cd0 0x7ff99c13e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 -- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff99c0bcdd0 msgr2=0x7ff99c148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff99c0bcdd0 0x7ff99c148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99b7fe640 1 -- 172.21.15.40:0/1650871146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900094d0 con 0x7ff99c0b64c0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.826+0000 7ff99affd640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff99c0bcdd0 0x7ff99c148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.827+0000 7ff99b7fe640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c147bd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e760 tx=0x7ff98c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.827+0000 7ff983fff640 1 -- 172.21.15.40:0/1650871146 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c004230 con 0x7ff99c0b64c0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.827+0000 7ff983fff640 1 -- 172.21.15.40:0/1650871146 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c004390 con 0x7ff99c0b64c0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.827+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c148610 con 0x7ff99c0b64c0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.827+0000 7ff983fff640 1 -- 172.21.15.40:0/1650871146 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00c8f0 con 0x7ff99c0b64c0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.827+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c1453f0 con 0x7ff99c0b64c0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.828+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c148390 con 0x7ff99c0b64c0 2023-12-20T06:04:54.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.828+0000 7ff983fff640 1 -- 172.21.15.40:0/1650871146 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff98c00ca50 con 0x7ff99c0b64c0 2023-12-20T06:04:54.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.829+0000 7ff983fff640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff98806a430 0x7ff98806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:54.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.829+0000 7ff983fff640 1 -- 172.21.15.40:0/1650871146 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff98c088570 con 0x7ff99c0b64c0 2023-12-20T06:04:54.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.829+0000 7ff99affd640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff98806a430 0x7ff98806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:54.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.830+0000 7ff99affd640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff98806a430 0x7ff98806c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff990036000 tx=0x7ff990039040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:54.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:54.833+0000 7ff983fff640 1 -- 172.21.15.40:0/1650871146 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff98c053b50 con 0x7ff99c0b64c0 2023-12-20T06:04:55.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.009+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff99c0bc310 con 0x7ff99c0b64c0 2023-12-20T06:04:55.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.010+0000 7ff983fff640 1 -- 172.21.15.40:0/1650871146 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16053 (secure 0 0 0) 0x7ff98c057170 con 0x7ff99c0b64c0 2023-12-20T06:04:55.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:04:55.011 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":31,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T04:24:06.929899+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:24:03.672943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:24:04.910865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T06:04:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff98806a430 msgr2=0x7ff98806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff98806a430 0x7ff98806c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff990036000 tx=0x7ff990039040 comp rx=0 tx=0).stop 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 msgr2=0x7ff99c147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c147bd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e760 tx=0x7ff98c00ec20 comp rx=0 tx=0).stop 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 shutdown_connections 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff98806a430 0x7ff98806c8f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff99c144cd0 0x7ff99c13e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff99c0bcdd0 0x7ff99c148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 --2- 172.21.15.40:0/1650871146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff99c0b64c0 0x7ff99c147bd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 >> 172.21.15.40:0/1650871146 conn(0x7ff99c071e60 msgr2=0x7ff99c0b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 shutdown_connections 2023-12-20T06:04:55.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.012+0000 7ff9a2042640 1 -- 172.21.15.40:0/1650871146 wait complete. 2023-12-20T06:04:55.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T06:04:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.131+0000 7fd1fcfd2640 1 Processor -- start 2023-12-20T06:04:55.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.131+0000 7fd1fcfd2640 1 -- start start 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1fcfd2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1fcfd2640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1f80b9ff0 0x7fd1f8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1fcfd2640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f806acb0 con 0x7fd1f806b420 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1fcfd2640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80b8160 con 0x7fd1f80b9ff0 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1fcfd2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80ba4f0 con 0x7fd1f80b7d80 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1f659c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1f659c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:36058/0 (socket says 172.21.15.40:36058) 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1f659c640 1 -- 172.21.15.40:0/3370192118 learned_addr learned my addr 172.21.15.40:0/3370192118 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:55.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1effff640 1 --2- 172.21.15.40:0/3370192118 >> v2:172.21.15.69:3300/0 conn(0x7fd1f80b9ff0 0x7fd1f8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1f659c640 1 -- 172.21.15.40:0/3370192118 >> v2:172.21.15.69:3300/0 conn(0x7fd1f80b9ff0 msgr2=0x7fd1f8070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1f659c640 1 --2- 172.21.15.40:0/3370192118 >> v2:172.21.15.69:3300/0 conn(0x7fd1f80b9ff0 0x7fd1f8070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1f659c640 1 -- 172.21.15.40:0/3370192118 >> v1:172.21.15.69:6789/0 conn(0x7fd1f806b420 legacy=0x7fd1f814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.132+0000 7fd1f659c640 1 -- 172.21.15.40:0/3370192118 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80ba7d0 con 0x7fd1f80b7d80 2023-12-20T06:04:55.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.133+0000 7fd1f659c640 1 --2- 172.21.15.40:0/3370192118 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814aa20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009870 tx=0x7fd1e802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa3e4ef91881f4d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:55.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.135+0000 7fd1f5d9b640 1 -- 172.21.15.40:0/3370192118 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e802f840 con 0x7fd1f80b7d80 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.135+0000 7fd1f5d9b640 1 -- 172.21.15.40:0/3370192118 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e802f9a0 con 0x7fd1f80b7d80 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.135+0000 7fd1f5d9b640 1 -- 172.21.15.40:0/3370192118 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e802fd30 con 0x7fd1f80b7d80 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/3370192118 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 msgr2=0x7fd1f814aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/3370192118 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814aa20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009870 tx=0x7fd1e802ba20 comp rx=0 tx=0).stop 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/3370192118 shutdown_connections 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/3370192118 >> v2:172.21.15.69:3300/0 conn(0x7fd1f80b9ff0 0x7fd1f8070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/3370192118 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814aa20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/3370192118 >> 172.21.15.40:0/3370192118 conn(0x7fd1f80bab20 msgr2=0x7fd1f80baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/3370192118 shutdown_connections 2023-12-20T06:04:55.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.136+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/3370192118 wait complete. 2023-12-20T06:04:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 Processor -- start 2023-12-20T06:04:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 -- start start 2023-12-20T06:04:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1f806b420 0x7fd1f814dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f80b9ff0 0x7fd1f81e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f814c740 con 0x7fd1f806b420 2023-12-20T06:04:55.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80b6990 con 0x7fd1f80b9ff0 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.137+0000 7fd1fcfd2640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f81e2ef0 con 0x7fd1f80b7d80 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1f806b420 0x7fd1f814dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1f806b420 0x7fd1f814dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53960/0 (socket says 172.21.15.40:53960) 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 -- 172.21.15.40:0/291432578 learned_addr learned my addr 172.21.15.40:0/291432578 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1effff640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f6d9d640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f80b9ff0 0x7fd1f81e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 -- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 msgr2=0x7fd1f814c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 -- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f80b9ff0 msgr2=0x7fd1f81e3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f80b9ff0 0x7fd1f81e3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 -- 172.21.15.40:0/291432578 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e80094d0 con 0x7fd1f806b420 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1f659c640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1f806b420 0x7fd1f814dc90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009870 tx=0x7fd1e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1eeffd640 1 -- 172.21.15.40:0/291432578 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8037c40 con 0x7fd1f806b420 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1eeffd640 1 -- 172.21.15.40:0/291432578 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e8037dc0 con 0x7fd1f806b420 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f80b6b80 con 0x7fd1f806b420 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1eeffd640 1 -- 172.21.15.40:0/291432578 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e8041640 con 0x7fd1f806b420 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.138+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f81e33e0 con 0x7fd1f806b420 2023-12-20T06:04:55.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.139+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f806bf00 con 0x7fd1f806b420 2023-12-20T06:04:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.140+0000 7fd1eeffd640 1 -- 172.21.15.40:0/291432578 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1e80417a0 con 0x7fd1f806b420 2023-12-20T06:04:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.140+0000 7fd1eeffd640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd1d806a430 0x7fd1d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.140+0000 7fd1eeffd640 1 -- 172.21.15.40:0/291432578 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1e803c070 con 0x7fd1f806b420 2023-12-20T06:04:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.140+0000 7fd1effff640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd1d806a430 0x7fd1d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.141+0000 7fd1effff640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd1d806a430 0x7fd1d806c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80719a0 tx=0x7fd1e0009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:55.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.144+0000 7fd1eeffd640 1 -- 172.21.15.40:0/291432578 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd1e8076c00 con 0x7fd1f806b420 2023-12-20T06:04:55.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.359+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1f804e840 con 0x7fd1f806b420 2023-12-20T06:04:55.369 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-12-20T06:04:55.369+0000 7fda12e62640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T06:04:55.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.379+0000 7fd1eeffd640 1 -- 172.21.15.40:0/291432578 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1e807a220 con 0x7fd1f806b420 2023-12-20T06:04:55.380 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T06:04:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd1d806a430 msgr2=0x7fd1d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd1d806a430 0x7fd1d806c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80719a0 tx=0x7fd1e0009190 comp rx=0 tx=0).stop 2023-12-20T06:04:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1f806b420 msgr2=0x7fd1f814dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1f806b420 0x7fd1f814dc90 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8009870 tx=0x7fd1e8004730 comp rx=0 tx=0).stop 2023-12-20T06:04:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 shutdown_connections 2023-12-20T06:04:55.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd1d806a430 0x7fd1d806c8f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1f80b9ff0 0x7fd1f81e3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd1f80b7d80 0x7fd1f814c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 --2- 172.21.15.40:0/291432578 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1f806b420 0x7fd1f814dc90 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 >> 172.21.15.40:0/291432578 conn(0x7fd1f80bab20 msgr2=0x7fd1f81430b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 shutdown_connections 2023-12-20T06:04:55.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.382+0000 7fd1fcfd2640 1 -- 172.21.15.40:0/291432578 wait complete. 2023-12-20T06:04:55.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T06:04:55.473 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-12-20T06:04:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.507+0000 7f28f6d8b640 1 Processor -- start 2023-12-20T06:04:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.507+0000 7f28f6d8b640 1 -- start start 2023-12-20T06:04:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28f6d8b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f28f0142b60 0x7f28f00b9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28f6d8b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28f00b3ed0 0x7f28f00b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28f6d8b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f00b9380 con 0x7f28f0070d90 2023-12-20T06:04:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28f6d8b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f00b79c0 con 0x7f28f00b3ed0 2023-12-20T06:04:55.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28f6d8b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f00b83d0 con 0x7f28f0142b60 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28effff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28f00b3ed0 0x7f28f00b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28effff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28f00b3ed0 0x7f28f00b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53972/0 (socket says 172.21.15.40:53972) 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28effff640 1 -- 172.21.15.40:0/3708953245 learned_addr learned my addr 172.21.15.40:0/3708953245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28f5328640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f28f0070d90 0x7f28f0069ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44172/0 (socket says 172.21.15.40:44172) 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28f4b27640 1 --2- 172.21.15.40:0/3708953245 >> v2:172.21.15.69:3300/0 conn(0x7f28f0142b60 0x7f28f00b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28effff640 1 -- 172.21.15.40:0/3708953245 >> v2:172.21.15.69:3300/0 conn(0x7f28f0142b60 msgr2=0x7f28f00b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28effff640 1 --2- 172.21.15.40:0/3708953245 >> v2:172.21.15.69:3300/0 conn(0x7f28f0142b60 0x7f28f00b9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28effff640 1 -- 172.21.15.40:0/3708953245 >> v1:172.21.15.40:6789/0 conn(0x7f28f0070d90 legacy=0x7f28f0069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28effff640 1 -- 172.21.15.40:0/3708953245 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00b7bd0 con 0x7f28f00b3ed0 2023-12-20T06:04:55.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.508+0000 7f28ef7fe640 1 -- 172.21.15.40:0/3708953245 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025034165 0 0) 0x7f28f00b9380 con 0x7f28f0070d90 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.509+0000 7f28effff640 1 --2- 172.21.15.40:0/3708953245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f00b3ed0 0x7f28f00b6650 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f28f00b71e0 tx=0x7f28e402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2bbeed115c8efb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.509+0000 7f28ef7fe640 1 -- 172.21.15.40:0/3708953245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e402f850 con 0x7f28f00b3ed0 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.509+0000 7f28ef7fe640 1 -- 172.21.15.40:0/3708953245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e402f9b0 con 0x7f28f00b3ed0 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.509+0000 7f28ef7fe640 1 -- 172.21.15.40:0/3708953245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e402fd40 con 0x7f28f00b3ed0 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 -- 172.21.15.40:0/3708953245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f00b3ed0 msgr2=0x7f28f00b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/3708953245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f00b3ed0 0x7f28f00b6650 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f28f00b71e0 tx=0x7f28e402ba30 comp rx=0 tx=0).stop 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 -- 172.21.15.40:0/3708953245 shutdown_connections 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/3708953245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f00b3ed0 0x7f28f00b6650 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/3708953245 >> v2:172.21.15.69:3300/0 conn(0x7f28f0142b60 0x7f28f00b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 -- 172.21.15.40:0/3708953245 >> 172.21.15.40:0/3708953245 conn(0x7f28f006acb0 msgr2=0x7f28f006b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:55.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 -- 172.21.15.40:0/3708953245 shutdown_connections 2023-12-20T06:04:55.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.510+0000 7f28f6d8b640 1 -- 172.21.15.40:0/3708953245 wait complete. 2023-12-20T06:04:55.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.511+0000 7f28f6d8b640 1 Processor -- start 2023-12-20T06:04:55.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.511+0000 7f28f6d8b640 1 -- start start 2023-12-20T06:04:55.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f6d8b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f28f0070d90 0x7f28f01490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f6d8b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28f00b3ed0 0x7f28f01e0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f6d8b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f0142b60 0x7f28f01466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f6d8b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f01dfda0 con 0x7f28f0142b60 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f6d8b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f0148740 con 0x7f28f00b3ed0 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f6d8b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f01e0040 con 0x7f28f0070d90 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f0142b60 0x7f28f01466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f0142b60 0x7f28f01466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53978/0 (socket says 172.21.15.40:53978) 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 -- 172.21.15.40:0/822229546 learned_addr learned my addr 172.21.15.40:0/822229546 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28effff640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28f00b3ed0 0x7f28f01e0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f4b27640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f28f0070d90 0x7f28f01490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 -- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f28f0070d90 msgr2=0x7f28f01490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f28f0070d90 0x7f28f01490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 -- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28f00b3ed0 msgr2=0x7f28f01e0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:55.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28f00b3ed0 0x7f28f01e0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 -- 172.21.15.40:0/822229546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40094d0 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f4b27640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f28f0070d90 0x7f28f01490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28f5328640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f0142b60 0x7f28f01466f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c7e0 tx=0x7f28e800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.512+0000 7f28ed7fa640 1 -- 172.21.15.40:0/822229546 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800a640 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.513+0000 7f28ed7fa640 1 -- 172.21.15.40:0/822229546 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800a7c0 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.513+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f01e0320 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.513+0000 7f28ed7fa640 1 -- 172.21.15.40:0/822229546 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800ab70 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.513+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f0148030 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.513+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f006fea0 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.514+0000 7f28ed7fa640 1 -- 172.21.15.40:0/822229546 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f28e800acd0 con 0x7f28f0142b60 2023-12-20T06:04:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.514+0000 7f28ed7fa640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f28dc06a430 0x7f28dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:55.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.515+0000 7f28ed7fa640 1 -- 172.21.15.40:0/822229546 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f28e80881c0 con 0x7f28f0142b60 2023-12-20T06:04:55.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.515+0000 7f28f4b27640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f28dc06a430 0x7f28dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:55.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.515+0000 7f28f4b27640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f28dc06a430 0x7f28dc06c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f28e0006fd0 tx=0x7f28e0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:55.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.519+0000 7f28ed7fa640 1 -- 172.21.15.40:0/822229546 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f28e80537e0 con 0x7f28f0142b60 2023-12-20T06:04:55.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:55.737+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f28f00740a0 con 0x7f28f0142b60 2023-12-20T06:04:56.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.387+0000 7f28ed7fa640 1 -- 172.21.15.40:0/822229546 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f28e8056e00 con 0x7f28f0142b60 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f28dc06a430 msgr2=0x7f28dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f28dc06a430 0x7f28dc06c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f28e0006fd0 tx=0x7f28e0008040 comp rx=0 tx=0).stop 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f0142b60 msgr2=0x7f28f01466f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f0142b60 0x7f28f01466f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c7e0 tx=0x7f28e800cca0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 shutdown_connections 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f28dc06a430 0x7f28dc06c8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28f0142b60 0x7f28f01466f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28f00b3ed0 0x7f28f01e0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.390+0000 7f28f6d8b640 1 --2- 172.21.15.40:0/822229546 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f28f0070d90 0x7f28f01490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.391+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 >> 172.21.15.40:0/822229546 conn(0x7f28f006acb0 msgr2=0x7f28f01419f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:56.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.391+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 shutdown_connections 2023-12-20T06:04:56.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.391+0000 7f28f6d8b640 1 -- 172.21.15.40:0/822229546 wait complete. 2023-12-20T06:04:56.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T06:04:56.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.521+0000 7f62fcb3e640 1 Processor -- start 2023-12-20T06:04:56.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.521+0000 7f62fcb3e640 1 -- start start 2023-12-20T06:04:56.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.521+0000 7f62fcb3e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f62f814b460 0x7f62f8156390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.521+0000 7f62fcb3e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80b8ba0 con 0x7f62f80b79a0 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.521+0000 7f62fcb3e640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f80b8e80 con 0x7f62f80bc660 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.521+0000 7f62fcb3e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f80bcab0 con 0x7f62f814b460 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f62f80b79a0 0x7f62f80b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52468/0 (socket says 172.21.15.40:52468) 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f659c640 1 -- 172.21.15.40:0/3692081509 learned_addr learned my addr 172.21.15.40:0/3692081509 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449573964 0 0) 0x7f62f80b8ba0 con 0x7f62f80b79a0 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f6d9d640 1 --2- 172.21.15.40:0/3692081509 >> v2:172.21.15.69:3300/0 conn(0x7f62f814b460 0x7f62f8156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e4003520 con 0x7f62f80b79a0 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134711304 0 0) 0x7f62e4003520 con 0x7f62f80b79a0 2023-12-20T06:04:56.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 >> v2:172.21.15.69:3300/0 conn(0x7f62f814b460 msgr2=0x7f62f8156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 --2- 172.21.15.40:0/3692081509 >> v2:172.21.15.69:3300/0 conn(0x7f62f814b460 0x7f62f8156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 >> v1:172.21.15.69:6789/0 conn(0x7f62f80bc660 legacy=0x7f62f814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80b9160 con 0x7f62f80b79a0 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f62e8001690 con 0x7f62f80b79a0 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 >> v1:172.21.15.40:6789/0 conn(0x7f62f80b79a0 legacy=0x7f62f80b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62e40039e0 0x7f62e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e4005180 0x7f62e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80bcab0 con 0x7f62e40047c0 2023-12-20T06:04:56.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e400c0b0 con 0x7f62e4005180 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e400c270 con 0x7f62e40039e0 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62edd9b640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f659c640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62e40039e0 0x7f62e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.522+0000 7f62f6d9d640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e4005180 0x7f62e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62edd9b640 1 -- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62e40039e0 msgr2=0x7f62e4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62edd9b640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62e40039e0 0x7f62e4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62edd9b640 1 -- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e4005180 msgr2=0x7f62e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62edd9b640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62e4005180 0x7f62e400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62edd9b640 1 -- 172.21.15.40:0/3692081509 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e4003520 con 0x7f62e40047c0 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62f6d9d640 1 -- 172.21.15.40:0/3692081509 reap_dead start 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62edd9b640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62e4004c40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f62e0001750 tx=0x7f62e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262de22183fb2ca5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e00052d0 con 0x7f62e40047c0 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e002e050 con 0x7f62e40047c0 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.523+0000 7f62f5d9b640 1 -- 172.21.15.40:0/3692081509 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e0003830 con 0x7f62e40047c0 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.524+0000 7f62fcb3e640 1 -- 172.21.15.40:0/3692081509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 msgr2=0x7f62e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.524+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62e4004c40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f62e0001750 tx=0x7f62e40057f0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.524+0000 7f62fcb3e640 1 -- 172.21.15.40:0/3692081509 shutdown_connections 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.524+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/3692081509 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62e4004c40 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.524+0000 7f62fcb3e640 1 -- 172.21.15.40:0/3692081509 >> 172.21.15.40:0/3692081509 conn(0x7f62f80c0330 msgr2=0x7f62f80c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.524+0000 7f62fcb3e640 1 -- 172.21.15.40:0/3692081509 shutdown_connections 2023-12-20T06:04:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.524+0000 7f62fcb3e640 1 -- 172.21.15.40:0/3692081509 wait complete. 2023-12-20T06:04:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.525+0000 7f62fcb3e640 1 Processor -- start 2023-12-20T06:04:56.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.525+0000 7f62fcb3e640 1 -- start start 2023-12-20T06:04:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62fcb3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62f80a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62fcb3e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62f81e32f0 0x7f62f81e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62fcb3e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f81e3770 0x7f62f81e1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62fcb3e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8140b70 con 0x7f62e40047c0 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62fcb3e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f813f3f0 con 0x7f62f81e3770 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62fcb3e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f80bfa90 con 0x7f62f81e32f0 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62f80a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62f80a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55024/0 (socket says 172.21.15.40:55024) 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 -- 172.21.15.40:0/1544929899 learned_addr learned my addr 172.21.15.40:0/1544929899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f6d9d640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f81e3770 0x7f62f81e1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62edd9b640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62f81e32f0 0x7f62f81e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 -- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62f81e32f0 msgr2=0x7f62f81e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62f81e32f0 0x7f62f81e15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 -- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f81e3770 msgr2=0x7f62f81e1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f81e3770 0x7f62f81e1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.526+0000 7f62f659c640 1 -- 172.21.15.40:0/1544929899 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80b5cc0 con 0x7f62e40047c0 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.527+0000 7f62f659c640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62f80a5fb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f62e8004ec0 tx=0x7f62e8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.527+0000 7f62ef7fe640 1 -- 172.21.15.40:0/1544929899 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800f750 con 0x7f62e40047c0 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.527+0000 7f62ef7fe640 1 -- 172.21.15.40:0/1544929899 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e800f8d0 con 0x7f62e40047c0 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.527+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f813f110 con 0x7f62e40047c0 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.527+0000 7f62ef7fe640 1 -- 172.21.15.40:0/1544929899 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800fc80 con 0x7f62e40047c0 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.527+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f81e40c0 con 0x7f62e40047c0 2023-12-20T06:04:56.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.528+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f804e840 con 0x7f62e40047c0 2023-12-20T06:04:56.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.528+0000 7f62ef7fe640 1 -- 172.21.15.40:0/1544929899 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62e801d460 con 0x7f62e40047c0 2023-12-20T06:04:56.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.529+0000 7f62ef7fe640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f62d806a430 0x7f62d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:56.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.529+0000 7f62ef7fe640 1 -- 172.21.15.40:0/1544929899 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f62e80889e0 con 0x7f62e40047c0 2023-12-20T06:04:56.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.529+0000 7f62edd9b640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f62d806a430 0x7f62d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:56.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.529+0000 7f62edd9b640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f62d806a430 0x7f62d806c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f62e0033000 tx=0x7f62e0009030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:56.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.533+0000 7f62ef7fe640 1 -- 172.21.15.40:0/1544929899 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f62e8053f60 con 0x7f62e40047c0 2023-12-20T06:04:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:56.710+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62f80b3690 con 0x7f62e40047c0 2023-12-20T06:04:57.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.390+0000 7f62ef7fe640 1 -- 172.21.15.40:0/1544929899 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f62e8057580 con 0x7f62e40047c0 2023-12-20T06:04:57.392 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-12-20T06:04:57.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f62d806a430 msgr2=0x7f62d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:57.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f62d806a430 0x7f62d806c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f62e0033000 tx=0x7f62e0009030 comp rx=0 tx=0).stop 2023-12-20T06:04:57.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 msgr2=0x7f62f80a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:57.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62f80a5fb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f62e8004ec0 tx=0x7f62e8007430 comp rx=0 tx=0).stop 2023-12-20T06:04:57.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 shutdown_connections 2023-12-20T06:04:57.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f62d806a430 0x7f62d806c8f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62f81e3770 0x7f62f81e1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f62f81e32f0 0x7f62f81e15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 --2- 172.21.15.40:0/1544929899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62e40047c0 0x7f62f80a5fb0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.394+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 >> 172.21.15.40:0/1544929899 conn(0x7f62f80c0330 msgr2=0x7f62f8143180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:57.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.395+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 shutdown_connections 2023-12-20T06:04:57.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.395+0000 7f62fcb3e640 1 -- 172.21.15.40:0/1544929899 wait complete. 2023-12-20T06:04:57.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T06:04:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.533+0000 7f4fb41b1640 1 Processor -- start 2023-12-20T06:04:57.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.533+0000 7f4fb41b1640 1 -- start start 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb41b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 0x7f4fac14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb41b1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4fac14b290 0x7f4fac155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb41b1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac14b6e0 con 0x7f4fac0b79a0 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb41b1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac06cd70 con 0x7f4fac14b290 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb41b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0bca80 con 0x7f4fac0bc660 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb1f4d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4fac0b79a0 0x7f4fac0b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52474/0 (socket says 172.21.15.40:52474) 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb1f4d640 1 -- 172.21.15.40:0/1981917657 learned_addr learned my addr 172.21.15.40:0/1981917657 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb174c640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 0x7f4fac14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb274e640 1 --2- 172.21.15.40:0/1981917657 >> v2:172.21.15.69:3300/0 conn(0x7f4fac14b290 0x7f4fac155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369635199 0 0) 0x7f4fac14b6e0 con 0x7f4fac0b79a0 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f98003520 con 0x7f4fac0b79a0 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 292953349 0 0) 0x7f4f98003520 con 0x7f4fac0b79a0 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 msgr2=0x7f4fac14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 0x7f4fac14ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 >> v2:172.21.15.69:3300/0 conn(0x7f4fac14b290 msgr2=0x7f4fac155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 --2- 172.21.15.40:0/1981917657 >> v2:172.21.15.69:3300/0 conn(0x7f4fac14b290 0x7f4fac155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac0b8ba0 con 0x7f4fac0b79a0 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f4fa8001670 con 0x7f4fac0b79a0 2023-12-20T06:04:57.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 >> v1:172.21.15.40:6789/0 conn(0x7f4fac0b79a0 legacy=0x7f4fac0b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f980039e0 0x7f4f98003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 0x7f4f980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f98004d00 0x7f4f98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0bca80 con 0x7f4f980039e0 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9800b9b0 con 0x7f4f98004d00 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9800bb70 con 0x7f4fac0bc660 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.534+0000 7f4fb1f4d640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f980039e0 0x7f4f98003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.535+0000 7f4fb174c640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 0x7f4f980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.535+0000 7f4fb274e640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f98004d00 0x7f4f98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.535+0000 7f4fb1f4d640 1 -- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 msgr2=0x7f4f980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.535+0000 7f4fb1f4d640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4fac0bc660 0x7f4f980047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.535+0000 7f4fb1f4d640 1 -- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f98004d00 msgr2=0x7f4f98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.535+0000 7f4fb1f4d640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f98004d00 0x7f4f98005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.535+0000 7f4fb1f4d640 1 -- 172.21.15.40:0/1981917657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98003520 con 0x7f4f980039e0 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb1f4d640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f980039e0 0x7f4f98003e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800c290 tx=0x7f4f980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6271f5a145a410c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8005ad0 con 0x7f4f980039e0 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa8005c30 con 0x7f4f980039e0 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb0f4b640 1 -- 172.21.15.40:0/1981917657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa802c8d0 con 0x7f4f980039e0 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb41b1640 1 -- 172.21.15.40:0/1981917657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f980039e0 msgr2=0x7f4f98003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:57.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb41b1640 1 --2- 172.21.15.40:0/1981917657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f980039e0 0x7f4f98003e00 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4fa800c290 tx=0x7f4f980057f0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb274e640 1 -- 172.21.15.40:0/1981917657 reap_dead start 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb41b1640 1 -- 172.21.15.40:0/1981917657 shutdown_connections 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb41b1640 1 -- 172.21.15.40:0/1981917657 >> 172.21.15.40:0/1981917657 conn(0x7f4fac0c0330 msgr2=0x7f4fac0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb41b1640 1 -- 172.21.15.40:0/1981917657 shutdown_connections 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.536+0000 7f4fb41b1640 1 -- 172.21.15.40:0/1981917657 wait complete. 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.537+0000 7f4fb41b1640 1 Processor -- start 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.537+0000 7f4fb41b1640 1 -- start start 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb41b1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4f980039e0 0x7f4fac0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb41b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fac14ddd0 0x7f4fac1453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb41b1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fac145930 0x7f4fac0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb41b1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac0b54f0 con 0x7f4fac14ddd0 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb41b1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac146070 con 0x7f4fac145930 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb41b1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac148040 con 0x7f4f980039e0 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fac14ddd0 0x7f4fac1453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fac14ddd0 0x7f4fac1453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55040/0 (socket says 172.21.15.40:55040) 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 -- 172.21.15.40:0/436016152 learned_addr learned my addr 172.21.15.40:0/436016152 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb1f4d640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4f980039e0 0x7f4fac0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 -- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4f980039e0 msgr2=0x7f4fac0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4f980039e0 0x7f4fac0b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb274e640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fac145930 0x7f4fac0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 -- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fac145930 msgr2=0x7f4fac0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:57.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fac145930 0x7f4fac0b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.538+0000 7f4fb174c640 1 -- 172.21.15.40:0/436016152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac14d850 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.539+0000 7f4fb174c640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fac14ddd0 0x7f4fac1453f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0118e0 tx=0x7f4f9c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.539+0000 7f4fa27fc640 1 -- 172.21.15.40:0/436016152 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00faf0 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.539+0000 7f4fa27fc640 1 -- 172.21.15.40:0/436016152 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00fc50 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.539+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac1482e0 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.539+0000 7f4fa27fc640 1 -- 172.21.15.40:0/436016152 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c014440 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.539+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac14db30 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.540+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac0bba10 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.540+0000 7f4fa27fc640 1 -- 172.21.15.40:0/436016152 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f9c0145a0 con 0x7f4fac14ddd0 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.540+0000 7f4fa27fc640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:57.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.541+0000 7f4fa27fc640 1 -- 172.21.15.40:0/436016152 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4f9c089100 con 0x7f4fac14ddd0 2023-12-20T06:04:57.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.541+0000 7f4fb1f4d640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:57.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.541+0000 7f4fb1f4d640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4f9006a430 0x7f4f9006c8f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8034000 tx=0x7f4fa8007000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:57.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.545+0000 7f4fa27fc640 1 -- 172.21.15.40:0/436016152 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4f9c054850 con 0x7f4fac14ddd0 2023-12-20T06:04:57.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:57.721+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4fac04e840 con 0x7f4fac14ddd0 2023-12-20T06:04:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.395+0000 7f4fa27fc640 1 -- 172.21.15.40:0/436016152 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4f9c057e70 con 0x7f4fac14ddd0 2023-12-20T06:04:58.396 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-12-20T06:04:58.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.401+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4f9006a430 msgr2=0x7f4f9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.401+0000 7f4fb41b1640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4f9006a430 0x7f4f9006c8f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8034000 tx=0x7f4fa8007000 comp rx=0 tx=0).stop 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.401+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fac14ddd0 msgr2=0x7f4fac1453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.401+0000 7f4fb41b1640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fac14ddd0 0x7f4fac1453f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0118e0 tx=0x7f4f9c011da0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 shutdown_connections 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f4f9006a430 0x7f4f9006c8f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fac145930 0x7f4fac0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fac14ddd0 0x7f4fac1453f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 --2- 172.21.15.40:0/436016152 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f4f980039e0 0x7f4fac0b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 >> 172.21.15.40:0/436016152 conn(0x7f4fac0c0330 msgr2=0x7f4fac0ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:58.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 shutdown_connections 2023-12-20T06:04:58.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.402+0000 7f4fb41b1640 1 -- 172.21.15.40:0/436016152 wait complete. 2023-12-20T06:04:58.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T06:04:58.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.581+0000 7f0699cce640 1 Processor -- start 2023-12-20T06:04:58.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.581+0000 7f0699cce640 1 -- start start 2023-12-20T06:04:58.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0699cce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940b3ab0 0x7f0694156450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0699cce640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940ba7f0 con 0x7f06940c0f40 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0699cce640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069406aa20 con 0x7f06940b9f00 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0699cce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069406b090 con 0x7f06940b3ab0 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0692ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f06940c0f40 0x7f069406a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52482/0 (socket says 172.21.15.40:52482) 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0692ffd640 1 -- 172.21.15.40:0/1903601140 learned_addr learned my addr 172.21.15.40:0/1903601140 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0693fff640 1 --2- 172.21.15.40:0/1903601140 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940b3ab0 0x7f0694156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f06927fc640 1 -- 172.21.15.40:0/1903601140 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780085627 0 0) 0x7f06940ba7f0 con 0x7f06940c0f40 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f06927fc640 1 -- 172.21.15.40:0/1903601140 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f067c003520 con 0x7f06940c0f40 2023-12-20T06:04:58.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f06927fc640 1 -- 172.21.15.40:0/1903601140 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593430613 0 0) 0x7f069406aa20 con 0x7f06940b9f00 2023-12-20T06:04:58.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f06927fc640 1 -- 172.21.15.40:0/1903601140 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06940ba7f0 con 0x7f06940b9f00 2023-12-20T06:04:58.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0693fff640 1 -- 172.21.15.40:0/1903601140 >> v1:172.21.15.69:6789/0 conn(0x7f06940b9f00 legacy=0x7f06940be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0693fff640 1 -- 172.21.15.40:0/1903601140 >> v1:172.21.15.40:6789/0 conn(0x7f06940c0f40 legacy=0x7f069406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.582+0000 7f0693fff640 1 -- 172.21.15.40:0/1903601140 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940baed0 con 0x7f06940b3ab0 2023-12-20T06:04:58.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.583+0000 7f0693fff640 1 --2- 172.21.15.40:0/1903601140 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940b3ab0 0x7f0694156450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f068c009dc0 tx=0x7f068c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4da9a27c4130c8c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:58.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.584+0000 7f06927fc640 1 -- 172.21.15.40:0/1903601140 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c02ccd0 con 0x7f06940b3ab0 2023-12-20T06:04:58.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.584+0000 7f06927fc640 1 -- 172.21.15.40:0/1903601140 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c02ce30 con 0x7f06940b3ab0 2023-12-20T06:04:58.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.584+0000 7f06927fc640 1 -- 172.21.15.40:0/1903601140 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c034660 con 0x7f06940b3ab0 2023-12-20T06:04:58.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.584+0000 7f0699cce640 1 -- 172.21.15.40:0/1903601140 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940b3ab0 msgr2=0x7f0694156450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.584+0000 7f0699cce640 1 --2- 172.21.15.40:0/1903601140 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940b3ab0 0x7f0694156450 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f068c009dc0 tx=0x7f068c02bf20 comp rx=0 tx=0).stop 2023-12-20T06:04:58.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.585+0000 7f0699cce640 1 -- 172.21.15.40:0/1903601140 shutdown_connections 2023-12-20T06:04:58.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.585+0000 7f0699cce640 1 --2- 172.21.15.40:0/1903601140 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940b3ab0 0x7f0694156450 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.585+0000 7f0699cce640 1 -- 172.21.15.40:0/1903601140 >> 172.21.15.40:0/1903601140 conn(0x7f06940c0420 msgr2=0x7f06940c0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.585+0000 7f0699cce640 1 -- 172.21.15.40:0/1903601140 shutdown_connections 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.585+0000 7f0699cce640 1 -- 172.21.15.40:0/1903601140 wait complete. 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.586+0000 7f0699cce640 1 Processor -- start 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.586+0000 7f0699cce640 1 -- start start 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0699cce640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06940b3ab0 0x7f06941d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0699cce640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06940b9f00 0x7f06940a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0699cce640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940c0f40 0x7f06941e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0699cce640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940a5cf0 con 0x7f06940b3ab0 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0699cce640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06941e05b0 con 0x7f06940b9f00 2023-12-20T06:04:58.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0699cce640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06941e0890 con 0x7f06940c0f40 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06940b3ab0 0x7f06941d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0692ffd640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06940b9f00 0x7f06940a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06940b3ab0 0x7f06941d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55054/0 (socket says 172.21.15.40:55054) 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f0693fff640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940c0f40 0x7f06941e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 -- 172.21.15.40:0/2548849677 learned_addr learned my addr 172.21.15.40:0/2548849677 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 -- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940c0f40 msgr2=0x7f06941e0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940c0f40 0x7f06941e0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 -- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06940b9f00 msgr2=0x7f06940a57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06940b9f00 0x7f06940a57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.587+0000 7f06937fe640 1 -- 172.21.15.40:0/2548849677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c009a70 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.588+0000 7f06937fe640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06940b3ab0 0x7f06941d1c70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f068400c4c0 tx=0x7f068400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.588+0000 7f067bfff640 1 -- 172.21.15.40:0/2548849677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840052d0 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.588+0000 7f067bfff640 1 -- 172.21.15.40:0/2548849677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684005430 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.588+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06940b3e90 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.588+0000 7f067bfff640 1 -- 172.21.15.40:0/2548849677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684012870 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.588+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06941d10a0 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.589+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06940b8d90 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.589+0000 7f067bfff640 1 -- 172.21.15.40:0/2548849677 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06840129d0 con 0x7f06940b3ab0 2023-12-20T06:04:58.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.590+0000 7f067bfff640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f068006a430 0x7f068006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:58.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.590+0000 7f067bfff640 1 -- 172.21.15.40:0/2548849677 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0684088100 con 0x7f06940b3ab0 2023-12-20T06:04:58.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.590+0000 7f0692ffd640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f068006a430 0x7f068006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:58.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.591+0000 7f0692ffd640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f068006a430 0x7f068006c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f06940a1540 tx=0x7f0688007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:58.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.595+0000 7f067bfff640 1 -- 172.21.15.40:0/2548849677 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0684053aa0 con 0x7f06940b3ab0 2023-12-20T06:04:58.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.852+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f06940bf920 con 0x7f06940b3ab0 2023-12-20T06:04:58.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.856+0000 7f067bfff640 1 -- 172.21.15.40:0/2548849677 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f06840570c0 con 0x7f06940b3ab0 2023-12-20T06:04:58.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f068006a430 msgr2=0x7f068006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f068006a430 0x7f068006c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f06940a1540 tx=0x7f0688007d30 comp rx=0 tx=0).stop 2023-12-20T06:04:58.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06940b3ab0 msgr2=0x7f06941d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06940b3ab0 0x7f06941d1c70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f068400c4c0 tx=0x7f068400c980 comp rx=0 tx=0).stop 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 shutdown_connections 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f068006a430 0x7f068006c8f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f06940c0f40 0x7f06941e0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06940b9f00 0x7f06940a57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 --2- 172.21.15.40:0/2548849677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06940b3ab0 0x7f06941d1c70 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 >> 172.21.15.40:0/2548849677 conn(0x7f06940c0420 msgr2=0x7f06940b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 shutdown_connections 2023-12-20T06:04:58.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:58.859+0000 7f0699cce640 1 -- 172.21.15.40:0/2548849677 wait complete. 2023-12-20T06:04:58.874 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-20T06:04:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.006+0000 7fd5d0199640 1 Processor -- start 2023-12-20T06:04:59.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.006+0000 7fd5d0199640 1 -- start start 2023-12-20T06:04:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.006+0000 7fd5d0199640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c80b68d0 0x7fd5c8071100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.006+0000 7fd5d0199640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd5c8142cc0 0x7fd5c806b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.006+0000 7fd5d0199640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c8070660 con 0x7fd5c806aca0 2023-12-20T06:04:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.006+0000 7fd5d0199640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c806b640 con 0x7fd5c8142cc0 2023-12-20T06:04:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.006+0000 7fd5d0199640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c806fc10 con 0x7fd5c80b68d0 2023-12-20T06:04:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5cd734640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd5c806aca0 0x7fd5c81425b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52488/0 (socket says 172.21.15.40:52488) 2023-12-20T06:04:59.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5cd734640 1 -- 172.21.15.40:0/910420008 learned_addr learned my addr 172.21.15.40:0/910420008 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5cdf35640 1 --2- 172.21.15.40:0/910420008 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c80b68d0 0x7fd5c8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5ce736640 1 --2- 172.21.15.40:0/910420008 >> v2:172.21.15.69:3300/0 conn(0x7fd5c8142cc0 0x7fd5c806b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5ccf33640 1 -- 172.21.15.40:0/910420008 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173709740 0 0) 0x7fd5b8001110 con 0x7fd5c806aca0 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5ccf33640 1 -- 172.21.15.40:0/910420008 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b4003520 con 0x7fd5c806aca0 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5cdf35640 1 -- 172.21.15.40:0/910420008 >> v2:172.21.15.69:3300/0 conn(0x7fd5c8142cc0 msgr2=0x7fd5c806b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5cdf35640 1 --2- 172.21.15.40:0/910420008 >> v2:172.21.15.69:3300/0 conn(0x7fd5c8142cc0 0x7fd5c806b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5cdf35640 1 -- 172.21.15.40:0/910420008 >> v1:172.21.15.40:6789/0 conn(0x7fd5c806aca0 legacy=0x7fd5c81425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5cdf35640 1 -- 172.21.15.40:0/910420008 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c806a8f0 con 0x7fd5c80b68d0 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.007+0000 7fd5ce736640 1 --2- 172.21.15.40:0/910420008 >> v2:172.21.15.69:3300/0 conn(0x7fd5c8142cc0 0x7fd5c806b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.008+0000 7fd5cdf35640 1 --2- 172.21.15.40:0/910420008 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c80b68d0 0x7fd5c8071100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40097a0 tx=0x7fd5c402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ee9eeb484f290 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:59.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.008+0000 7fd5ccf33640 1 -- 172.21.15.40:0/910420008 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4031830 con 0x7fd5c80b68d0 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.008+0000 7fd5ccf33640 1 -- 172.21.15.40:0/910420008 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c4031990 con 0x7fd5c80b68d0 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.008+0000 7fd5ccf33640 1 -- 172.21.15.40:0/910420008 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4031d20 con 0x7fd5c80b68d0 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 -- 172.21.15.40:0/910420008 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c80b68d0 msgr2=0x7fd5c8071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 --2- 172.21.15.40:0/910420008 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c80b68d0 0x7fd5c8071100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40097a0 tx=0x7fd5c402b8d0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 -- 172.21.15.40:0/910420008 shutdown_connections 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 --2- 172.21.15.40:0/910420008 >> v2:172.21.15.69:3300/0 conn(0x7fd5c8142cc0 0x7fd5c806b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 --2- 172.21.15.40:0/910420008 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c80b68d0 0x7fd5c8071100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 -- 172.21.15.40:0/910420008 >> 172.21.15.40:0/910420008 conn(0x7fd5c80b9c30 msgr2=0x7fd5c80ba010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 -- 172.21.15.40:0/910420008 shutdown_connections 2023-12-20T06:04:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.009+0000 7fd5d0199640 1 -- 172.21.15.40:0/910420008 wait complete. 2023-12-20T06:04:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 Processor -- start 2023-12-20T06:04:59.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 -- start start 2023-12-20T06:04:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c806aca0 0x7fd5c80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5c80b68d0 0x7fd5c81447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:59.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5c8142cc0 0x7fd5c8146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8143e40 con 0x7fd5c80b68d0 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8149570 con 0x7fd5c8142cc0 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.010+0000 7fd5d0199640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8144350 con 0x7fd5c806aca0 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5c80b68d0 0x7fd5c81447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5c80b68d0 0x7fd5c81447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55070/0 (socket says 172.21.15.40:55070) 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 -- 172.21.15.40:0/3601752764 learned_addr learned my addr 172.21.15.40:0/3601752764 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cdf35640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c806aca0 0x7fd5c80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5ce736640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5c8142cc0 0x7fd5c8146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:59.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 -- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c806aca0 msgr2=0x7fd5c80b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c806aca0 0x7fd5c80b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 -- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5c8142cc0 msgr2=0x7fd5c8146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5c8142cc0 0x7fd5c8146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 -- 172.21.15.40:0/3601752764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0009a70 con 0x7fd5c80b68d0 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cdf35640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c806aca0 0x7fd5c80b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5ce736640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5c8142cc0 0x7fd5c8146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5cd734640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5c80b68d0 0x7fd5c81447e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c730 tx=0x7fd5b800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5be7fc640 1 -- 172.21.15.40:0/3601752764 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8005ab0 con 0x7fd5c80b68d0 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5be7fc640 1 -- 172.21.15.40:0/3601752764 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b8005c10 con 0x7fd5c80b68d0 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c4009400 con 0x7fd5c80b68d0 2023-12-20T06:04:59.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5be7fc640 1 -- 172.21.15.40:0/3601752764 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800ce70 con 0x7fd5c80b68d0 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.011+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c8146c80 con 0x7fd5c80b68d0 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.012+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c804e840 con 0x7fd5c80b68d0 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.013+0000 7fd5be7fc640 1 -- 172.21.15.40:0/3601752764 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd5b8007070 con 0x7fd5c80b68d0 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.013+0000 7fd5be7fc640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd5ac06a430 0x7fd5ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.013+0000 7fd5be7fc640 1 -- 172.21.15.40:0/3601752764 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd5b8087930 con 0x7fd5c80b68d0 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.013+0000 7fd5cdf35640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd5ac06a430 0x7fd5ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.014+0000 7fd5cdf35640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd5ac06a430 0x7fd5ac06c8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4036000 tx=0x7fd5c403c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:04:59.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.017+0000 7fd5be7fc640 1 -- 172.21.15.40:0/3601752764 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd5b8053360 con 0x7fd5c80b68d0 2023-12-20T06:04:59.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.359+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7fd5c806b3f0 con 0x7fd5c80b68d0 2023-12-20T06:04:59.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.396+0000 7fd5be7fc640 1 -- 172.21.15.40:0/3601752764 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v3096) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd5b8017020 con 0x7fd5c80b68d0 2023-12-20T06:04:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd5ac06a430 msgr2=0x7fd5ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd5ac06a430 0x7fd5ac06c8f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4036000 tx=0x7fd5c403c040 comp rx=0 tx=0).stop 2023-12-20T06:04:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5c80b68d0 msgr2=0x7fd5c81447e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:04:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5c80b68d0 0x7fd5c81447e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c730 tx=0x7fd5b800cb30 comp rx=0 tx=0).stop 2023-12-20T06:04:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 shutdown_connections 2023-12-20T06:04:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd5ac06a430 0x7fd5ac06c8f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5c8142cc0 0x7fd5c8146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5c80b68d0 0x7fd5c81447e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 --2- 172.21.15.40:0/3601752764 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd5c806aca0 0x7fd5c80b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:04:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 >> 172.21.15.40:0/3601752764 conn(0x7fd5c80b9c30 msgr2=0x7fd5c8141300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:04:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 shutdown_connections 2023-12-20T06:04:59.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:04:59.398+0000 7fd5d0199640 1 -- 172.21.15.40:0/3601752764 wait complete. 2023-12-20T06:04:59.410 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... FAIL 2023-12-20T06:04:59.410 INFO:tasks.cephfs_test_runner: 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner: 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:Ran 1 test in 6070.845s 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner: 2023-12-20T06:04:59.411 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner: 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner:FAIL: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_fscrypt.py", line 76, in test_fscrypt_dummy_encryption_with_quick_group 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner: self.assertEqual(proc.returncode, 0) 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-12-20T06:04:59.412 INFO:tasks.cephfs_test_runner: 2023-12-20T06:04:59.412 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-20T06:04:59.487 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=aa81309892c94e6b92444dc2607a16e1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-20T06:04:59.489 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-20T06:04:59.498 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-20T06:04:59.521 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-20T06:04:59.521 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-12-20T06:04:59.521 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T06:04:59.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:04:59.547 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:04:59.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:04:59.594 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054298,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249408k,nr_inodes=812352,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498824k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-20T06:04:59.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:59.595 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-12-20T06:04:59.809 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T06:04:59.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:59.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T06:04:59.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T06:04:59.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-12-20T06:05:00.093 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-20T06:05:00.103 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-20T06:05:00.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T06:05:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.209+0000 7fe822212640 1 Processor -- start 2023-12-20T06:05:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.209+0000 7fe822212640 1 -- start start 2023-12-20T06:05:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe822212640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe81c0b6690 0x7fe81c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe822212640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe81c144cd0 0x7fe81c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe822212640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0bc6b0 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe822212640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c0a59f0 con 0x7fe81c144cd0 2023-12-20T06:05:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe822212640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c0bc0a0 con 0x7fe81c0b6690 2023-12-20T06:05:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe81bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe81c144cd0 0x7fe81c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe81bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe81c144cd0 0x7fe81c155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55086/0 (socket says 172.21.15.40:55086) 2023-12-20T06:05:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe81bfff640 1 -- 172.21.15.40:0/1920102605 learned_addr learned my addr 172.21.15.40:0/1920102605 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:00.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.210+0000 7fe81affd640 1 --2- 172.21.15.40:0/1920102605 >> v2:172.21.15.69:3300/0 conn(0x7fe81c0b6690 0x7fe81c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81bfff640 1 -- 172.21.15.40:0/1920102605 >> v2:172.21.15.69:3300/0 conn(0x7fe81c0b6690 msgr2=0x7fe81c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81bfff640 1 --2- 172.21.15.40:0/1920102605 >> v2:172.21.15.69:3300/0 conn(0x7fe81c0b6690 0x7fe81c144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81bfff640 1 -- 172.21.15.40:0/1920102605 >> v1:172.21.15.69:6789/0 conn(0x7fe81c0bcdd0 legacy=0x7fe81c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81bfff640 1 -- 172.21.15.40:0/1920102605 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0bc340 con 0x7fe81c144cd0 2023-12-20T06:05:00.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81bfff640 1 --2- 172.21.15.40:0/1920102605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c144cd0 0x7fe81c155340 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0b72e0 tx=0x7fe81402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c1bd997007644c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81a7fc640 1 -- 172.21.15.40:0/1920102605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81402cbb0 con 0x7fe81c144cd0 2023-12-20T06:05:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81a7fc640 1 -- 172.21.15.40:0/1920102605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81402cd10 con 0x7fe81c144cd0 2023-12-20T06:05:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.211+0000 7fe81a7fc640 1 -- 172.21.15.40:0/1920102605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814034610 con 0x7fe81c144cd0 2023-12-20T06:05:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 -- 172.21.15.40:0/1920102605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c144cd0 msgr2=0x7fe81c155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 --2- 172.21.15.40:0/1920102605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c144cd0 0x7fe81c155340 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0b72e0 tx=0x7fe81402c010 comp rx=0 tx=0).stop 2023-12-20T06:05:00.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 -- 172.21.15.40:0/1920102605 shutdown_connections 2023-12-20T06:05:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 --2- 172.21.15.40:0/1920102605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c144cd0 0x7fe81c155340 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 --2- 172.21.15.40:0/1920102605 >> v2:172.21.15.69:3300/0 conn(0x7fe81c0b6690 0x7fe81c144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 -- 172.21.15.40:0/1920102605 >> 172.21.15.40:0/1920102605 conn(0x7fe81c071e60 msgr2=0x7fe81c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 -- 172.21.15.40:0/1920102605 shutdown_connections 2023-12-20T06:05:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.212+0000 7fe822212640 1 -- 172.21.15.40:0/1920102605 wait complete. 2023-12-20T06:05:00.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.213+0000 7fe822212640 1 Processor -- start 2023-12-20T06:05:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.213+0000 7fe822212640 1 -- start start 2023-12-20T06:05:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe822212640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe81c0b6690 0x7fe81c13e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe822212640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c0bcdd0 0x7fe81c146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe822212640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe81c144cd0 0x7fe81c146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe822212640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c13e930 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe822212640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c14b5c0 con 0x7fe81c0b6690 2023-12-20T06:05:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe822212640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c14ad80 con 0x7fe81c144cd0 2023-12-20T06:05:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c0bcdd0 0x7fe81c146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c0bcdd0 0x7fe81c146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55092/0 (socket says 172.21.15.40:55092) 2023-12-20T06:05:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 -- 172.21.15.40:0/4267773662 learned_addr learned my addr 172.21.15.40:0/4267773662 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81b7fe640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe81c0b6690 0x7fe81c13e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81bfff640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe81c144cd0 0x7fe81c146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 -- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe81c144cd0 msgr2=0x7fe81c146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe81c144cd0 0x7fe81c146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 -- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe81c0b6690 msgr2=0x7fe81c13e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe81c0b6690 0x7fe81c13e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.214+0000 7fe81affd640 1 -- 172.21.15.40:0/4267773662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814009b30 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.215+0000 7fe81affd640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c0bcdd0 0x7fe81c146a50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe81000d800 tx=0x7fe81000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.215+0000 7fe803fff640 1 -- 172.21.15.40:0/4267773662 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000b6c0 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.215+0000 7fe803fff640 1 -- 172.21.15.40:0/4267773662 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81000b820 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.215+0000 7fe803fff640 1 -- 172.21.15.40:0/4267773662 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81000bbb0 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.215+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c14a8f0 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.215+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c149bc0 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.216+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c04e840 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.216+0000 7fe803fff640 1 -- 172.21.15.40:0/4267773662 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe81000bd10 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.216+0000 7fe803fff640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe80806a430 0x7fe80806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.217+0000 7fe803fff640 1 -- 172.21.15.40:0/4267773662 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe810088ac0 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.217+0000 7fe81b7fe640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe80806a430 0x7fe80806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.217+0000 7fe81b7fe640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe80806a430 0x7fe80806c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000f60 tx=0x7fe80c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.221+0000 7fe803fff640 1 -- 172.21.15.40:0/4267773662 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe8100543c0 con 0x7fe81c0bcdd0 2023-12-20T06:05:00.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.392+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe81c0bd1b0 con 0x7fe80806a430 2023-12-20T06:05:00.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.394+0000 7fe803fff640 1 -- 172.21.15.40:0/4267773662 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50695 (secure 0 0 0) 0x7fe80c0014a0 con 0x7fe80806a430 2023-12-20T06:05:00.396 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:05:00.397 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T06:05:00.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe80806a430 msgr2=0x7fe80806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe80806a430 0x7fe80806c8f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000f60 tx=0x7fe80c009040 comp rx=0 tx=0).stop 2023-12-20T06:05:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c0bcdd0 msgr2=0x7fe81c146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c0bcdd0 0x7fe81c146a50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe81000d800 tx=0x7fe81000dcc0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 shutdown_connections 2023-12-20T06:05:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fe80806a430 0x7fe80806c8f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fe81c144cd0 0x7fe81c146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe81c0bcdd0 0x7fe81c146a50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 --2- 172.21.15.40:0/4267773662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe81c0b6690 0x7fe81c13e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.396+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 >> 172.21.15.40:0/4267773662 conn(0x7fe81c071e60 msgr2=0x7fe81c0b8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.397+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 shutdown_connections 2023-12-20T06:05:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.397+0000 7fe822212640 1 -- 172.21.15.40:0/4267773662 wait complete. 2023-12-20T06:05:00.409 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":3079,"stamp":"2023-12-20T06:05:00.067748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":7758196,"kb_used_data":269352,"kb_used_omap":528,"kb_used_meta":7475951,"kb_avail":747216524,"statfs":{"total":773094113280,"available":765149720576,"internally_reserved":0,"allocated":275816448,"data_stored":273900542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540840,"internal_metadata":7655374680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":180,"apply_latency_ms":180,"commit_latency_ns":180000000,"apply_latency_ns":180000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-755403238,"num_objects":-1460,"num_object_clones":0,"num_object_copies":-2920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1460,"num_whiteouts":0,"num_read":-66506,"num_read_kb":-54202099,"num_write":-2171536,"num_write_kb":-61103050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001268"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T06:04:57.993136+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T06:04:57.993136+0000","last_peered":"2023-12-20T06:04:57.993136+0000","last_clean":"2023-12-20T06:04:57.993136+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T06:04:57.993136+0000","last_undegraded":"2023-12-20T06:04:57.993136+0000","last_fullsized":"2023-12-20T06:04:57.993136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576069,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376396,"kb_used_data":964,"kb_used_omap":7,"kb_used_meta":375416,"kb_avail":93995444,"statfs":{"total":96636764160,"available":96251334656,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7431,"internal_metadata":384426745},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.48299999999999998,"15min":0.46700000000000003},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.22600000000000001},"max":{"1min":4.907,"5min":4.907,"15min":4.907},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28199999999999997,"15min":0.27000000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":2.012},"last":0.45100000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.46999999999999997,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.69999999999999996,"15min":9.5289999999999999},"last":0.37},{"interface":"front","average":{"1min":0.436,"5min":0.48899999999999999,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.68000000000000005,"5min":0.749,"15min":8.484},"last":0.496}]},{"osd":2,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":4.5300000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.30599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":2.3220000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.29999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.85399999999999998},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":2.0699999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":2.3530000000000002},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.82699999999999996,"15min":4.5620000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.248},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.0899999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":2.0470000000000002},"last":0.621},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.91900000000000004},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834576072,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1511740,"kb_used_data":94644,"kb_used_omap":0,"kb_used_meta":1417088,"kb_avail":92860100,"statfs":{"total":96636764160,"available":95088742400,"internally_reserved":0,"allocated":96915456,"data_stored":96684970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1451098112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.47799999999999998,"15min":0.56299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.496,"5min":2.6779999999999999,"15min":10.500999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.47199999999999998,"15min":0.52300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":3.6699999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84999999999999998,"5min":2.6509999999999998,"15min":4.399},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.47999999999999998,"15min":0.63200000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.72699999999999998,"15min":12.664},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.57399999999999995,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27000000000000002},"max":{"1min":1.0860000000000001,"5min":8.3829999999999991,"15min":10.188000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.624},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78700000000000003,"5min":7.202,"15min":7.202},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.318},"max":{"1min":0.88100000000000001,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.55900000000000005,"15min":0.624},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.61199999999999999,"5min":3.5539999999999998,"15min":10.236000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52300000000000002,"15min":0.60099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65000000000000002,"5min":2.621,"15min":15.074},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.55300000000000005,"15min":0.63400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":2.383,"15min":20.684999999999999},"last":0.441}]},{"osd":5,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51200000000000001,"15min":0.58199999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.308},"max":{"1min":0.56699999999999995,"5min":0.80900000000000005,"15min":10.15},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.58899999999999997,"15min":0.64500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":2.5830000000000002,"15min":7.9400000000000004},"last":0.32500000000000001}]},{"osd":7,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.59099999999999997,"15min":0.621},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":2.5550000000000002,"15min":7.0839999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.57599999999999996,"15min":0.64100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63,"5min":0.97299999999999998,"15min":10.212999999999999},"last":0.497}]}]},{"osd":5,"up_from":13,"seq":55834576071,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":709000,"kb_used_data":384,"kb_used_omap":30,"kb_used_meta":708577,"kb_avail":93662840,"statfs":{"total":96636764160,"available":95910748160,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":725583410},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":0.627,"5min":0.69499999999999995,"15min":0.69599999999999995},"last":0.372},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.52800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":8.2260000000000009},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.57099999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.69099999999999995,"5min":0.72499999999999998,"15min":13.317},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":14.054},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.54000000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":12.787000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1890000000000001,"5min":3.9239999999999999,"15min":8.4290000000000003},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.63300000000000001,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":9.1329999999999991,"15min":18.420999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78400000000000003,"15min":0.70999999999999996},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.67500000000000004,"5min":21.369,"15min":21.369},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46500000000000002,"15min":0.51000000000000001},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58999999999999997,"5min":0.73899999999999999,"15min":3.0630000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.50600000000000001,"15min":0.66800000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57499999999999996,"5min":0.77900000000000003,"15min":24.158999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.51600000000000001,"15min":0.59099999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67900000000000005,"5min":0.75700000000000001,"15min":13.279999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.622,"5min":0.79200000000000004,"15min":3.0299999999999998},"last":0.33200000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55800000000000005,"15min":0.621},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.317},"max":{"1min":0.64900000000000002,"5min":0.84999999999999998,"15min":8.2690000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57499999999999996,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":8.9930000000000003},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834576070,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":694472,"kb_used_data":384,"kb_used_omap":10,"kb_used_meta":694069,"kb_avail":93677368,"statfs":{"total":96636764160,"available":95925624832,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10854,"internal_metadata":710727066},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.67300000000000004,"5min":3.9449999999999998,"15min":7.6150000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68200000000000005,"5min":0.751,"15min":6.4199999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.51800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":6.7370000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.601,"5min":6.5609999999999999,"15min":7.649},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.505,"15min":0.54100000000000004},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.751,"5min":1.141,"15min":8.7309999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.317},"max":{"1min":1.6639999999999999,"5min":6.1369999999999996,"15min":9.9740000000000002},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48899999999999999,"15min":0.66000000000000003},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.28199999999999997},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":39.670999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54400000000000004,"15min":0.76500000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":54.856999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24299999999999999},"max":{"1min":0.69499999999999995,"5min":4.0069999999999997,"15min":7.7060000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.51500000000000001,"15min":0.67300000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.84799999999999998,"15min":39.640000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71099999999999997,"5min":0.88300000000000001,"15min":4.694},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.59299999999999997,"15min":0.61499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":3.9780000000000002,"15min":7.6779999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.54300000000000004,"15min":0.70599999999999996},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.91700000000000004,"15min":39.417000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834576069,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":762440,"kb_used_data":384,"kb_used_omap":13,"kb_used_meta":762034,"kb_avail":93609400,"statfs":{"total":96636764160,"available":95856025600,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13388,"internal_metadata":780323764},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":4.8609999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":14.263999999999999},"last":0.26000000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34000000000000002,"15min":0.42599999999999999},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":15.218999999999999},"last":0.37},{"interface":"front","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":25.405999999999999},"last":0.313}]},{"osd":2,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.44800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.223},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":14.377000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.437},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":5.0700000000000003},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.61899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":14.335000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73499999999999999,"5min":0.86199999999999999,"15min":3.7160000000000002},"last":0.58099999999999996}]},{"osd":5,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.64200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":15.253},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.89900000000000002,"15min":3.5339999999999998},"last":0.45500000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":3.633},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71299999999999997,"5min":0.94899999999999995,"15min":3.298},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":5.2460000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":14.307},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834576072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1389768,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1389376,"kb_avail":92982072,"statfs":{"total":96636764160,"available":95213641728,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1422721024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.45000000000000001,"5min":7.6399999999999997,"15min":7.6399999999999997},"last":0.255},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.441,"15min":0.39000000000000001},"min":{"1min":0.22900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61199999999999999,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.40899999999999997}]},{"osd":1,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.44},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54500000000000004,"5min":1.2989999999999999,"15min":7.4870000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":1.1140000000000001,"5min":4.1559999999999997,"15min":4.1559999999999997},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.437,"15min":0.41999999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23300000000000001},"max":{"1min":0.80800000000000005,"5min":5.1820000000000004,"15min":5.5970000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.50800000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.247},"max":{"1min":0.59099999999999997,"5min":13.347,"15min":13.347},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77500000000000002,"5min":0.86399999999999999,"15min":5.2859999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57899999999999996,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":3.7229999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":6.798},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.83899999999999997,"5min":1.284,"15min":5.5650000000000004},"last":0.39200000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.86699999999999999,"5min":1.3149999999999999,"15min":5.6200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.091,"5min":1.575,"15min":6.7489999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.375},"max":{"1min":0.89700000000000002,"5min":1.3400000000000001,"15min":5.6459999999999999},"last":0.45300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834576071,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":861448,"kb_used_data":86452,"kb_used_omap":466,"kb_used_meta":762221,"kb_avail":93510392,"statfs":{"total":96636764160,"available":95754641408,"internally_reserved":0,"allocated":88526848,"data_stored":88285543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":477985,"internal_metadata":780514527},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.40899999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20599999999999999},"max":{"1min":1.488,"5min":1.488,"15min":9.3049999999999997},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.55500000000000005,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.22600000000000001,"15min":0.19400000000000001},"max":{"1min":1.0980000000000001,"5min":13.952,"15min":13.952},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.109,"5min":2.4710000000000001,"15min":6.1189999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.24199999999999999},"max":{"1min":1.532,"5min":8.7420000000000009,"15min":9.9429999999999996},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71799999999999997,"15min":0.56499999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93300000000000005,"5min":19.202000000000002,"15min":19.202000000000002},"last":0.317},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.179,"5min":8.3520000000000003,"15min":8.3520000000000003},"last":0.374}]},{"osd":4,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.626,"15min":0.66800000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.5640000000000001,"5min":3.6030000000000002,"15min":12.558},"last":0.496},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68000000000000005},"min":{"1min":0.313,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.86099999999999999,"5min":3.073,"15min":5.7329999999999997},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2030000000000001,"5min":8.2720000000000002,"15min":8.6340000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28199999999999997},"max":{"1min":1.587,"5min":1.587,"15min":10.545999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.69099999999999995},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.879,"5min":3.0369999999999999,"15min":5.1829999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":8.391,"15min":11.904999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":3.0960000000000001,"15min":4.5789999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834576073,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1452932,"kb_used_data":85756,"kb_used_omap":0,"kb_used_meta":1367168,"kb_avail":92918908,"statfs":{"total":96636764160,"available":95148961792,"internally_reserved":0,"allocated":87814144,"data_stored":87580106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1399980032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.43099999999999999},"min":{"1min":0.22,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":1.6319999999999999,"5min":2.0070000000000001,"15min":11.935},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.39000000000000001,"15min":0.44600000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":2.823,"5min":2.823,"15min":13.151999999999999},"last":0.24399999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38900000000000001,"15min":0.46300000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.5700000000000001,"5min":2.0369999999999999,"15min":7.641},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":3.7149999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":2.3660000000000001,"5min":8.2579999999999991,"15min":8.2579999999999991},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.5369999999999999,"5min":2.0670000000000002,"15min":5.827},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.57699999999999996,"15min":0.68700000000000006},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.66200000000000003,"5min":3.3730000000000002,"15min":13.061},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35799999999999998},"max":{"1min":2.4550000000000001,"5min":7.1710000000000003,"15min":8.9459999999999997},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.28899999999999998},"max":{"1min":1.6120000000000001,"5min":1.9359999999999999,"15min":4.2329999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.58599999999999997,"15min":0.67700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":1.321,"15min":16.009},"last":0.84299999999999997}]},{"osd":6,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66800000000000004,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.39400000000000002,"15min":0.33300000000000002},"max":{"1min":2.403,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.376},"max":{"1min":1.5900000000000001,"5min":1.978,"15min":3.5499999999999998},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.68100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":1.2989999999999999,"15min":12.731},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36499999999999999},"max":{"1min":2.4289999999999998,"5min":6.0289999999999999,"15min":6.0289999999999999},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T06:05:00.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T06:05:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.516+0000 7f9c3b42c640 1 Processor -- start 2023-12-20T06:05:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c3b42c640 1 -- start start 2023-12-20T06:05:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c3b42c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9c34144d10 0x7f9c34069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c3b42c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3414ed10 con 0x7f9c3414b450 2023-12-20T06:05:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c3b42c640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3414b8a0 con 0x7f9c3414afc0 2023-12-20T06:05:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c3b42c640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c34070ef0 con 0x7f9c34144d10 2023-12-20T06:05:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c399c9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9c3414b450 0x7f9c3414e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52490/0 (socket says 172.21.15.40:52490) 2023-12-20T06:05:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c399c9640 1 -- 172.21.15.40:0/2676458106 learned_addr learned my addr 172.21.15.40:0/2676458106 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.517+0000 7f9c391c8640 1 --2- 172.21.15.40:0/2676458106 >> v2:172.21.15.69:3300/0 conn(0x7f9c34144d10 0x7f9c34069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.518+0000 7f9c2bfff640 1 -- 172.21.15.40:0/2676458106 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375559749 0 0) 0x7f9c3414ed10 con 0x7f9c3414b450 2023-12-20T06:05:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.518+0000 7f9c2bfff640 1 -- 172.21.15.40:0/2676458106 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c20003520 con 0x7f9c3414b450 2023-12-20T06:05:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.518+0000 7f9c2bfff640 1 -- 172.21.15.40:0/2676458106 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659342045 0 0) 0x7f9c3414b8a0 con 0x7f9c3414afc0 2023-12-20T06:05:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.518+0000 7f9c2bfff640 1 -- 172.21.15.40:0/2676458106 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c3414ed10 con 0x7f9c3414afc0 2023-12-20T06:05:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.518+0000 7f9c391c8640 1 -- 172.21.15.40:0/2676458106 >> v1:172.21.15.69:6789/0 conn(0x7f9c3414afc0 legacy=0x7f9c3414def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.518+0000 7f9c391c8640 1 -- 172.21.15.40:0/2676458106 >> v1:172.21.15.40:6789/0 conn(0x7f9c3414b450 legacy=0x7f9c3414e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.518+0000 7f9c391c8640 1 -- 172.21.15.40:0/2676458106 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340704d0 con 0x7f9c34144d10 2023-12-20T06:05:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c391c8640 1 --2- 172.21.15.40:0/2676458106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c34144d10 0x7f9c34069ba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009790 tx=0x7f9c3002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab64e428abed6a34 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c2bfff640 1 -- 172.21.15.40:0/2676458106 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30030610 con 0x7f9c34144d10 2023-12-20T06:05:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c2bfff640 1 -- 172.21.15.40:0/2676458106 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c30030770 con 0x7f9c34144d10 2023-12-20T06:05:00.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c2bfff640 1 -- 172.21.15.40:0/2676458106 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30030b00 con 0x7f9c34144d10 2023-12-20T06:05:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2676458106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c34144d10 msgr2=0x7f9c34069ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2676458106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c34144d10 0x7f9c34069ba0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9c30009790 tx=0x7f9c3002b960 comp rx=0 tx=0).stop 2023-12-20T06:05:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2676458106 shutdown_connections 2023-12-20T06:05:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2676458106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c34144d10 0x7f9c34069ba0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2676458106 >> 172.21.15.40:0/2676458106 conn(0x7f9c340b99b0 msgr2=0x7f9c340b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:00.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2676458106 shutdown_connections 2023-12-20T06:05:00.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.519+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2676458106 wait complete. 2023-12-20T06:05:00.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.520+0000 7f9c3b42c640 1 Processor -- start 2023-12-20T06:05:00.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.520+0000 7f9c3b42c640 1 -- start start 2023-12-20T06:05:00.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c3b42c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c34144d10 0x7f9c34149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c3b42c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c3414afc0 0x7f9c3413ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c3b42c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c3414b450 0x7f9c3413f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c3b42c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34149770 con 0x7f9c34144d10 2023-12-20T06:05:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c3b42c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3414e840 con 0x7f9c3414afc0 2023-12-20T06:05:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c3b42c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34140f80 con 0x7f9c3414b450 2023-12-20T06:05:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c391c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c34144d10 0x7f9c34149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c391c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c34144d10 0x7f9c34149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55104/0 (socket says 172.21.15.40:55104) 2023-12-20T06:05:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c391c8640 1 -- 172.21.15.40:0/2840234317 learned_addr learned my addr 172.21.15.40:0/2840234317 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c399c9640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c3414b450 0x7f9c3413f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c389c7640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c3414afc0 0x7f9c3413ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c391c8640 1 -- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c3414b450 msgr2=0x7f9c3413f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c391c8640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c3414b450 0x7f9c3413f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c391c8640 1 -- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c3414afc0 msgr2=0x7f9c3413ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.521+0000 7f9c391c8640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c3414afc0 0x7f9c3413ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.522+0000 7f9c391c8640 1 -- 172.21.15.40:0/2840234317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300093a0 con 0x7f9c34144d10 2023-12-20T06:05:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.522+0000 7f9c391c8640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c34144d10 0x7f9c34149230 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002bf70 tx=0x7f9c300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.522+0000 7f9c29ffb640 1 -- 172.21.15.40:0/2840234317 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3003e070 con 0x7f9c34144d10 2023-12-20T06:05:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.522+0000 7f9c29ffb640 1 -- 172.21.15.40:0/2840234317 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c300397a0 con 0x7f9c34144d10 2023-12-20T06:05:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.522+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c340b71c0 con 0x7f9c34144d10 2023-12-20T06:05:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.522+0000 7f9c29ffb640 1 -- 172.21.15.40:0/2840234317 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c30039b70 con 0x7f9c34144d10 2023-12-20T06:05:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.522+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3414a190 con 0x7f9c34144d10 2023-12-20T06:05:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.523+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34140900 con 0x7f9c34144d10 2023-12-20T06:05:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.523+0000 7f9c29ffb640 1 -- 172.21.15.40:0/2840234317 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c30039cd0 con 0x7f9c34144d10 2023-12-20T06:05:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.524+0000 7f9c29ffb640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c1806a430 0x7f9c1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.524+0000 7f9c29ffb640 1 -- 172.21.15.40:0/2840234317 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c300aa860 con 0x7f9c34144d10 2023-12-20T06:05:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.524+0000 7f9c389c7640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c1806a430 0x7f9c1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.524+0000 7f9c389c7640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c1806a430 0x7f9c1806c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9c340665f0 tx=0x7f9c24009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.528+0000 7f9c29ffb640 1 -- 172.21.15.40:0/2840234317 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9c34140900 con 0x7f9c34144d10 2023-12-20T06:05:00.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.701+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c340707b0 con 0x7f9c1806a430 2023-12-20T06:05:00.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.704+0000 7f9c29ffb640 1 -- 172.21.15.40:0/2840234317 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50695 (secure 0 0 0) 0x7f9c240050d0 con 0x7f9c1806a430 2023-12-20T06:05:00.705 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:05:00.705 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T06:05:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c1806a430 msgr2=0x7f9c1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c1806a430 0x7f9c1806c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9c340665f0 tx=0x7f9c24009040 comp rx=0 tx=0).stop 2023-12-20T06:05:00.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c34144d10 msgr2=0x7f9c34149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c34144d10 0x7f9c34149230 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9c3002bf70 tx=0x7f9c300046c0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 shutdown_connections 2023-12-20T06:05:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f9c1806a430 0x7f9c1806c8f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f9c3414b450 0x7f9c3413f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c3414afc0 0x7f9c3413ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 --2- 172.21.15.40:0/2840234317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c34144d10 0x7f9c34149230 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 >> 172.21.15.40:0/2840234317 conn(0x7f9c340b99b0 msgr2=0x7f9c341428f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:00.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 shutdown_connections 2023-12-20T06:05:00.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.705+0000 7f9c3b42c640 1 -- 172.21.15.40:0/2840234317 wait complete. 2023-12-20T06:05:00.717 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":3079,"stamp":"2023-12-20T06:05:00.067748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":7758196,"kb_used_data":269352,"kb_used_omap":528,"kb_used_meta":7475951,"kb_avail":747216524,"statfs":{"total":773094113280,"available":765149720576,"internally_reserved":0,"allocated":275816448,"data_stored":273900542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540840,"internal_metadata":7655374680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":180,"apply_latency_ms":180,"commit_latency_ns":180000000,"apply_latency_ns":180000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-755403238,"num_objects":-1460,"num_object_clones":0,"num_object_copies":-2920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1460,"num_whiteouts":0,"num_read":-66506,"num_read_kb":-54202099,"num_write":-2171536,"num_write_kb":-61103050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001268"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T06:04:57.993136+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T06:04:57.993136+0000","last_peered":"2023-12-20T06:04:57.993136+0000","last_clean":"2023-12-20T06:04:57.993136+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T06:04:57.993136+0000","last_undegraded":"2023-12-20T06:04:57.993136+0000","last_fullsized":"2023-12-20T06:04:57.993136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576069,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376396,"kb_used_data":964,"kb_used_omap":7,"kb_used_meta":375416,"kb_avail":93995444,"statfs":{"total":96636764160,"available":96251334656,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7431,"internal_metadata":384426745},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.48299999999999998,"15min":0.46700000000000003},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.22600000000000001},"max":{"1min":4.907,"5min":4.907,"15min":4.907},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28199999999999997,"15min":0.27000000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":2.012},"last":0.45100000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.46999999999999997,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.69999999999999996,"15min":9.5289999999999999},"last":0.37},{"interface":"front","average":{"1min":0.436,"5min":0.48899999999999999,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.68000000000000005,"5min":0.749,"15min":8.484},"last":0.496}]},{"osd":2,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":4.5300000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.30599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":2.3220000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.29999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.85399999999999998},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":2.0699999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":2.3530000000000002},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.82699999999999996,"15min":4.5620000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.248},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.0899999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":2.0470000000000002},"last":0.621},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.91900000000000004},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834576072,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1511740,"kb_used_data":94644,"kb_used_omap":0,"kb_used_meta":1417088,"kb_avail":92860100,"statfs":{"total":96636764160,"available":95088742400,"internally_reserved":0,"allocated":96915456,"data_stored":96684970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1451098112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.47799999999999998,"15min":0.56299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.496,"5min":2.6779999999999999,"15min":10.500999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.47199999999999998,"15min":0.52300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":3.6699999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84999999999999998,"5min":2.6509999999999998,"15min":4.399},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.47999999999999998,"15min":0.63200000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.72699999999999998,"15min":12.664},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.57399999999999995,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27000000000000002},"max":{"1min":1.0860000000000001,"5min":8.3829999999999991,"15min":10.188000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.624},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78700000000000003,"5min":7.202,"15min":7.202},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.318},"max":{"1min":0.88100000000000001,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.55900000000000005,"15min":0.624},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.61199999999999999,"5min":3.5539999999999998,"15min":10.236000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52300000000000002,"15min":0.60099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65000000000000002,"5min":2.621,"15min":15.074},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.55300000000000005,"15min":0.63400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":2.383,"15min":20.684999999999999},"last":0.441}]},{"osd":5,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51200000000000001,"15min":0.58199999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.308},"max":{"1min":0.56699999999999995,"5min":0.80900000000000005,"15min":10.15},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.58899999999999997,"15min":0.64500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":2.5830000000000002,"15min":7.9400000000000004},"last":0.32500000000000001}]},{"osd":7,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.59099999999999997,"15min":0.621},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":2.5550000000000002,"15min":7.0839999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.57599999999999996,"15min":0.64100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63,"5min":0.97299999999999998,"15min":10.212999999999999},"last":0.497}]}]},{"osd":5,"up_from":13,"seq":55834576071,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":709000,"kb_used_data":384,"kb_used_omap":30,"kb_used_meta":708577,"kb_avail":93662840,"statfs":{"total":96636764160,"available":95910748160,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":725583410},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":0.627,"5min":0.69499999999999995,"15min":0.69599999999999995},"last":0.372},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.52800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":8.2260000000000009},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.57099999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.69099999999999995,"5min":0.72499999999999998,"15min":13.317},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":14.054},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.54000000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":12.787000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1890000000000001,"5min":3.9239999999999999,"15min":8.4290000000000003},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.63300000000000001,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":9.1329999999999991,"15min":18.420999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78400000000000003,"15min":0.70999999999999996},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.67500000000000004,"5min":21.369,"15min":21.369},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46500000000000002,"15min":0.51000000000000001},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58999999999999997,"5min":0.73899999999999999,"15min":3.0630000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.50600000000000001,"15min":0.66800000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57499999999999996,"5min":0.77900000000000003,"15min":24.158999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.51600000000000001,"15min":0.59099999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67900000000000005,"5min":0.75700000000000001,"15min":13.279999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.622,"5min":0.79200000000000004,"15min":3.0299999999999998},"last":0.33200000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55800000000000005,"15min":0.621},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.317},"max":{"1min":0.64900000000000002,"5min":0.84999999999999998,"15min":8.2690000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57499999999999996,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":8.9930000000000003},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834576070,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":694472,"kb_used_data":384,"kb_used_omap":10,"kb_used_meta":694069,"kb_avail":93677368,"statfs":{"total":96636764160,"available":95925624832,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10854,"internal_metadata":710727066},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.67300000000000004,"5min":3.9449999999999998,"15min":7.6150000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68200000000000005,"5min":0.751,"15min":6.4199999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.51800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":6.7370000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.601,"5min":6.5609999999999999,"15min":7.649},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.505,"15min":0.54100000000000004},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.751,"5min":1.141,"15min":8.7309999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.317},"max":{"1min":1.6639999999999999,"5min":6.1369999999999996,"15min":9.9740000000000002},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48899999999999999,"15min":0.66000000000000003},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.28199999999999997},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":39.670999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54400000000000004,"15min":0.76500000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":54.856999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24299999999999999},"max":{"1min":0.69499999999999995,"5min":4.0069999999999997,"15min":7.7060000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.51500000000000001,"15min":0.67300000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.84799999999999998,"15min":39.640000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71099999999999997,"5min":0.88300000000000001,"15min":4.694},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.59299999999999997,"15min":0.61499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":3.9780000000000002,"15min":7.6779999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.54300000000000004,"15min":0.70599999999999996},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.91700000000000004,"15min":39.417000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834576069,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":762440,"kb_used_data":384,"kb_used_omap":13,"kb_used_meta":762034,"kb_avail":93609400,"statfs":{"total":96636764160,"available":95856025600,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13388,"internal_metadata":780323764},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":4.8609999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":14.263999999999999},"last":0.26000000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34000000000000002,"15min":0.42599999999999999},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":15.218999999999999},"last":0.37},{"interface":"front","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":25.405999999999999},"last":0.313}]},{"osd":2,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.44800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.223},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":14.377000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.437},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":5.0700000000000003},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.61899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":14.335000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73499999999999999,"5min":0.86199999999999999,"15min":3.7160000000000002},"last":0.58099999999999996}]},{"osd":5,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.64200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":15.253},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.89900000000000002,"15min":3.5339999999999998},"last":0.45500000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":3.633},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71299999999999997,"5min":0.94899999999999995,"15min":3.298},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":5.2460000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":14.307},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834576072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1389768,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1389376,"kb_avail":92982072,"statfs":{"total":96636764160,"available":95213641728,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1422721024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.45000000000000001,"5min":7.6399999999999997,"15min":7.6399999999999997},"last":0.255},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.441,"15min":0.39000000000000001},"min":{"1min":0.22900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61199999999999999,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.40899999999999997}]},{"osd":1,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.44},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54500000000000004,"5min":1.2989999999999999,"15min":7.4870000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":1.1140000000000001,"5min":4.1559999999999997,"15min":4.1559999999999997},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.437,"15min":0.41999999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23300000000000001},"max":{"1min":0.80800000000000005,"5min":5.1820000000000004,"15min":5.5970000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.50800000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.247},"max":{"1min":0.59099999999999997,"5min":13.347,"15min":13.347},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77500000000000002,"5min":0.86399999999999999,"15min":5.2859999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57899999999999996,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":3.7229999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":6.798},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.83899999999999997,"5min":1.284,"15min":5.5650000000000004},"last":0.39200000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.86699999999999999,"5min":1.3149999999999999,"15min":5.6200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.091,"5min":1.575,"15min":6.7489999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.375},"max":{"1min":0.89700000000000002,"5min":1.3400000000000001,"15min":5.6459999999999999},"last":0.45300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834576071,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":861448,"kb_used_data":86452,"kb_used_omap":466,"kb_used_meta":762221,"kb_avail":93510392,"statfs":{"total":96636764160,"available":95754641408,"internally_reserved":0,"allocated":88526848,"data_stored":88285543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":477985,"internal_metadata":780514527},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.40899999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20599999999999999},"max":{"1min":1.488,"5min":1.488,"15min":9.3049999999999997},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.55500000000000005,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.22600000000000001,"15min":0.19400000000000001},"max":{"1min":1.0980000000000001,"5min":13.952,"15min":13.952},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.109,"5min":2.4710000000000001,"15min":6.1189999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.24199999999999999},"max":{"1min":1.532,"5min":8.7420000000000009,"15min":9.9429999999999996},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71799999999999997,"15min":0.56499999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93300000000000005,"5min":19.202000000000002,"15min":19.202000000000002},"last":0.317},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.179,"5min":8.3520000000000003,"15min":8.3520000000000003},"last":0.374}]},{"osd":4,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.626,"15min":0.66800000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.5640000000000001,"5min":3.6030000000000002,"15min":12.558},"last":0.496},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68000000000000005},"min":{"1min":0.313,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.86099999999999999,"5min":3.073,"15min":5.7329999999999997},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2030000000000001,"5min":8.2720000000000002,"15min":8.6340000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28199999999999997},"max":{"1min":1.587,"5min":1.587,"15min":10.545999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.69099999999999995},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.879,"5min":3.0369999999999999,"15min":5.1829999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":8.391,"15min":11.904999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":3.0960000000000001,"15min":4.5789999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834576073,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1452932,"kb_used_data":85756,"kb_used_omap":0,"kb_used_meta":1367168,"kb_avail":92918908,"statfs":{"total":96636764160,"available":95148961792,"internally_reserved":0,"allocated":87814144,"data_stored":87580106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1399980032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.43099999999999999},"min":{"1min":0.22,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":1.6319999999999999,"5min":2.0070000000000001,"15min":11.935},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.39000000000000001,"15min":0.44600000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":2.823,"5min":2.823,"15min":13.151999999999999},"last":0.24399999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38900000000000001,"15min":0.46300000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.5700000000000001,"5min":2.0369999999999999,"15min":7.641},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":3.7149999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":2.3660000000000001,"5min":8.2579999999999991,"15min":8.2579999999999991},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.5369999999999999,"5min":2.0670000000000002,"15min":5.827},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.57699999999999996,"15min":0.68700000000000006},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.66200000000000003,"5min":3.3730000000000002,"15min":13.061},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35799999999999998},"max":{"1min":2.4550000000000001,"5min":7.1710000000000003,"15min":8.9459999999999997},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.28899999999999998},"max":{"1min":1.6120000000000001,"5min":1.9359999999999999,"15min":4.2329999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.58599999999999997,"15min":0.67700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":1.321,"15min":16.009},"last":0.84299999999999997}]},{"osd":6,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66800000000000004,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.39400000000000002,"15min":0.33300000000000002},"max":{"1min":2.403,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.376},"max":{"1min":1.5900000000000001,"5min":1.978,"15min":3.5499999999999998},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.68100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":1.2989999999999999,"15min":12.731},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36499999999999999},"max":{"1min":2.4289999999999998,"5min":6.0289999999999999,"15min":6.0289999999999999},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T06:05:00.719 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-20T06:05:00.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T06:05:00.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.824+0000 7f5b4e2fb640 1 Processor -- start 2023-12-20T06:05:00.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4e2fb640 1 -- start start 2023-12-20T06:05:00.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4e2fb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480bcdd0 0x7f5b480b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4e2fb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5b480b64c0 0x7f5b48144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4e2fb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b480bc6b0 con 0x7f5b48144cd0 2023-12-20T06:05:00.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4e2fb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b480b6900 con 0x7f5b480b64c0 2023-12-20T06:05:00.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4e2fb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480a59f0 con 0x7f5b480bcdd0 2023-12-20T06:05:00.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b477fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5b480b64c0 0x7f5b48144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4c898640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5b48144cd0 0x7f5b4814e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52492/0 (socket says 172.21.15.40:52492) 2023-12-20T06:05:00.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.825+0000 7f5b4c898640 1 -- 172.21.15.40:0/3426484993 learned_addr learned my addr 172.21.15.40:0/3426484993 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:00.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b47fff640 1 --2- 172.21.15.40:0/3426484993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480bcdd0 0x7f5b480b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b46ffd640 1 -- 172.21.15.40:0/3426484993 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921518830 0 0) 0x7f5b480bc6b0 con 0x7f5b48144cd0 2023-12-20T06:05:00.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b46ffd640 1 -- 172.21.15.40:0/3426484993 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b30003520 con 0x7f5b48144cd0 2023-12-20T06:05:00.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b477fe640 1 -- 172.21.15.40:0/3426484993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480bcdd0 msgr2=0x7f5b480b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:00.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b477fe640 1 --2- 172.21.15.40:0/3426484993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480bcdd0 0x7f5b480b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b477fe640 1 -- 172.21.15.40:0/3426484993 >> v1:172.21.15.40:6789/0 conn(0x7f5b48144cd0 legacy=0x7f5b4814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b477fe640 1 -- 172.21.15.40:0/3426484993 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480bc0a0 con 0x7f5b480b64c0 2023-12-20T06:05:00.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.826+0000 7f5b477fe640 1 --2- 172.21.15.40:0/3426484993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b480b64c0 0x7f5b48144790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0097a0 tx=0x7f5b3c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ad65f86b50065b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b46ffd640 1 -- 172.21.15.40:0/3426484993 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c030610 con 0x7f5b480b64c0 2023-12-20T06:05:00.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b46ffd640 1 -- 172.21.15.40:0/3426484993 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c030770 con 0x7f5b480b64c0 2023-12-20T06:05:00.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b46ffd640 1 -- 172.21.15.40:0/3426484993 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c030b00 con 0x7f5b480b64c0 2023-12-20T06:05:00.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3426484993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b480b64c0 msgr2=0x7f5b48144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3426484993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b480b64c0 0x7f5b48144790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0097a0 tx=0x7f5b3c02b960 comp rx=0 tx=0).stop 2023-12-20T06:05:00.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3426484993 shutdown_connections 2023-12-20T06:05:00.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3426484993 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b480b64c0 0x7f5b48144790 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3426484993 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480bcdd0 0x7f5b480b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3426484993 >> 172.21.15.40:0/3426484993 conn(0x7f5b48071e60 msgr2=0x7f5b480c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:00.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3426484993 shutdown_connections 2023-12-20T06:05:00.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.827+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3426484993 wait complete. 2023-12-20T06:05:00.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.828+0000 7f5b4e2fb640 1 Processor -- start 2023-12-20T06:05:00.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.828+0000 7f5b4e2fb640 1 -- start start 2023-12-20T06:05:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4e2fb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480b64c0 0x7f5b481d44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4e2fb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b480bcdd0 0x7f5b481d6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4e2fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b48144cd0 0x7f5b481e3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4e2fb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481d69b0 con 0x7f5b48144cd0 2023-12-20T06:05:00.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4e2fb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481e3750 con 0x7f5b480bcdd0 2023-12-20T06:05:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4e2fb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481d4ae0 con 0x7f5b480b64c0 2023-12-20T06:05:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b48144cd0 0x7f5b481e3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b48144cd0 0x7f5b481e3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55114/0 (socket says 172.21.15.40:55114) 2023-12-20T06:05:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 -- 172.21.15.40:0/3346343387 learned_addr learned my addr 172.21.15.40:0/3346343387 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b477fe640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b480bcdd0 0x7f5b481d6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b47fff640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480b64c0 0x7f5b481d44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 -- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480b64c0 msgr2=0x7f5b481d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480b64c0 0x7f5b481d44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 -- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b480bcdd0 msgr2=0x7f5b481d6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b480bcdd0 0x7f5b481d6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.829+0000 7f5b4c898640 1 -- 172.21.15.40:0/3346343387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c009400 con 0x7f5b48144cd0 2023-12-20T06:05:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.830+0000 7f5b4c898640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b48144cd0 0x7f5b481e3be0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000caa0 tx=0x7f5b4000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.830+0000 7f5b44ff9640 1 -- 172.21.15.40:0/3346343387 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4000ac00 con 0x7f5b48144cd0 2023-12-20T06:05:00.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.830+0000 7f5b44ff9640 1 -- 172.21.15.40:0/3346343387 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4000ad60 con 0x7f5b48144cd0 2023-12-20T06:05:00.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.830+0000 7f5b44ff9640 1 -- 172.21.15.40:0/3346343387 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40012620 con 0x7f5b48144cd0 2023-12-20T06:05:00.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.830+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b481d4dc0 con 0x7f5b48144cd0 2023-12-20T06:05:00.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.830+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b481d2f10 con 0x7f5b48144cd0 2023-12-20T06:05:00.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.831+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4804e840 con 0x7f5b48144cd0 2023-12-20T06:05:00.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.831+0000 7f5b44ff9640 1 -- 172.21.15.40:0/3346343387 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b40007070 con 0x7f5b48144cd0 2023-12-20T06:05:00.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.832+0000 7f5b44ff9640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5b3406a430 0x7f5b3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.832+0000 7f5b44ff9640 1 -- 172.21.15.40:0/3346343387 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5b400885a0 con 0x7f5b48144cd0 2023-12-20T06:05:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.832+0000 7f5b47fff640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5b3406a430 0x7f5b3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.832+0000 7f5b47fff640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5b3406a430 0x7f5b3406c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009ad0 tx=0x7f5b38008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:00.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:00.836+0000 7f5b44ff9640 1 -- 172.21.15.40:0/3346343387 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5b40053e90 con 0x7f5b48144cd0 2023-12-20T06:05:01.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.007+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b480b5500 con 0x7f5b3406a430 2023-12-20T06:05:01.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.010+0000 7f5b44ff9640 1 -- 172.21.15.40:0/3346343387 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50695 (secure 0 0 0) 0x7f5b380119a0 con 0x7f5b3406a430 2023-12-20T06:05:01.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:05:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T06:05:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5b3406a430 msgr2=0x7f5b3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5b3406a430 0x7f5b3406c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009ad0 tx=0x7f5b38008040 comp rx=0 tx=0).stop 2023-12-20T06:05:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b48144cd0 msgr2=0x7f5b481e3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b48144cd0 0x7f5b481e3be0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000caa0 tx=0x7f5b4000cf60 comp rx=0 tx=0).stop 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 shutdown_connections 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f5b3406a430 0x7f5b3406c8f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b48144cd0 0x7f5b481e3be0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b480bcdd0 0x7f5b481d6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 --2- 172.21.15.40:0/3346343387 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f5b480b64c0 0x7f5b481d44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 >> 172.21.15.40:0/3346343387 conn(0x7f5b48071e60 msgr2=0x7f5b480b8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:01.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 shutdown_connections 2023-12-20T06:05:01.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.012+0000 7f5b4e2fb640 1 -- 172.21.15.40:0/3346343387 wait complete. 2023-12-20T06:05:01.024 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":3079,"stamp":"2023-12-20T06:05:00.067748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":7758196,"kb_used_data":269352,"kb_used_omap":528,"kb_used_meta":7475951,"kb_avail":747216524,"statfs":{"total":773094113280,"available":765149720576,"internally_reserved":0,"allocated":275816448,"data_stored":273900542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540840,"internal_metadata":7655374680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":180,"apply_latency_ms":180,"commit_latency_ns":180000000,"apply_latency_ns":180000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-755403238,"num_objects":-1460,"num_object_clones":0,"num_object_copies":-2920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1460,"num_whiteouts":0,"num_read":-66506,"num_read_kb":-54202099,"num_write":-2171536,"num_write_kb":-61103050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001268"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T06:04:57.993136+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T06:04:57.993136+0000","last_peered":"2023-12-20T06:04:57.993136+0000","last_clean":"2023-12-20T06:04:57.993136+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T06:04:57.993136+0000","last_undegraded":"2023-12-20T06:04:57.993136+0000","last_fullsized":"2023-12-20T06:04:57.993136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576069,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376396,"kb_used_data":964,"kb_used_omap":7,"kb_used_meta":375416,"kb_avail":93995444,"statfs":{"total":96636764160,"available":96251334656,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7431,"internal_metadata":384426745},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.48299999999999998,"15min":0.46700000000000003},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.22600000000000001},"max":{"1min":4.907,"5min":4.907,"15min":4.907},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28199999999999997,"15min":0.27000000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":2.012},"last":0.45100000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.46999999999999997,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.69999999999999996,"15min":9.5289999999999999},"last":0.37},{"interface":"front","average":{"1min":0.436,"5min":0.48899999999999999,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.68000000000000005,"5min":0.749,"15min":8.484},"last":0.496}]},{"osd":2,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":4.5300000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.30599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":2.3220000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.29999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.85399999999999998},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":2.0699999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":2.3530000000000002},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.82699999999999996,"15min":4.5620000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.248},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.0899999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":2.0470000000000002},"last":0.621},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.91900000000000004},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834576072,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1511740,"kb_used_data":94644,"kb_used_omap":0,"kb_used_meta":1417088,"kb_avail":92860100,"statfs":{"total":96636764160,"available":95088742400,"internally_reserved":0,"allocated":96915456,"data_stored":96684970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1451098112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.47799999999999998,"15min":0.56299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.496,"5min":2.6779999999999999,"15min":10.500999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.47199999999999998,"15min":0.52300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":3.6699999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84999999999999998,"5min":2.6509999999999998,"15min":4.399},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.47999999999999998,"15min":0.63200000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.72699999999999998,"15min":12.664},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.57399999999999995,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27000000000000002},"max":{"1min":1.0860000000000001,"5min":8.3829999999999991,"15min":10.188000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.624},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78700000000000003,"5min":7.202,"15min":7.202},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.318},"max":{"1min":0.88100000000000001,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.439,"5min":0.55900000000000005,"15min":0.624},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.61199999999999999,"5min":3.5539999999999998,"15min":10.236000000000001},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52300000000000002,"15min":0.60099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65000000000000002,"5min":2.621,"15min":15.074},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.55300000000000005,"15min":0.63400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":2.383,"15min":20.684999999999999},"last":0.441}]},{"osd":5,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51200000000000001,"15min":0.58199999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.308},"max":{"1min":0.56699999999999995,"5min":0.80900000000000005,"15min":10.15},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.58899999999999997,"15min":0.64500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":2.5830000000000002,"15min":7.9400000000000004},"last":0.32500000000000001}]},{"osd":7,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.59099999999999997,"15min":0.621},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":2.5550000000000002,"15min":7.0839999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.57599999999999996,"15min":0.64100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63,"5min":0.97299999999999998,"15min":10.212999999999999},"last":0.497}]}]},{"osd":5,"up_from":13,"seq":55834576071,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":709000,"kb_used_data":384,"kb_used_omap":30,"kb_used_meta":708577,"kb_avail":93662840,"statfs":{"total":96636764160,"available":95910748160,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":725583410},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":0.627,"5min":0.69499999999999995,"15min":0.69599999999999995},"last":0.372},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.52800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":8.2260000000000009},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.57099999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.69099999999999995,"5min":0.72499999999999998,"15min":13.317},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":14.054},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.54000000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":12.787000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1890000000000001,"5min":3.9239999999999999,"15min":8.4290000000000003},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.63300000000000001,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":9.1329999999999991,"15min":18.420999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78400000000000003,"15min":0.70999999999999996},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.67500000000000004,"5min":21.369,"15min":21.369},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46500000000000002,"15min":0.51000000000000001},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58999999999999997,"5min":0.73899999999999999,"15min":3.0630000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.50600000000000001,"15min":0.66800000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57499999999999996,"5min":0.77900000000000003,"15min":24.158999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.51600000000000001,"15min":0.59099999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67900000000000005,"5min":0.75700000000000001,"15min":13.279999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.622,"5min":0.79200000000000004,"15min":3.0299999999999998},"last":0.33200000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55800000000000005,"15min":0.621},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.317},"max":{"1min":0.64900000000000002,"5min":0.84999999999999998,"15min":8.2690000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57499999999999996,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":8.9930000000000003},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834576070,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":694472,"kb_used_data":384,"kb_used_omap":10,"kb_used_meta":694069,"kb_avail":93677368,"statfs":{"total":96636764160,"available":95925624832,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10854,"internal_metadata":710727066},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.67300000000000004,"5min":3.9449999999999998,"15min":7.6150000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68200000000000005,"5min":0.751,"15min":6.4199999999999999},"last":0.39000000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.51800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":6.7370000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.601,"5min":6.5609999999999999,"15min":7.649},"last":0.54000000000000004}]},{"osd":2,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.505,"15min":0.54100000000000004},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.751,"5min":1.141,"15min":8.7309999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.317},"max":{"1min":1.6639999999999999,"5min":6.1369999999999996,"15min":9.9740000000000002},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48899999999999999,"15min":0.66000000000000003},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.28199999999999997},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":39.670999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54400000000000004,"15min":0.76500000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":54.856999999999999},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24299999999999999},"max":{"1min":0.69499999999999995,"5min":4.0069999999999997,"15min":7.7060000000000004},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.51500000000000001,"15min":0.67300000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.84799999999999998,"15min":39.640000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71099999999999997,"5min":0.88300000000000001,"15min":4.694},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.59299999999999997,"15min":0.61499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":3.9780000000000002,"15min":7.6779999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.54300000000000004,"15min":0.70599999999999996},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.91700000000000004,"15min":39.417000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834576069,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":762440,"kb_used_data":384,"kb_used_omap":13,"kb_used_meta":762034,"kb_avail":93609400,"statfs":{"total":96636764160,"available":95856025600,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13388,"internal_metadata":780323764},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":4.8609999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":14.263999999999999},"last":0.26000000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34000000000000002,"15min":0.42599999999999999},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":15.218999999999999},"last":0.37},{"interface":"front","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":25.405999999999999},"last":0.313}]},{"osd":2,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.44800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.223},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":14.377000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.437},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":5.0700000000000003},"last":0.35999999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.61899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":14.335000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73499999999999999,"5min":0.86199999999999999,"15min":3.7160000000000002},"last":0.58099999999999996}]},{"osd":5,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.64200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":15.253},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.89900000000000002,"15min":3.5339999999999998},"last":0.45500000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":3.633},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71299999999999997,"5min":0.94899999999999995,"15min":3.298},"last":0.60099999999999998}]},{"osd":7,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":5.2460000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":14.307},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834576072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1389768,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1389376,"kb_avail":92982072,"statfs":{"total":96636764160,"available":95213641728,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1422721024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.45000000000000001,"5min":7.6399999999999997,"15min":7.6399999999999997},"last":0.255},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.441,"15min":0.39000000000000001},"min":{"1min":0.22900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61199999999999999,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.40899999999999997}]},{"osd":1,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.44},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54500000000000004,"5min":1.2989999999999999,"15min":7.4870000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":1.1140000000000001,"5min":4.1559999999999997,"15min":4.1559999999999997},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.437,"15min":0.41999999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23300000000000001},"max":{"1min":0.80800000000000005,"5min":5.1820000000000004,"15min":5.5970000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.50800000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.247},"max":{"1min":0.59099999999999997,"5min":13.347,"15min":13.347},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77500000000000002,"5min":0.86399999999999999,"15min":5.2859999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57899999999999996,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":3.7229999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":6.798},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.83899999999999997,"5min":1.284,"15min":5.5650000000000004},"last":0.39200000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.86699999999999999,"5min":1.3149999999999999,"15min":5.6200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.091,"5min":1.575,"15min":6.7489999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.375},"max":{"1min":0.89700000000000002,"5min":1.3400000000000001,"15min":5.6459999999999999},"last":0.45300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834576071,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":861448,"kb_used_data":86452,"kb_used_omap":466,"kb_used_meta":762221,"kb_avail":93510392,"statfs":{"total":96636764160,"available":95754641408,"internally_reserved":0,"allocated":88526848,"data_stored":88285543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":477985,"internal_metadata":780514527},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.40899999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20599999999999999},"max":{"1min":1.488,"5min":1.488,"15min":9.3049999999999997},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.55500000000000005,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.22600000000000001,"15min":0.19400000000000001},"max":{"1min":1.0980000000000001,"5min":13.952,"15min":13.952},"last":0.34799999999999998}]},{"osd":2,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.109,"5min":2.4710000000000001,"15min":6.1189999999999998},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.24199999999999999},"max":{"1min":1.532,"5min":8.7420000000000009,"15min":9.9429999999999996},"last":0.36299999999999999}]},{"osd":3,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71799999999999997,"15min":0.56499999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93300000000000005,"5min":19.202000000000002,"15min":19.202000000000002},"last":0.317},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.179,"5min":8.3520000000000003,"15min":8.3520000000000003},"last":0.374}]},{"osd":4,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.626,"15min":0.66800000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.5640000000000001,"5min":3.6030000000000002,"15min":12.558},"last":0.496},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68000000000000005},"min":{"1min":0.313,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.86099999999999999,"5min":3.073,"15min":5.7329999999999997},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2030000000000001,"5min":8.2720000000000002,"15min":8.6340000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28199999999999997},"max":{"1min":1.587,"5min":1.587,"15min":10.545999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.69099999999999995},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.879,"5min":3.0369999999999999,"15min":5.1829999999999998},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":8.391,"15min":11.904999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":3.0960000000000001,"15min":4.5789999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.63400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834576073,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1452932,"kb_used_data":85756,"kb_used_omap":0,"kb_used_meta":1367168,"kb_avail":92918908,"statfs":{"total":96636764160,"available":95148961792,"internally_reserved":0,"allocated":87814144,"data_stored":87580106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1399980032},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.43099999999999999},"min":{"1min":0.22,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":1.6319999999999999,"5min":2.0070000000000001,"15min":11.935},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.39000000000000001,"15min":0.44600000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":2.823,"5min":2.823,"15min":13.151999999999999},"last":0.24399999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38900000000000001,"15min":0.46300000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.5700000000000001,"5min":2.0369999999999999,"15min":7.641},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":3.7149999999999999},"last":0.33500000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":2.3660000000000001,"5min":8.2579999999999991,"15min":8.2579999999999991},"last":0.377},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.5369999999999999,"5min":2.0670000000000002,"15min":5.827},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.57699999999999996,"15min":0.68700000000000006},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.66200000000000003,"5min":3.3730000000000002,"15min":13.061},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35799999999999998},"max":{"1min":2.4550000000000001,"5min":7.1710000000000003,"15min":8.9459999999999997},"last":0.67200000000000004}]},{"osd":5,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.28899999999999998},"max":{"1min":1.6120000000000001,"5min":1.9359999999999999,"15min":4.2329999999999997},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.58599999999999997,"15min":0.67700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":1.321,"15min":16.009},"last":0.84299999999999997}]},{"osd":6,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66800000000000004,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.39400000000000002,"15min":0.33300000000000002},"max":{"1min":2.403,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.376},"max":{"1min":1.5900000000000001,"5min":1.978,"15min":3.5499999999999998},"last":0.73099999999999998}]},{"osd":7,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.68100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":1.2989999999999999,"15min":12.731},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36499999999999999},"max":{"1min":2.4289999999999998,"5min":6.0289999999999999,"15min":6.0289999999999999},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T06:05:01.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T06:05:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.130+0000 7f3b9cf69640 1 Processor -- start 2023-12-20T06:05:01.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.130+0000 7f3b9cf69640 1 -- start start 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b9cf69640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b980bcdd0 0x7f3b980b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b9cf69640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980b64c0 0x7f3b98144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b9cf69640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980bc6b0 con 0x7f3b98144cd0 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b9cf69640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980b6900 con 0x7f3b980bcdd0 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b9cf69640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980a59f0 con 0x7f3b980b64c0 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b9659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b980bcdd0 0x7f3b980b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b96d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b98144cd0 0x7f3b9814e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52494/0 (socket says 172.21.15.40:52494) 2023-12-20T06:05:01.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.131+0000 7f3b96d9d640 1 -- 172.21.15.40:0/3364873167 learned_addr learned my addr 172.21.15.40:0/3364873167 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.132+0000 7f3b95d9b640 1 --2- 172.21.15.40:0/3364873167 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980b64c0 0x7f3b98144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.132+0000 7f3b9659c640 1 -- 172.21.15.40:0/3364873167 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980b64c0 msgr2=0x7f3b98144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.132+0000 7f3b9659c640 1 --2- 172.21.15.40:0/3364873167 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980b64c0 0x7f3b98144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.132+0000 7f3b9659c640 1 -- 172.21.15.40:0/3364873167 >> v1:172.21.15.40:6789/0 conn(0x7f3b98144cd0 legacy=0x7f3b9814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.132+0000 7f3b9559a640 1 -- 172.21.15.40:0/3364873167 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677905088 0 0) 0x7f3b980bc6b0 con 0x7f3b98144cd0 2023-12-20T06:05:01.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.132+0000 7f3b9659c640 1 -- 172.21.15.40:0/3364873167 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980bc0a0 con 0x7f3b980bcdd0 2023-12-20T06:05:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9659c640 1 --2- 172.21.15.40:0/3364873167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980bcdd0 0x7f3b980b5f80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3b900097a0 tx=0x7f3b9002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899c035a1cd25eb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9559a640 1 -- 172.21.15.40:0/3364873167 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90030610 con 0x7f3b980bcdd0 2023-12-20T06:05:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9559a640 1 -- 172.21.15.40:0/3364873167 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90030770 con 0x7f3b980bcdd0 2023-12-20T06:05:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9559a640 1 -- 172.21.15.40:0/3364873167 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90030b00 con 0x7f3b980bcdd0 2023-12-20T06:05:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 -- 172.21.15.40:0/3364873167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980bcdd0 msgr2=0x7f3b980b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/3364873167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980bcdd0 0x7f3b980b5f80 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3b900097a0 tx=0x7f3b9002b960 comp rx=0 tx=0).stop 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 -- 172.21.15.40:0/3364873167 shutdown_connections 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/3364873167 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980b64c0 0x7f3b98144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/3364873167 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980bcdd0 0x7f3b980b5f80 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 -- 172.21.15.40:0/3364873167 >> 172.21.15.40:0/3364873167 conn(0x7f3b98071e60 msgr2=0x7f3b980c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 -- 172.21.15.40:0/3364873167 shutdown_connections 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.133+0000 7f3b9cf69640 1 -- 172.21.15.40:0/3364873167 wait complete. 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 Processor -- start 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 -- start start 2023-12-20T06:05:01.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980b64c0 0x7f3b9813fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980bcdd0 0x7f3b9813f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b98144cd0 0x7f3b98145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9813fa10 con 0x7f3b980b64c0 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981d37d0 con 0x7f3b98144cd0 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9cf69640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b981d49a0 con 0x7f3b980bcdd0 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980b64c0 0x7f3b9813fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980b64c0 0x7f3b9813fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55126/0 (socket says 172.21.15.40:55126) 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b9659c640 1 -- 172.21.15.40:0/445000685 learned_addr learned my addr 172.21.15.40:0/445000685 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b95d9b640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980bcdd0 0x7f3b9813f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:01.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.135+0000 7f3b96d9d640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b98144cd0 0x7f3b98145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9659c640 1 -- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980bcdd0 msgr2=0x7f3b9813f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9659c640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980bcdd0 0x7f3b9813f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9659c640 1 -- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b98144cd0 msgr2=0x7f3b98145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9659c640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b98144cd0 0x7f3b98145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9659c640 1 -- 172.21.15.40:0/445000685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009400 con 0x7f3b980b64c0 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b95d9b640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980bcdd0 0x7f3b9813f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b96d9d640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b98144cd0 0x7f3b98145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9659c640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980b64c0 0x7f3b9813fbe0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3b900097a0 tx=0x7f3b900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b8effd640 1 -- 172.21.15.40:0/445000685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90039c90 con 0x7f3b980b64c0 2023-12-20T06:05:01.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b8effd640 1 -- 172.21.15.40:0/445000685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9003f040 con 0x7f3b980b64c0 2023-12-20T06:05:01.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b8effd640 1 -- 172.21.15.40:0/445000685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90004270 con 0x7f3b980b64c0 2023-12-20T06:05:01.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b981d4c80 con 0x7f3b980b64c0 2023-12-20T06:05:01.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.136+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b980a5720 con 0x7f3b980b64c0 2023-12-20T06:05:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.137+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9804e840 con 0x7f3b980b64c0 2023-12-20T06:05:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.137+0000 7f3b8effd640 1 -- 172.21.15.40:0/445000685 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b900043d0 con 0x7f3b980b64c0 2023-12-20T06:05:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.138+0000 7f3b8effd640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3b7806a430 0x7f3b7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.138+0000 7f3b8effd640 1 -- 172.21.15.40:0/445000685 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3b900aa6a0 con 0x7f3b980b64c0 2023-12-20T06:05:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.138+0000 7f3b95d9b640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3b7806a430 0x7f3b7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:01.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.139+0000 7f3b95d9b640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3b7806a430 0x7f3b7806c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b980b95c0 tx=0x7f3b80008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:01.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.142+0000 7f3b8effd640 1 -- 172.21.15.40:0/445000685 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3b90075f90 con 0x7f3b980b64c0 2023-12-20T06:05:01.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.320+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b981d4e10 con 0x7f3b980b64c0 2023-12-20T06:05:01.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.321+0000 7f3b8effd640 1 -- 172.21.15.40:0/445000685 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+12470 (secure 0 0 0) 0x7f3b90006e10 con 0x7f3b980b64c0 2023-12-20T06:05:01.322 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:05:01.322 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":34,"fsid":"9ed6574e-2792-4eae-92b0-945f286f0eed","created":"2023-12-20T04:23:02.468107+0000","modified":"2023-12-20T06:04:58.389289+0000","last_up_change":"2023-12-20T04:23:13.557441+0000","last_in_change":"2023-12-20T04:23:04.691056+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:23:14.584861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"33c863db-afa5-44bd-b009-cc8fae07ef10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":89422},{"type":"v1","addr":"172.21.15.40:6801","nonce":89422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":89422},{"type":"v1","addr":"172.21.15.40:6803","nonce":89422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":89422},{"type":"v1","addr":"172.21.15.40:6807","nonce":89422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":89422},{"type":"v1","addr":"172.21.15.40:6805","nonce":89422}]},"public_addr":"172.21.15.40:6801/89422","cluster_addr":"172.21.15.40:6803/89422","heartbeat_back_addr":"172.21.15.40:6807/89422","heartbeat_front_addr":"172.21.15.40:6805/89422","state":["exists","up"]},{"osd":1,"uuid":"6515c24a-73aa-409f-95b7-84322a930eec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":89425},{"type":"v1","addr":"172.21.15.40:6810","nonce":89425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":89425},{"type":"v1","addr":"172.21.15.40:6814","nonce":89425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":89425},{"type":"v1","addr":"172.21.15.40:6822","nonce":89425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":89425},{"type":"v1","addr":"172.21.15.40:6818","nonce":89425}]},"public_addr":"172.21.15.40:6810/89425","cluster_addr":"172.21.15.40:6814/89425","heartbeat_back_addr":"172.21.15.40:6822/89425","heartbeat_front_addr":"172.21.15.40:6818/89425","state":["exists","up"]},{"osd":2,"uuid":"b0a23918-8a6c-442f-912e-db9f61f3f28d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6809","nonce":89424},{"type":"v1","addr":"172.21.15.40:6811","nonce":89424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6813","nonce":89424},{"type":"v1","addr":"172.21.15.40:6815","nonce":89424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":89424},{"type":"v1","addr":"172.21.15.40:6823","nonce":89424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":89424},{"type":"v1","addr":"172.21.15.40:6819","nonce":89424}]},"public_addr":"172.21.15.40:6811/89424","cluster_addr":"172.21.15.40:6815/89424","heartbeat_back_addr":"172.21.15.40:6823/89424","heartbeat_front_addr":"172.21.15.40:6819/89424","state":["exists","up"]},{"osd":3,"uuid":"3e9a1150-4fdb-4440-bf5f-a5145ccd3b73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":89423},{"type":"v1","addr":"172.21.15.40:6825","nonce":89423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":89423},{"type":"v1","addr":"172.21.15.40:6827","nonce":89423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":89423},{"type":"v1","addr":"172.21.15.40:6831","nonce":89423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":89423},{"type":"v1","addr":"172.21.15.40:6829","nonce":89423}]},"public_addr":"172.21.15.40:6825/89423","cluster_addr":"172.21.15.40:6827/89423","heartbeat_back_addr":"172.21.15.40:6831/89423","heartbeat_front_addr":"172.21.15.40:6829/89423","state":["exists","up"]},{"osd":4,"uuid":"e542e453-dc96-473e-a782-f67519ccf8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":89421},{"type":"v1","addr":"172.21.15.69:6825","nonce":89421}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":89421},{"type":"v1","addr":"172.21.15.69:6827","nonce":89421}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":89421},{"type":"v1","addr":"172.21.15.69:6831","nonce":89421}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":89421},{"type":"v1","addr":"172.21.15.69:6829","nonce":89421}]},"public_addr":"172.21.15.69:6825/89421","cluster_addr":"172.21.15.69:6827/89421","heartbeat_back_addr":"172.21.15.69:6831/89421","heartbeat_front_addr":"172.21.15.69:6829/89421","state":["exists","up"]},{"osd":5,"uuid":"bd5a6512-aade-40d4-8b73-0b515a54415e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":89419},{"type":"v1","addr":"172.21.15.69:6809","nonce":89419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":89419},{"type":"v1","addr":"172.21.15.69:6811","nonce":89419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":89419},{"type":"v1","addr":"172.21.15.69:6815","nonce":89419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":89419},{"type":"v1","addr":"172.21.15.69:6813","nonce":89419}]},"public_addr":"172.21.15.69:6809/89419","cluster_addr":"172.21.15.69:6811/89419","heartbeat_back_addr":"172.21.15.69:6815/89419","heartbeat_front_addr":"172.21.15.69:6813/89419","state":["exists","up"]},{"osd":6,"uuid":"e55e5986-4fe7-4794-adc4-f73d074957d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":89420},{"type":"v1","addr":"172.21.15.69:6801","nonce":89420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":89420},{"type":"v1","addr":"172.21.15.69:6803","nonce":89420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":89420},{"type":"v1","addr":"172.21.15.69:6807","nonce":89420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":89420},{"type":"v1","addr":"172.21.15.69:6805","nonce":89420}]},"public_addr":"172.21.15.69:6801/89420","cluster_addr":"172.21.15.69:6803/89420","heartbeat_back_addr":"172.21.15.69:6807/89420","heartbeat_front_addr":"172.21.15.69:6805/89420","state":["exists","up"]},{"osd":7,"uuid":"9f984eec-3a3e-4edf-b896-8fe6ca58ebdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":89432},{"type":"v1","addr":"172.21.15.69:6817","nonce":89432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":89432},{"type":"v1","addr":"172.21.15.69:6819","nonce":89432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":89432},{"type":"v1","addr":"172.21.15.69:6823","nonce":89432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":89432},{"type":"v1","addr":"172.21.15.69:6821","nonce":89432}]},"public_addr":"172.21.15.69:6817/89432","cluster_addr":"172.21.15.69:6819/89432","heartbeat_back_addr":"172.21.15.69:6823/89432","heartbeat_front_addr":"172.21.15.69:6821/89432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.821854+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.906604+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.877858+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.862358+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.857461+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.788480+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.885616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:23:09.904656+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6834/3041271085":"2023-12-21T06:04:55.360539+0000","172.21.15.40:6832/3041271085":"2023-12-21T06:04:55.360539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T06:05:01.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.323+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3b7806a430 msgr2=0x7f3b7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.323+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3b7806a430 0x7f3b7806c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3b980b95c0 tx=0x7f3b80008040 comp rx=0 tx=0).stop 2023-12-20T06:05:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.323+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980b64c0 msgr2=0x7f3b9813fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.323+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980b64c0 0x7f3b9813fbe0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3b900097a0 tx=0x7f3b900046c0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 shutdown_connections 2023-12-20T06:05:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3b7806a430 0x7f3b7806c8f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b98144cd0 0x7f3b98145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3b980bcdd0 0x7f3b9813f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 --2- 172.21.15.40:0/445000685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b980b64c0 0x7f3b9813fbe0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 >> 172.21.15.40:0/445000685 conn(0x7f3b98071e60 msgr2=0x7f3b981d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 shutdown_connections 2023-12-20T06:05:01.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:01.324+0000 7f3b9cf69640 1 -- 172.21.15.40:0/445000685 wait complete. 2023-12-20T06:05:02.337 INFO:tasks.ceph:Scrubbing osd.0 2023-12-20T06:05:02.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:02.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.461+0000 7f6e76296640 1 Processor -- start 2023-12-20T06:05:02.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.461+0000 7f6e76296640 1 -- start start 2023-12-20T06:05:02.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e76296640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e700b79a0 0x7f6e700bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e76296640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e700b8ba0 con 0x7f6e700b64a0 2023-12-20T06:05:02.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e76296640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e700b8e80 con 0x7f6e7014b460 2023-12-20T06:05:02.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e76296640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7006cd70 con 0x7f6e700b79a0 2023-12-20T06:05:02.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e6ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e700b79a0 0x7f6e700bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e6f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e700b64a0 0x7f6e7014ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52502/0 (socket says 172.21.15.40:52502) 2023-12-20T06:05:02.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e6ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e700b79a0 0x7f6e700bc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55132/0 (socket says 172.21.15.40:55132) 2023-12-20T06:05:02.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e6f7fe640 1 -- 172.21.15.40:0/3496039435 learned_addr learned my addr 172.21.15.40:0/3496039435 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:02.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e6ffff640 1 -- 172.21.15.40:0/3496039435 >> v1:172.21.15.69:6789/0 conn(0x7f6e7014b460 legacy=0x7f6e70155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:02.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e6ffff640 1 -- 172.21.15.40:0/3496039435 >> v1:172.21.15.40:6789/0 conn(0x7f6e700b64a0 legacy=0x7f6e7014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.462+0000 7f6e6ffff640 1 -- 172.21.15.40:0/3496039435 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e700b9160 con 0x7f6e700b79a0 2023-12-20T06:05:02.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.463+0000 7f6e6ffff640 1 --2- 172.21.15.40:0/3496039435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e700b79a0 0x7f6e700bc660 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6e600097a0 tx=0x7f6e6002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31cb2c375c87bed server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.463+0000 7f6e6effd640 1 -- 172.21.15.40:0/3496039435 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60030610 con 0x7f6e700b79a0 2023-12-20T06:05:02.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.463+0000 7f6e6effd640 1 -- 172.21.15.40:0/3496039435 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e60030770 con 0x7f6e700b79a0 2023-12-20T06:05:02.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.463+0000 7f6e6effd640 1 -- 172.21.15.40:0/3496039435 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e60030b00 con 0x7f6e700b79a0 2023-12-20T06:05:02.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.464+0000 7f6e76296640 1 -- 172.21.15.40:0/3496039435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e700b79a0 msgr2=0x7f6e700bc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.464+0000 7f6e76296640 1 --2- 172.21.15.40:0/3496039435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e700b79a0 0x7f6e700bc660 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6e600097a0 tx=0x7f6e6002b960 comp rx=0 tx=0).stop 2023-12-20T06:05:02.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.464+0000 7f6e76296640 1 -- 172.21.15.40:0/3496039435 shutdown_connections 2023-12-20T06:05:02.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.464+0000 7f6e76296640 1 --2- 172.21.15.40:0/3496039435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e700b79a0 0x7f6e700bc660 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.464+0000 7f6e76296640 1 -- 172.21.15.40:0/3496039435 >> 172.21.15.40:0/3496039435 conn(0x7f6e700c0330 msgr2=0x7f6e700c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:02.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.464+0000 7f6e76296640 1 -- 172.21.15.40:0/3496039435 shutdown_connections 2023-12-20T06:05:02.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.464+0000 7f6e76296640 1 -- 172.21.15.40:0/3496039435 wait complete. 2023-12-20T06:05:02.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.465+0000 7f6e76296640 1 Processor -- start 2023-12-20T06:05:02.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.465+0000 7f6e76296640 1 -- start start 2023-12-20T06:05:02.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e76296640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e700b64a0 0x7f6e70146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e76296640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e700b79a0 0x7f6e70147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e76296640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e7014b460 0x7f6e701e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e76296640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70147e90 con 0x7f6e7014b460 2023-12-20T06:05:02.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e76296640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7014e150 con 0x7f6e700b64a0 2023-12-20T06:05:02.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e76296640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70148fe0 con 0x7f6e700b79a0 2023-12-20T06:05:02.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e7014b460 0x7f6e701e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e7014b460 0x7f6e701e33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55144/0 (socket says 172.21.15.40:55144) 2023-12-20T06:05:02.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 -- 172.21.15.40:0/3484191420 learned_addr learned my addr 172.21.15.40:0/3484191420 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:02.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e6ffff640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e700b64a0 0x7f6e70146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e6f7fe640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e700b79a0 0x7f6e70147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 -- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e700b79a0 msgr2=0x7f6e70147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6e700b79a0 0x7f6e70147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 -- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e700b64a0 msgr2=0x7f6e70146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e700b64a0 0x7f6e70146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 -- 172.21.15.40:0/3484191420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009400 con 0x7f6e7014b460 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e74833640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e7014b460 0x7f6e701e33a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800b970 tx=0x7f6e6800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6800cb40 con 0x7f6e7014b460 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.466+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6800cca0 con 0x7f6e7014b460 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.467+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7014db00 con 0x7f6e7014b460 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.467+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68014680 con 0x7f6e7014b460 2023-12-20T06:05:02.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.467+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e70148a90 con 0x7f6e7014b460 2023-12-20T06:05:02.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.467+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e70144fc0 con 0x7f6e7014b460 2023-12-20T06:05:02.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.468+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e6801d3b0 con 0x7f6e7014b460 2023-12-20T06:05:02.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.468+0000 7f6e6cff9640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e5006a430 0x7f6e5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6e68088420 con 0x7f6e7014b460 2023-12-20T06:05:02.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6cff9640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7f6e50070290 0x7f6e500726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6ffff640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e5006a430 0x7f6e5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 --> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e50072d60 con 0x7f6e50070290 2023-12-20T06:05:02.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e6808aae0 con 0x7f6e7014b460 2023-12-20T06:05:02.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6f7fe640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7f6e50070290 0x7f6e500726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6ffff640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e5006a430 0x7f6e5006c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6e60036000 tx=0x7f6e60008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.469+0000 7f6e6f7fe640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7f6e50070290 0x7f6e500726b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.470+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== osd.0 v2:172.21.15.40:6800/89422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6e50072d60 con 0x7f6e50070290 2023-12-20T06:05:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.482+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 --> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6e700b7d80 con 0x7f6e50070290 2023-12-20T06:05:02.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e6cff9640 1 -- 172.21.15.40:0/3484191420 <== osd.0 v2:172.21.15.40:6800/89422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6e58001580 con 0x7f6e50070290 2023-12-20T06:05:02.484 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:02.485 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:02.485 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7f6e50070290 msgr2=0x7f6e500726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:6800/89422,v1:172.21.15.40:6801/89422] conn(0x7f6e50070290 0x7f6e500726b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e5006a430 msgr2=0x7f6e5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6e5006a430 0x7f6e5006c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6e60036000 tx=0x7f6e60008030 comp rx=0 tx=0).stop 2023-12-20T06:05:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e7014b460 msgr2=0x7f6e701e33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 --2- 172.21.15.40:0/3484191420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e7014b460 0x7f6e701e33a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f6e6800b970 tx=0x7f6e6800be30 comp rx=0 tx=0).stop 2023-12-20T06:05:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e74833640 1 -- 172.21.15.40:0/3484191420 reap_dead start 2023-12-20T06:05:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 shutdown_connections 2023-12-20T06:05:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 >> 172.21.15.40:0/3484191420 conn(0x7f6e700c0330 msgr2=0x7f6e701494c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 shutdown_connections 2023-12-20T06:05:02.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.483+0000 7f6e76296640 1 -- 172.21.15.40:0/3484191420 wait complete. 2023-12-20T06:05:02.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-20T06:05:02.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.602+0000 7fb280c84640 1 Processor -- start 2023-12-20T06:05:02.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.602+0000 7fb280c84640 1 -- start start 2023-12-20T06:05:02.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.602+0000 7fb280c84640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb27c0b6690 0x7fb27c144790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.602+0000 7fb280c84640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb27c144cd0 0x7fb27c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.602+0000 7fb280c84640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0bc6b0 con 0x7fb27c0bcdd0 2023-12-20T06:05:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.602+0000 7fb280c84640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0a59f0 con 0x7fb27c0b6690 2023-12-20T06:05:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.602+0000 7fb280c84640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0bc0a0 con 0x7fb27c144cd0 2023-12-20T06:05:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb273fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb27c0b6690 0x7fb27c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb273fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb27c0b6690 0x7fb27c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55146/0 (socket says 172.21.15.40:55146) 2023-12-20T06:05:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb273fff640 1 -- 172.21.15.40:0/3552619522 learned_addr learned my addr 172.21.15.40:0/3552619522 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:02.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb27ad9d640 1 --2- 172.21.15.40:0/3552619522 >> v2:172.21.15.69:3300/0 conn(0x7fb27c144cd0 0x7fb27c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb273fff640 1 -- 172.21.15.40:0/3552619522 >> v2:172.21.15.69:3300/0 conn(0x7fb27c144cd0 msgr2=0x7fb27c155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb273fff640 1 --2- 172.21.15.40:0/3552619522 >> v2:172.21.15.69:3300/0 conn(0x7fb27c144cd0 0x7fb27c155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb273fff640 1 -- 172.21.15.40:0/3552619522 >> v1:172.21.15.69:6789/0 conn(0x7fb27c0bcdd0 legacy=0x7fb27c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.603+0000 7fb273fff640 1 -- 172.21.15.40:0/3552619522 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0bc340 con 0x7fb27c0b6690 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb273fff640 1 --2- 172.21.15.40:0/3552619522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c0b6690 0x7fb27c144790 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb27c06a090 tx=0x7fb26402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323652184fb6fb63 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb279d9b640 1 -- 172.21.15.40:0/3552619522 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26402f850 con 0x7fb27c0b6690 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb279d9b640 1 -- 172.21.15.40:0/3552619522 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26402f9b0 con 0x7fb27c0b6690 2023-12-20T06:05:02.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb279d9b640 1 -- 172.21.15.40:0/3552619522 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26402fd40 con 0x7fb27c0b6690 2023-12-20T06:05:02.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 -- 172.21.15.40:0/3552619522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c0b6690 msgr2=0x7fb27c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 --2- 172.21.15.40:0/3552619522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c0b6690 0x7fb27c144790 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb27c06a090 tx=0x7fb26402ba30 comp rx=0 tx=0).stop 2023-12-20T06:05:02.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 -- 172.21.15.40:0/3552619522 shutdown_connections 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 --2- 172.21.15.40:0/3552619522 >> v2:172.21.15.69:3300/0 conn(0x7fb27c144cd0 0x7fb27c155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 --2- 172.21.15.40:0/3552619522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c0b6690 0x7fb27c144790 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 -- 172.21.15.40:0/3552619522 >> 172.21.15.40:0/3552619522 conn(0x7fb27c071e60 msgr2=0x7fb27c0c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 -- 172.21.15.40:0/3552619522 shutdown_connections 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.604+0000 7fb280c84640 1 -- 172.21.15.40:0/3552619522 wait complete. 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 Processor -- start 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 -- start start 2023-12-20T06:05:02.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb27c0b6690 0x7fb27c13f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb27c0bcdd0 0x7fb27c1d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c144cd0 0x7fb27c1d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c1d4d00 con 0x7fb27c144cd0 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c13e930 con 0x7fb27c0bcdd0 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb280c84640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c13ec10 con 0x7fb27c0b6690 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb27ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c144cd0 0x7fb27c1d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb27ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c144cd0 0x7fb27c1d3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55162/0 (socket says 172.21.15.40:55162) 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.606+0000 7fb27ad9d640 1 -- 172.21.15.40:0/1252220209 learned_addr learned my addr 172.21.15.40:0/1252220209 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:02.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb273fff640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb27c0bcdd0 0x7fb27c1d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb27a59c640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb27c0b6690 0x7fb27c13f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb27ad9d640 1 -- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb27c0b6690 msgr2=0x7fb27c13f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb27ad9d640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb27c0b6690 0x7fb27c13f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb27ad9d640 1 -- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb27c0bcdd0 msgr2=0x7fb27c1d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb27ad9d640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb27c0bcdd0 0x7fb27c1d3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb27ad9d640 1 -- 172.21.15.40:0/1252220209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640094d0 con 0x7fb27c144cd0 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb273fff640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb27c0bcdd0 0x7fb27c1d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb27ad9d640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c144cd0 0x7fb27c1d3fc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb27400efc0 tx=0x7fb27400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb272ffd640 1 -- 172.21.15.40:0/1252220209 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274009ba0 con 0x7fb27c144cd0 2023-12-20T06:05:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb272ffd640 1 -- 172.21.15.40:0/1252220209 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27400f040 con 0x7fb27c144cd0 2023-12-20T06:05:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c13eef0 con 0x7fb27c144cd0 2023-12-20T06:05:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb272ffd640 1 -- 172.21.15.40:0/1252220209 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740146c0 con 0x7fb27c144cd0 2023-12-20T06:05:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.607+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c0a5510 con 0x7fb27c144cd0 2023-12-20T06:05:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.608+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c1d37a0 con 0x7fb27c144cd0 2023-12-20T06:05:02.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.609+0000 7fb272ffd640 1 -- 172.21.15.40:0/1252220209 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb274014820 con 0x7fb27c144cd0 2023-12-20T06:05:02.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.609+0000 7fb272ffd640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb25c06a430 0x7fb25c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.609+0000 7fb272ffd640 1 -- 172.21.15.40:0/1252220209 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb274089210 con 0x7fb27c144cd0 2023-12-20T06:05:02.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.609+0000 7fb27a59c640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb25c06a430 0x7fb25c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.610+0000 7fb27a59c640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb25c06a430 0x7fb25c06c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb26c000f60 tx=0x7fb26c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.613+0000 7fb272ffd640 1 -- 172.21.15.40:0/1252220209 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb27c1d37a0 con 0x7fb27c144cd0 2023-12-20T06:05:02.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.788+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb27c13eaa0 con 0x7fb25c06a430 2023-12-20T06:05:02.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.788+0000 7fb272ffd640 1 -- 172.21.15.40:0/1252220209 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb27c13eaa0 con 0x7fb25c06a430 2023-12-20T06:05:02.789 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 0 to deep-scrub 2023-12-20T06:05:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb25c06a430 msgr2=0x7fb25c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb25c06a430 0x7fb25c06c8f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb26c000f60 tx=0x7fb26c009040 comp rx=0 tx=0).stop 2023-12-20T06:05:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c144cd0 msgr2=0x7fb27c1d3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c144cd0 0x7fb27c1d3fc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb27400efc0 tx=0x7fb27400c490 comp rx=0 tx=0).stop 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 shutdown_connections 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fb25c06a430 0x7fb25c06c8f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb27c144cd0 0x7fb27c1d3fc0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb27c0bcdd0 0x7fb27c1d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 --2- 172.21.15.40:0/1252220209 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fb27c0b6690 0x7fb27c13f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 >> 172.21.15.40:0/1252220209 conn(0x7fb27c071e60 msgr2=0x7fb27c0b9310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 shutdown_connections 2023-12-20T06:05:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.790+0000 7fb280c84640 1 -- 172.21.15.40:0/1252220209 wait complete. 2023-12-20T06:05:02.802 INFO:tasks.ceph:Scrubbing osd.1 2023-12-20T06:05:02.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.911+0000 7f995ceaf640 1 Processor -- start 2023-12-20T06:05:02.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.911+0000 7f995ceaf640 1 -- start start 2023-12-20T06:05:02.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f995ceaf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f995814b460 0x7f9958156390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f995ceaf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99580b8ba0 con 0x7f99580bc660 2023-12-20T06:05:02.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f995ceaf640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99580b8e80 con 0x7f99580b79a0 2023-12-20T06:05:02.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f995ceaf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99580bcab0 con 0x7f995814b460 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f9955d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f99580bc660 0x7f995814ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52506/0 (socket says 172.21.15.40:52506) 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f9955d9b640 1 -- 172.21.15.40:0/3314750062 learned_addr learned my addr 172.21.15.40:0/3314750062 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f9956d9d640 1 --2- 172.21.15.40:0/3314750062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f995814b460 0x7f9958156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f995559a640 1 -- 172.21.15.40:0/3314750062 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177088121 0 0) 0x7f99580b8ba0 con 0x7f99580bc660 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f995559a640 1 -- 172.21.15.40:0/3314750062 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9944003520 con 0x7f99580bc660 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f995559a640 1 -- 172.21.15.40:0/3314750062 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962912619 0 0) 0x7f99580b8e80 con 0x7f99580b79a0 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f9956d9d640 1 -- 172.21.15.40:0/3314750062 >> v1:172.21.15.69:6789/0 conn(0x7f99580b79a0 legacy=0x7f99580b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f9956d9d640 1 -- 172.21.15.40:0/3314750062 >> v1:172.21.15.40:6789/0 conn(0x7f99580bc660 legacy=0x7f995814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.912+0000 7f9956d9d640 1 -- 172.21.15.40:0/3314750062 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99580b9160 con 0x7f995814b460 2023-12-20T06:05:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.913+0000 7f9956d9d640 1 --2- 172.21.15.40:0/3314750062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f995814b460 0x7f9958156390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99500097d0 tx=0x7f995002b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10ee5f7fdfc66e05 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.913+0000 7f995559a640 1 -- 172.21.15.40:0/3314750062 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400015f0 con 0x7f995814b460 2023-12-20T06:05:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.913+0000 7f995559a640 1 -- 172.21.15.40:0/3314750062 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995002e050 con 0x7f995814b460 2023-12-20T06:05:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.913+0000 7f995559a640 1 -- 172.21.15.40:0/3314750062 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950030730 con 0x7f995814b460 2023-12-20T06:05:02.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.914+0000 7f995ceaf640 1 -- 172.21.15.40:0/3314750062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f995814b460 msgr2=0x7f9958156390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.914+0000 7f995ceaf640 1 --2- 172.21.15.40:0/3314750062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f995814b460 0x7f9958156390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f99500097d0 tx=0x7f995002b7b0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.914+0000 7f995ceaf640 1 -- 172.21.15.40:0/3314750062 shutdown_connections 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.914+0000 7f995ceaf640 1 --2- 172.21.15.40:0/3314750062 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f995814b460 0x7f9958156390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.914+0000 7f995ceaf640 1 -- 172.21.15.40:0/3314750062 >> 172.21.15.40:0/3314750062 conn(0x7f99580c0330 msgr2=0x7f99580c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.914+0000 7f995ceaf640 1 -- 172.21.15.40:0/3314750062 shutdown_connections 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.914+0000 7f995ceaf640 1 -- 172.21.15.40:0/3314750062 wait complete. 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.915+0000 7f995ceaf640 1 Processor -- start 2023-12-20T06:05:02.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.915+0000 7f995ceaf640 1 -- start start 2023-12-20T06:05:02.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f995ceaf640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99580b79a0 0x7f99580bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f995ceaf640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99580bc660 0x7f99581473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f995ceaf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f995814b460 0x7f99580b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f995ceaf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99580bfe20 con 0x7f995814b460 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f995ceaf640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99581468a0 con 0x7f99580bc660 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f995ceaf640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9958147da0 con 0x7f99580b79a0 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f995814b460 0x7f99580b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f995814b460 0x7f99580b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55166/0 (socket says 172.21.15.40:55166) 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 -- 172.21.15.40:0/2752768717 learned_addr learned my addr 172.21.15.40:0/2752768717 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f995659c640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99580b79a0 0x7f99580bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9955d9b640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99580bc660 0x7f99581473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 -- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99580b79a0 msgr2=0x7f99580bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f99580b79a0 0x7f99580bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 -- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99580bc660 msgr2=0x7f99581473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99580bc660 0x7f99581473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 -- 172.21.15.40:0/2752768717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950009400 con 0x7f995814b460 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.916+0000 7f9956d9d640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f995814b460 0x7f99580b2c60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9950035040 tx=0x7f99500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.917+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950004230 con 0x7f995814b460 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.917+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9958147ff0 con 0x7f995814b460 2023-12-20T06:05:02.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.917+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950004390 con 0x7f995814b460 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.917+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995003d8d0 con 0x7f995814b460 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.917+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99580bb4e0 con 0x7f995814b460 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.918+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9958144fc0 con 0x7f995814b460 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.918+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9950039040 con 0x7f995814b460 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.918+0000 7f994effd640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f993806a430 0x7f993806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f99500aa610 con 0x7f995814b460 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f995659c640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f993806a430 0x7f993806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f994effd640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7f9938070290 0x7f99380726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 --> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9938072d60 con 0x7f9938070290 2023-12-20T06:05:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99500accd0 con 0x7f995814b460 2023-12-20T06:05:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f9955d9b640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7f9938070290 0x7f99380726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f995659c640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f993806a430 0x7f993806c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9948007ea0 tx=0x7f9948009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.919+0000 7f9955d9b640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7f9938070290 0x7f99380726b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.920+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== osd.1 v2:172.21.15.40:6808/89425 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9938072d60 con 0x7f9938070290 2023-12-20T06:05:02.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.932+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 --> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f99580b7d80 con 0x7f9938070290 2023-12-20T06:05:02.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f994effd640 1 -- 172.21.15.40:0/2752768717 <== osd.1 v2:172.21.15.40:6808/89425 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9940005cb0 con 0x7f9938070290 2023-12-20T06:05:02.934 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:02.934 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:02.934 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7f9938070290 msgr2=0x7f99380726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:6808/89425,v1:172.21.15.40:6810/89425] conn(0x7f9938070290 0x7f99380726b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f993806a430 msgr2=0x7f993806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f993806a430 0x7f993806c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9948007ea0 tx=0x7f9948009040 comp rx=0 tx=0).stop 2023-12-20T06:05:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f995814b460 msgr2=0x7f99580b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 --2- 172.21.15.40:0/2752768717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f995814b460 0x7f99580b2c60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9950035040 tx=0x7f99500046c0 comp rx=0 tx=0).stop 2023-12-20T06:05:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f9956d9d640 1 -- 172.21.15.40:0/2752768717 reap_dead start 2023-12-20T06:05:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 shutdown_connections 2023-12-20T06:05:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 >> 172.21.15.40:0/2752768717 conn(0x7f99580c0330 msgr2=0x7f9958148bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 shutdown_connections 2023-12-20T06:05:02.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:02.933+0000 7f995ceaf640 1 -- 172.21.15.40:0/2752768717 wait complete. 2023-12-20T06:05:02.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-20T06:05:03.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.050+0000 7fbc1cdfb640 1 Processor -- start 2023-12-20T06:05:03.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.050+0000 7fbc1cdfb640 1 -- start start 2023-12-20T06:05:03.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc1cdfb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc18144ea0 0x7fbc18156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc1cdfb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180bc6b0 con 0x7fbc180bcdd0 2023-12-20T06:05:03.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc1cdfb640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180a59f0 con 0x7fbc180b6690 2023-12-20T06:05:03.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc1cdfb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc180bc0a0 con 0x7fbc18144ea0 2023-12-20T06:05:03.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc1659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc180bcdd0 0x7fbc180b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52512/0 (socket says 172.21.15.40:52512) 2023-12-20T06:05:03.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc1659c640 1 -- 172.21.15.40:0/1762806102 learned_addr learned my addr 172.21.15.40:0/1762806102 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:03.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc16d9d640 1 --2- 172.21.15.40:0/1762806102 >> v2:172.21.15.40:3300/0 conn(0x7fbc18144ea0 0x7fbc18156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc16d9d640 1 -- 172.21.15.40:0/1762806102 >> v1:172.21.15.69:6789/0 conn(0x7fbc180b6690 legacy=0x7fbc18144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc16d9d640 1 -- 172.21.15.40:0/1762806102 >> v1:172.21.15.40:6789/0 conn(0x7fbc180bcdd0 legacy=0x7fbc180b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc16d9d640 1 -- 172.21.15.40:0/1762806102 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180bc340 con 0x7fbc18144ea0 2023-12-20T06:05:03.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.051+0000 7fbc15d9b640 1 -- 172.21.15.40:0/1762806102 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915342992 0 0) 0x7fbc180bc6b0 con 0x7fbc180bcdd0 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.052+0000 7fbc16d9d640 1 --2- 172.21.15.40:0/1762806102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc18144ea0 0x7fbc18156350 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbc180a5b80 tx=0x7fbc1002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d878dbd86df62d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.052+0000 7fbc15d9b640 1 -- 172.21.15.40:0/1762806102 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1002cd80 con 0x7fbc18144ea0 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.052+0000 7fbc15d9b640 1 -- 172.21.15.40:0/1762806102 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10034440 con 0x7fbc18144ea0 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.052+0000 7fbc15d9b640 1 -- 172.21.15.40:0/1762806102 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc100347d0 con 0x7fbc18144ea0 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.053+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/1762806102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc18144ea0 msgr2=0x7fbc18156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.053+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/1762806102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc18144ea0 0x7fbc18156350 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbc180a5b80 tx=0x7fbc1002bfd0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.053+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/1762806102 shutdown_connections 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.053+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/1762806102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc18144ea0 0x7fbc18156350 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.053+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/1762806102 >> 172.21.15.40:0/1762806102 conn(0x7fbc18071e60 msgr2=0x7fbc180c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.053+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/1762806102 shutdown_connections 2023-12-20T06:05:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.053+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/1762806102 wait complete. 2023-12-20T06:05:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 Processor -- start 2023-12-20T06:05:03.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 -- start start 2023-12-20T06:05:03.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc180b6690 0x7fbc181d3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180bcdd0 0x7fbc181dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc18144ea0 0x7fbc181dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc181d3ca0 con 0x7fbc180bcdd0 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18148e20 con 0x7fbc180b6690 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.054+0000 7fbc1cdfb640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18148860 con 0x7fbc18144ea0 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180bcdd0 0x7fbc181dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180bcdd0 0x7fbc181dfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55178/0 (socket says 172.21.15.40:55178) 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 -- 172.21.15.40:0/767558049 learned_addr learned my addr 172.21.15.40:0/767558049 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc1659c640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc180b6690 0x7fbc181d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc16d9d640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc18144ea0 0x7fbc181dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 -- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc18144ea0 msgr2=0x7fbc181dffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc18144ea0 0x7fbc181dffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 -- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc180b6690 msgr2=0x7fbc181d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc180b6690 0x7fbc181d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 -- 172.21.15.40:0/767558049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10009a70 con 0x7fbc180bcdd0 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0ffff640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180bcdd0 0x7fbc181dfa70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c450 tx=0x7fbc0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0effd640 1 -- 172.21.15.40:0/767558049 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc000052d0 con 0x7fbc180bcdd0 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0effd640 1 -- 172.21.15.40:0/767558049 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc00005430 con 0x7fbc180bcdd0 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1814a1d0 con 0x7fbc180bcdd0 2023-12-20T06:05:03.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc0effd640 1 -- 172.21.15.40:0/767558049 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00012870 con 0x7fbc180bcdd0 2023-12-20T06:05:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.055+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc18148ab0 con 0x7fbc180bcdd0 2023-12-20T06:05:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.056+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1804e840 con 0x7fbc180bcdd0 2023-12-20T06:05:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.057+0000 7fbc0effd640 1 -- 172.21.15.40:0/767558049 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc000129d0 con 0x7fbc180bcdd0 2023-12-20T06:05:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.057+0000 7fbc0effd640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbbf806a460 0x7fbbf806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.057+0000 7fbc0effd640 1 -- 172.21.15.40:0/767558049 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc00087f00 con 0x7fbc180bcdd0 2023-12-20T06:05:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.057+0000 7fbc1659c640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbbf806a460 0x7fbbf806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.058+0000 7fbc1659c640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbbf806a460 0x7fbbf806c920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc080011e0 tx=0x7fbc08001130 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.061+0000 7fbc0effd640 1 -- 172.21.15.40:0/767558049 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbc00053930 con 0x7fbc180bcdd0 2023-12-20T06:05:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.236+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc180bd1b0 con 0x7fbbf806a460 2023-12-20T06:05:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.236+0000 7fbc0effd640 1 -- 172.21.15.40:0/767558049 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbc08005850 con 0x7fbbf806a460 2023-12-20T06:05:03.237 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 1 to deep-scrub 2023-12-20T06:05:03.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbbf806a460 msgr2=0x7fbbf806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbbf806a460 0x7fbbf806c920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbc080011e0 tx=0x7fbc08001130 comp rx=0 tx=0).stop 2023-12-20T06:05:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180bcdd0 msgr2=0x7fbc181dfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180bcdd0 0x7fbc181dfa70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c450 tx=0x7fbc0000c910 comp rx=0 tx=0).stop 2023-12-20T06:05:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 shutdown_connections 2023-12-20T06:05:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbbf806a460 0x7fbbf806c920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbc18144ea0 0x7fbc181dffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180bcdd0 0x7fbc181dfa70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 --2- 172.21.15.40:0/767558049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc180b6690 0x7fbc181d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 >> 172.21.15.40:0/767558049 conn(0x7fbc18071e60 msgr2=0x7fbc18140850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 shutdown_connections 2023-12-20T06:05:03.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.238+0000 7fbc1cdfb640 1 -- 172.21.15.40:0/767558049 wait complete. 2023-12-20T06:05:03.250 INFO:tasks.ceph:Scrubbing osd.2 2023-12-20T06:05:03.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.360+0000 7fcee913e640 1 Processor -- start 2023-12-20T06:05:03.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.360+0000 7fcee913e640 1 -- start start 2023-12-20T06:05:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee913e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcee40bc660 0x7fcee414ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee913e640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcee414b290 0x7fcee4155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee913e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee414b6c0 con 0x7fcee40b79a0 2023-12-20T06:05:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee913e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40bcab0 con 0x7fcee40bc660 2023-12-20T06:05:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee913e640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee406cd70 con 0x7fcee414b290 2023-12-20T06:05:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcee40bc660 0x7fcee414ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcee40b79a0 0x7fcee40b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52526/0 (socket says 172.21.15.40:52526) 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee2d9d640 1 -- 172.21.15.40:0/3857187699 learned_addr learned my addr 172.21.15.40:0/3857187699 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee359e640 1 --2- 172.21.15.40:0/3857187699 >> v2:172.21.15.69:3300/0 conn(0x7fcee414b290 0x7fcee4155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee259c640 1 -- 172.21.15.40:0/3857187699 >> v2:172.21.15.69:3300/0 conn(0x7fcee414b290 msgr2=0x7fcee4155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee259c640 1 --2- 172.21.15.40:0/3857187699 >> v2:172.21.15.69:3300/0 conn(0x7fcee414b290 0x7fcee4155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee259c640 1 -- 172.21.15.40:0/3857187699 >> v1:172.21.15.40:6789/0 conn(0x7fcee40b79a0 legacy=0x7fcee40b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee1d9b640 1 -- 172.21.15.40:0/3857187699 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452371021 0 0) 0x7fcee414b6c0 con 0x7fcee40b79a0 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee259c640 1 -- 172.21.15.40:0/3857187699 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40b8ba0 con 0x7fcee40bc660 2023-12-20T06:05:03.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee359e640 1 --2- 172.21.15.40:0/3857187699 >> v2:172.21.15.69:3300/0 conn(0x7fcee414b290 0x7fcee4155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:05:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee259c640 1 --2- 172.21.15.40:0/3857187699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee40bc660 0x7fcee414ad50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62755e14853ffb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee1d9b640 1 -- 172.21.15.40:0/3857187699 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc031830 con 0x7fcee40bc660 2023-12-20T06:05:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee1d9b640 1 -- 172.21.15.40:0/3857187699 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc031990 con 0x7fcee40bc660 2023-12-20T06:05:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.362+0000 7fcee1d9b640 1 -- 172.21.15.40:0/3857187699 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc031d20 con 0x7fcee40bc660 2023-12-20T06:05:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 -- 172.21.15.40:0/3857187699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee40bc660 msgr2=0x7fcee414ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 --2- 172.21.15.40:0/3857187699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee40bc660 0x7fcee414ad50 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0097a0 tx=0x7fcecc02b8d0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 -- 172.21.15.40:0/3857187699 shutdown_connections 2023-12-20T06:05:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 --2- 172.21.15.40:0/3857187699 >> v2:172.21.15.69:3300/0 conn(0x7fcee414b290 0x7fcee4155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 --2- 172.21.15.40:0/3857187699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee40bc660 0x7fcee414ad50 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 -- 172.21.15.40:0/3857187699 >> 172.21.15.40:0/3857187699 conn(0x7fcee40c0330 msgr2=0x7fcee40c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 -- 172.21.15.40:0/3857187699 shutdown_connections 2023-12-20T06:05:03.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.363+0000 7fcee913e640 1 -- 172.21.15.40:0/3857187699 wait complete. 2023-12-20T06:05:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.364+0000 7fcee913e640 1 Processor -- start 2023-12-20T06:05:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.364+0000 7fcee913e640 1 -- start start 2023-12-20T06:05:03.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcee40b79a0 0x7fcee40b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcee40bc660 0x7fcee41e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee414b290 0x7fcee40b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40b5780 con 0x7fcee414b290 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4146890 con 0x7fcee40bc660 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4145ac0 con 0x7fcee40b79a0 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee414b290 0x7fcee40b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee414b290 0x7fcee40b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55198/0 (socket says 172.21.15.40:55198) 2023-12-20T06:05:03.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 -- 172.21.15.40:0/1256112900 learned_addr learned my addr 172.21.15.40:0/1256112900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee259c640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcee40bc660 0x7fcee41e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee2d9d640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcee40b79a0 0x7fcee40b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 -- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcee40b79a0 msgr2=0x7fcee40b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fcee40b79a0 0x7fcee40b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 -- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcee40bc660 msgr2=0x7fcee41e31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcee40bc660 0x7fcee41e31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 -- 172.21.15.40:0/1256112900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009400 con 0x7fcee414b290 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee259c640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcee40bc660 0x7fcee41e31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:05:03.372 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee359e640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee414b290 0x7fcee40b2ce0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fced400cd80 tx=0x7fced400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400f680 con 0x7fcee414b290 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400f800 con 0x7fcee414b290 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400fbb0 con 0x7fcee414b290 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee4145d40 con 0x7fcee414b290 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.365+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee4147a10 con 0x7fcee414b290 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.366+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcee40b9160 con 0x7fcee414b290 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.367+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fced400b040 con 0x7fcee414b290 2023-12-20T06:05:03.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.367+0000 7fcedb7fe640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcec406a460 0x7fcec406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.367+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fced4088fa0 con 0x7fcee414b290 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.367+0000 7fcedb7fe640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fcec40702c0 0x7fcec40726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.367+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 --> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcec4072d90 con 0x7fcec40702c0 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.367+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fced408b600 con 0x7fcee414b290 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.368+0000 7fcee259c640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fcec40702c0 0x7fcec40726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.368+0000 7fcee2d9d640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcec406a460 0x7fcec406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.368+0000 7fcee259c640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fcec40702c0 0x7fcec40726e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.368+0000 7fcee2d9d640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcec406a460 0x7fcec406c920 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcedc000f60 tx=0x7fcedc007b50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.368+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== osd.2 v2:172.21.15.40:6809/89424 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcec4072d90 con 0x7fcec40702c0 2023-12-20T06:05:03.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.381+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 --> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcee40b8e80 con 0x7fcec40702c0 2023-12-20T06:05:03.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.381+0000 7fcedb7fe640 1 -- 172.21.15.40:0/1256112900 <== osd.2 v2:172.21.15.40:6809/89424 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcecc031b80 con 0x7fcec40702c0 2023-12-20T06:05:03.382 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:03.383 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:03.383 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.381+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fcec40702c0 msgr2=0x7fcec40726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.381+0000 7fcee913e640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:6809/89424,v1:172.21.15.40:6811/89424] conn(0x7fcec40702c0 0x7fcec40726e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcec406a460 msgr2=0x7fcec406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fcec406a460 0x7fcec406c920 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcedc000f60 tx=0x7fcedc007b50 comp rx=0 tx=0).stop 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee414b290 msgr2=0x7fcee40b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 --2- 172.21.15.40:0/1256112900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcee414b290 0x7fcee40b2ce0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fced400cd80 tx=0x7fced400a650 comp rx=0 tx=0).stop 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee359e640 1 -- 172.21.15.40:0/1256112900 reap_dead start 2023-12-20T06:05:03.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 shutdown_connections 2023-12-20T06:05:03.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 >> 172.21.15.40:0/1256112900 conn(0x7fcee40c0330 msgr2=0x7fcee40ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 shutdown_connections 2023-12-20T06:05:03.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.382+0000 7fcee913e640 1 -- 172.21.15.40:0/1256112900 wait complete. 2023-12-20T06:05:03.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-20T06:05:03.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.499+0000 7fdfe41a3640 1 Processor -- start 2023-12-20T06:05:03.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.499+0000 7fdfe41a3640 1 -- start start 2023-12-20T06:05:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe41a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfdc0b4f90 0x7fdfdc0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe41a3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc1531a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe41a3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0b8270 con 0x7fdfdc070ff0 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe41a3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b6d70 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe41a3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b56e0 con 0x7fdfdc0b7e00 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe173e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdfdc0b4f90 0x7fdfdc0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe1f3f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdfdc070ff0 0x7fdfdc142850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52534/0 (socket says 172.21.15.40:52534) 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe173e640 1 --2- 172.21.15.40:0/3468337807 >> v2:172.21.15.40:3300/0 conn(0x7fdfdc0b4f90 0x7fdfdc0b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55208/0 (socket says 172.21.15.40:55208) 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe1f3f640 1 -- 172.21.15.40:0/3468337807 learned_addr learned my addr 172.21.15.40:0/3468337807 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe173e640 1 -- 172.21.15.40:0/3468337807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 msgr2=0x7fdfdc1531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.500+0000 7fdfe2740640 1 --2- 172.21.15.40:0/3468337807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc1531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe173e640 1 --2- 172.21.15.40:0/3468337807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc1531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe173e640 1 -- 172.21.15.40:0/3468337807 >> v1:172.21.15.40:6789/0 conn(0x7fdfdc070ff0 legacy=0x7fdfdc142850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe173e640 1 -- 172.21.15.40:0/3468337807 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0b59c0 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe2740640 1 --2- 172.21.15.40:0/3468337807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc1531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe0f3d640 1 -- 172.21.15.40:0/3468337807 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751003702 0 0) 0x7fdfdc0b8270 con 0x7fdfdc070ff0 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe173e640 1 --2- 172.21.15.40:0/3468337807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc0b78c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097a0 tx=0x7fdfd002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b62c9fb382446b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe0f3d640 1 -- 172.21.15.40:0/3468337807 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0030610 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe0f3d640 1 -- 172.21.15.40:0/3468337807 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0030770 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.501+0000 7fdfe0f3d640 1 -- 172.21.15.40:0/3468337807 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0030b00 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 -- 172.21.15.40:0/3468337807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 msgr2=0x7fdfdc0b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/3468337807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc0b78c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097a0 tx=0x7fdfd002b960 comp rx=0 tx=0).stop 2023-12-20T06:05:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 -- 172.21.15.40:0/3468337807 shutdown_connections 2023-12-20T06:05:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/3468337807 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc1531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/3468337807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc0b78c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 -- 172.21.15.40:0/3468337807 >> 172.21.15.40:0/3468337807 conn(0x7fdfdc0be120 msgr2=0x7fdfdc0be530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 -- 172.21.15.40:0/3468337807 shutdown_connections 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.502+0000 7fdfe41a3640 1 -- 172.21.15.40:0/3468337807 wait complete. 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.503+0000 7fdfe41a3640 1 Processor -- start 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.503+0000 7fdfe41a3640 1 -- start start 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe41a3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfdc070ff0 0x7fdfdc0bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe41a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc1e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe41a3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc137460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe41a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc146a60 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe41a3640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0bdc10 con 0x7fdfdc070ff0 2023-12-20T06:05:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe41a3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc06b470 con 0x7fdfdc0b7e00 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc1e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc1e43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55214/0 (socket says 172.21.15.40:55214) 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 -- 172.21.15.40:0/2302502133 learned_addr learned my addr 172.21.15.40:0/2302502133 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe1f3f640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfdc070ff0 0x7fdfdc0bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe2740640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc137460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 -- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 msgr2=0x7fdfdc137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc137460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 -- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfdc070ff0 msgr2=0x7fdfdc0bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfdc070ff0 0x7fdfdc0bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 -- 172.21.15.40:0/2302502133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009400 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.504+0000 7fdfe173e640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc1e43b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0000c00 tx=0x7fdfd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.505+0000 7fdfda7fc640 1 -- 172.21.15.40:0/2302502133 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0039c90 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.505+0000 7fdfda7fc640 1 -- 172.21.15.40:0/2302502133 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd003f040 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.505+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc06ad20 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.505+0000 7fdfda7fc640 1 -- 172.21.15.40:0/2302502133 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0006e10 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.505+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc06c630 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.506+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc04e840 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.506+0000 7fdfda7fc640 1 -- 172.21.15.40:0/2302502133 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdfd0004030 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.506+0000 7fdfda7fc640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdfc806a430 0x7fdfc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.507+0000 7fdfda7fc640 1 -- 172.21.15.40:0/2302502133 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdfd00aa570 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.507+0000 7fdfe1f3f640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdfc806a430 0x7fdfc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.507+0000 7fdfe1f3f640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdfc806a430 0x7fdfc806c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4000f60 tx=0x7fdfd4007b50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.511+0000 7fdfda7fc640 1 -- 172.21.15.40:0/2302502133 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdfd0075dd0 con 0x7fdfdc0b4f90 2023-12-20T06:05:03.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.688+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfdc0b5f80 con 0x7fdfc806a430 2023-12-20T06:05:03.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.689+0000 7fdfda7fc640 1 -- 172.21.15.40:0/2302502133 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdfd4007170 con 0x7fdfc806a430 2023-12-20T06:05:03.689 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 2 to deep-scrub 2023-12-20T06:05:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdfc806a430 msgr2=0x7fdfc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdfc806a430 0x7fdfc806c8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4000f60 tx=0x7fdfd4007b50 comp rx=0 tx=0).stop 2023-12-20T06:05:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 msgr2=0x7fdfdc1e43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc1e43b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0000c00 tx=0x7fdfd00046c0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 shutdown_connections 2023-12-20T06:05:03.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fdfc806a430 0x7fdfc806c8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fdfdc0b7e00 0x7fdfdc137460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdfdc0b4f90 0x7fdfdc1e43b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 --2- 172.21.15.40:0/2302502133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdfdc070ff0 0x7fdfdc0bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 >> 172.21.15.40:0/2302502133 conn(0x7fdfdc0be120 msgr2=0x7fdfdc0be500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 shutdown_connections 2023-12-20T06:05:03.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.691+0000 7fdfe41a3640 1 -- 172.21.15.40:0/2302502133 wait complete. 2023-12-20T06:05:03.703 INFO:tasks.ceph:Scrubbing osd.3 2023-12-20T06:05:03.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.812+0000 7efcc15e7640 1 Processor -- start 2023-12-20T06:05:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.812+0000 7efcc15e7640 1 -- start start 2023-12-20T06:05:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcc15e7640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efcbc147850 0x7efcbc06f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcc15e7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc06fd10 0x7efcbc152160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcc15e7640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc147ce0 con 0x7efcbc141c00 2023-12-20T06:05:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcc15e7640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcbc1487c0 con 0x7efcbc147850 2023-12-20T06:05:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcc15e7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0b8f50 con 0x7efcbc06fd10 2023-12-20T06:05:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcbb7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc06fd10 0x7efcbc152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcbb7fe640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc06fd10 0x7efcbc152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3301/0 says I am v2:172.21.15.40:33982/0 (socket says 172.21.15.40:33982) 2023-12-20T06:05:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcbb7fe640 1 -- 172.21.15.40:0/1677460885 learned_addr learned my addr 172.21.15.40:0/1677460885 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:03.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.813+0000 7efcba7fc640 1 --2- 172.21.15.40:0/1677460885 >> v2:172.21.15.69:3300/0 conn(0x7efcbc147850 0x7efcbc06f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.814+0000 7efcbb7fe640 1 -- 172.21.15.40:0/1677460885 >> v2:172.21.15.69:3300/0 conn(0x7efcbc147850 msgr2=0x7efcbc06f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:03.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.814+0000 7efcbb7fe640 1 --2- 172.21.15.40:0/1677460885 >> v2:172.21.15.69:3300/0 conn(0x7efcbc147850 0x7efcbc06f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.814+0000 7efcbb7fe640 1 -- 172.21.15.40:0/1677460885 >> v1:172.21.15.69:6789/0 conn(0x7efcbc141c00 legacy=0x7efcbc0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.814+0000 7efcbb7fe640 1 -- 172.21.15.40:0/1677460885 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc0b8a60 con 0x7efcbc06fd10 2023-12-20T06:05:03.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.814+0000 7efcbb7fe640 1 --2- 172.21.15.40:0/1677460885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc06fd10 0x7efcbc152160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcac009e50 tx=0x7efcac02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c012b8fb9a1580b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcb9ffb640 1 -- 172.21.15.40:0/1677460885 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac02cb00 con 0x7efcbc06fd10 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcb9ffb640 1 -- 172.21.15.40:0/1677460885 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcac02cc60 con 0x7efcbc06fd10 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcb9ffb640 1 -- 172.21.15.40:0/1677460885 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0343f0 con 0x7efcbc06fd10 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 -- 172.21.15.40:0/1677460885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc06fd10 msgr2=0x7efcbc152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 --2- 172.21.15.40:0/1677460885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc06fd10 0x7efcbc152160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcac009e50 tx=0x7efcac02bf60 comp rx=0 tx=0).stop 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 -- 172.21.15.40:0/1677460885 shutdown_connections 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 --2- 172.21.15.40:0/1677460885 >> v2:172.21.15.69:3300/0 conn(0x7efcbc147850 0x7efcbc06f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 --2- 172.21.15.40:0/1677460885 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc06fd10 0x7efcbc152160 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 -- 172.21.15.40:0/1677460885 >> 172.21.15.40:0/1677460885 conn(0x7efcbc06dc00 msgr2=0x7efcbc069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 -- 172.21.15.40:0/1677460885 shutdown_connections 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.815+0000 7efcc15e7640 1 -- 172.21.15.40:0/1677460885 wait complete. 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.816+0000 7efcc15e7640 1 Processor -- start 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.816+0000 7efcc15e7640 1 -- start start 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcc15e7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcbc06fd10 0x7efcbc13c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcc15e7640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc141c00 0x7efcbc139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcc15e7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc147850 0x7efcbc13a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcc15e7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc13c570 con 0x7efcbc147850 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcc15e7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0bad90 con 0x7efcbc06fd10 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcc15e7640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc142ac0 con 0x7efcbc141c00 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcbb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc147850 0x7efcbc13a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcbb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc147850 0x7efcbc13a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55222/0 (socket says 172.21.15.40:55222) 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcbb7fe640 1 -- 172.21.15.40:0/4179773369 learned_addr learned my addr 172.21.15.40:0/4179773369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcba7fc640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc141c00 0x7efcbc139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.817+0000 7efcbaffd640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcbc06fd10 0x7efcbc13c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcba7fc640 1 -- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcbc06fd10 msgr2=0x7efcbc13c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcba7fc640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efcbc06fd10 0x7efcbc13c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcba7fc640 1 -- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc147850 msgr2=0x7efcbc13a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcba7fc640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc147850 0x7efcbc13a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcba7fc640 1 -- 172.21.15.40:0/4179773369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcac009b30 con 0x7efcbc141c00 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcbb7fe640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcbc147850 0x7efcbc13a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcba7fc640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc141c00 0x7efcbc139ef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efca400e8a0 tx=0x7efca400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== mon.2 v2:172.21.15.69:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4009e60 con 0x7efcbc141c00 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== mon.2 v2:172.21.15.69:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca400c940 con 0x7efcbc141c00 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc0ba740 con 0x7efcbc141c00 2023-12-20T06:05:03.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== mon.2 v2:172.21.15.69:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca400ccd0 con 0x7efcbc141c00 2023-12-20T06:05:03.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.818+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc142d30 con 0x7efcbc141c00 2023-12-20T06:05:03.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.819+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcbc147f20 con 0x7efcbc141c00 2023-12-20T06:05:03.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== mon.2 v2:172.21.15.69:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efca4013470 con 0x7efcbc141c00 2023-12-20T06:05:03.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcb37fe640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efc9c06a460 0x7efc9c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== mon.2 v2:172.21.15.69:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efca4088920 con 0x7efcbc141c00 2023-12-20T06:05:03.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcbaffd640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efc9c06a460 0x7efc9c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcb37fe640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7efc9c0702c0 0x7efc9c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 --> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc9c072d90 con 0x7efc9c0702c0 2023-12-20T06:05:03.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== mon.2 v2:172.21.15.69:3301/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efca4088d70 con 0x7efcbc141c00 2023-12-20T06:05:03.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.820+0000 7efcbb7fe640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7efc9c0702c0 0x7efc9c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.821+0000 7efcbaffd640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efc9c06a460 0x7efc9c06c920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000f60 tx=0x7efcb4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.821+0000 7efcbb7fe640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7efc9c0702c0 0x7efc9c0726e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.821+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== osd.3 v2:172.21.15.40:6824/89423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efc9c072d90 con 0x7efc9c0702c0 2023-12-20T06:05:03.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 --> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efcbc070160 con 0x7efc9c0702c0 2023-12-20T06:05:03.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcb37fe640 1 -- 172.21.15.40:0/4179773369 <== osd.3 v2:172.21.15.40:6824/89423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efcac02ca00 con 0x7efc9c0702c0 2023-12-20T06:05:03.835 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:03.835 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:03.835 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:03.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7efc9c0702c0 msgr2=0x7efc9c0726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.40:6824/89423,v1:172.21.15.40:6825/89423] conn(0x7efc9c0702c0 0x7efc9c0726e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efc9c06a460 msgr2=0x7efc9c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7efc9c06a460 0x7efc9c06c920 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efcb4000f60 tx=0x7efcb4009040 comp rx=0 tx=0).stop 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc141c00 msgr2=0x7efcbc139ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 --2- 172.21.15.40:0/4179773369 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7efcbc141c00 0x7efcbc139ef0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efca400e8a0 tx=0x7efca400ed60 comp rx=0 tx=0).stop 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcbb7fe640 1 -- 172.21.15.40:0/4179773369 reap_dead start 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 shutdown_connections 2023-12-20T06:05:03.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 >> 172.21.15.40:0/4179773369 conn(0x7efcbc06dc00 msgr2=0x7efcbc0715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 shutdown_connections 2023-12-20T06:05:03.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.835+0000 7efcc15e7640 1 -- 172.21.15.40:0/4179773369 wait complete. 2023-12-20T06:05:03.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-20T06:05:03.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.952+0000 7f6c2a988640 1 Processor -- start 2023-12-20T06:05:03.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.952+0000 7f6c2a988640 1 -- start start 2023-12-20T06:05:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.952+0000 7f6c2a988640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6c240bcdd0 0x7f6c240b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.952+0000 7f6c2a988640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c24144ea0 0x7f6c24155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.952+0000 7f6c2a988640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c240bc6b0 con 0x7f6c240b64c0 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.952+0000 7f6c2a988640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c240b6900 con 0x7f6c24144ea0 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.952+0000 7f6c2a988640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c240a59f0 con 0x7f6c240bcdd0 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c237fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6c240b64c0 0x7f6c24144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52546/0 (socket says 172.21.15.40:52546) 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c28f25640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c24144ea0 0x7f6c24155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c237fe640 1 -- 172.21.15.40:0/2731969972 learned_addr learned my addr 172.21.15.40:0/2731969972 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c23fff640 1 --2- 172.21.15.40:0/2731969972 >> v2:172.21.15.69:3300/0 conn(0x7f6c240bcdd0 0x7f6c240b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c22ffd640 1 -- 172.21.15.40:0/2731969972 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727784981 0 0) 0x7f6c240bc6b0 con 0x7f6c240b64c0 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c22ffd640 1 -- 172.21.15.40:0/2731969972 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c10003520 con 0x7f6c240b64c0 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c28f25640 1 -- 172.21.15.40:0/2731969972 >> v2:172.21.15.69:3300/0 conn(0x7f6c240bcdd0 msgr2=0x7f6c240b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c28f25640 1 --2- 172.21.15.40:0/2731969972 >> v2:172.21.15.69:3300/0 conn(0x7f6c240bcdd0 0x7f6c240b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c28f25640 1 -- 172.21.15.40:0/2731969972 >> v1:172.21.15.40:6789/0 conn(0x7f6c240b64c0 legacy=0x7f6c24144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.953+0000 7f6c28f25640 1 -- 172.21.15.40:0/2731969972 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240bc0a0 con 0x7f6c24144ea0 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c28f25640 1 --2- 172.21.15.40:0/2731969972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c24144ea0 0x7f6c24155340 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6c240c10f0 tx=0x7f6c1c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be290bdbf90d83e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c22ffd640 1 -- 172.21.15.40:0/2731969972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c02cd00 con 0x7f6c24144ea0 2023-12-20T06:05:03.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c22ffd640 1 -- 172.21.15.40:0/2731969972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c02ce60 con 0x7f6c24144ea0 2023-12-20T06:05:03.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c22ffd640 1 -- 172.21.15.40:0/2731969972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c034640 con 0x7f6c24144ea0 2023-12-20T06:05:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 -- 172.21.15.40:0/2731969972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c24144ea0 msgr2=0x7f6c24155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 --2- 172.21.15.40:0/2731969972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c24144ea0 0x7f6c24155340 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6c240c10f0 tx=0x7f6c1c02bf50 comp rx=0 tx=0).stop 2023-12-20T06:05:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 -- 172.21.15.40:0/2731969972 shutdown_connections 2023-12-20T06:05:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 --2- 172.21.15.40:0/2731969972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c24144ea0 0x7f6c24155340 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 --2- 172.21.15.40:0/2731969972 >> v2:172.21.15.69:3300/0 conn(0x7f6c240bcdd0 0x7f6c240b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 -- 172.21.15.40:0/2731969972 >> 172.21.15.40:0/2731969972 conn(0x7f6c24071e60 msgr2=0x7f6c240c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 -- 172.21.15.40:0/2731969972 shutdown_connections 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.954+0000 7f6c2a988640 1 -- 172.21.15.40:0/2731969972 wait complete. 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.955+0000 7f6c2a988640 1 Processor -- start 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c2a988640 1 -- start start 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c2a988640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c240b64c0 0x7f6c24143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c2a988640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c240bcdd0 0x7f6c241e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c2a988640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c24144ea0 0x7f6c241e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c2a988640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241436a0 con 0x7f6c240bcdd0 2023-12-20T06:05:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c2a988640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241460b0 con 0x7f6c24144ea0 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c2a988640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c241457c0 con 0x7f6c240b64c0 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c237fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c240bcdd0 0x7f6c241e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c237fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c240bcdd0 0x7f6c241e2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55236/0 (socket says 172.21.15.40:55236) 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c237fe640 1 -- 172.21.15.40:0/1258717643 learned_addr learned my addr 172.21.15.40:0/1258717643 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c23fff640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c240b64c0 0x7f6c24143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.956+0000 7f6c28f25640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c24144ea0 0x7f6c241e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c237fe640 1 -- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c240b64c0 msgr2=0x7f6c24143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c237fe640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c240b64c0 0x7f6c24143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c237fe640 1 -- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c24144ea0 msgr2=0x7f6c241e2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c237fe640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c24144ea0 0x7f6c241e2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c237fe640 1 -- 172.21.15.40:0/1258717643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c009a70 con 0x7f6c240bcdd0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c237fe640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c240bcdd0 0x7f6c241e2a50 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c430 tx=0x7f6c1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c20ff9640 1 -- 172.21.15.40:0/1258717643 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14005ce0 con 0x7f6c240bcdd0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c20ff9640 1 -- 172.21.15.40:0/1258717643 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14005e40 con 0x7f6c240bcdd0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c24145a60 con 0x7f6c240bcdd0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c20ff9640 1 -- 172.21.15.40:0/1258717643 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c140072f0 con 0x7f6c240bcdd0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.957+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c24147410 con 0x7f6c240bcdd0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.958+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c24146420 con 0x7f6c240bcdd0 2023-12-20T06:05:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.958+0000 7f6c20ff9640 1 -- 172.21.15.40:0/1258717643 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c14007450 con 0x7f6c240bcdd0 2023-12-20T06:05:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.959+0000 7f6c20ff9640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c0406a430 0x7f6c0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.959+0000 7f6c20ff9640 1 -- 172.21.15.40:0/1258717643 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6c14087c30 con 0x7f6c240bcdd0 2023-12-20T06:05:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.959+0000 7f6c23fff640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c0406a430 0x7f6c0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.959+0000 7f6c23fff640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c0406a430 0x7f6c0406c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c006fd0 tx=0x7f6c0c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:03.964+0000 7f6c20ff9640 1 -- 172.21.15.40:0/1258717643 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6c140535d0 con 0x7f6c240bcdd0 2023-12-20T06:05:04.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.139+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c240b5500 con 0x7f6c0406a430 2023-12-20T06:05:04.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.139+0000 7f6c20ff9640 1 -- 172.21.15.40:0/1258717643 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6c0c004020 con 0x7f6c0406a430 2023-12-20T06:05:04.141 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 3 to deep-scrub 2023-12-20T06:05:04.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c0406a430 msgr2=0x7f6c0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c0406a430 0x7f6c0406c8f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c006fd0 tx=0x7f6c0c008040 comp rx=0 tx=0).stop 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c240bcdd0 msgr2=0x7f6c241e2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c240bcdd0 0x7f6c241e2a50 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c430 tx=0x7f6c1400c8f0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 shutdown_connections 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f6c0406a430 0x7f6c0406c8f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c24144ea0 0x7f6c241e2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c240bcdd0 0x7f6c241e2a50 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 --2- 172.21.15.40:0/1258717643 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f6c240b64c0 0x7f6c24143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 >> 172.21.15.40:0/1258717643 conn(0x7f6c24071e60 msgr2=0x7f6c240ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 shutdown_connections 2023-12-20T06:05:04.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.141+0000 7f6c2a988640 1 -- 172.21.15.40:0/1258717643 wait complete. 2023-12-20T06:05:04.153 INFO:tasks.ceph:Scrubbing osd.4 2023-12-20T06:05:04.154 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:04.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bffae640 1 Processor -- start 2023-12-20T06:05:04.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bffae640 1 -- start start 2023-12-20T06:05:04.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bffae640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc8b80bc660 0x7fc8b814ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bffae640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 0x7fc8b8155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bffae640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b814b6c0 con 0x7fc8b80b79a0 2023-12-20T06:05:04.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bffae640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b80bcab0 con 0x7fc8b80bc660 2023-12-20T06:05:04.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bffae640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b806cd70 con 0x7fc8b814b290 2023-12-20T06:05:04.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bdd4a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc8b80b79a0 0x7fc8b80b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52560/0 (socket says 172.21.15.40:52560) 2023-12-20T06:05:04.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.263+0000 7fc8bdd4a640 1 -- 172.21.15.40:0/1039698350 learned_addr learned my addr 172.21.15.40:0/1039698350 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:04.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bd549640 1 --2- 172.21.15.40:0/1039698350 >> v2:172.21.15.69:3300/0 conn(0x7fc8b80bc660 0x7fc8b814ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8be54b640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 0x7fc8b8155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049057283 0 0) 0x7fc8b814b6c0 con 0x7fc8b80b79a0 2023-12-20T06:05:04.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8a4003520 con 0x7fc8b80b79a0 2023-12-20T06:05:04.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3659223039 0 0) 0x7fc8a4003520 con 0x7fc8b80b79a0 2023-12-20T06:05:04.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 msgr2=0x7fc8b8155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 0x7fc8b8155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 >> v2:172.21.15.69:3300/0 conn(0x7fc8b80bc660 msgr2=0x7fc8b814ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 --2- 172.21.15.40:0/1039698350 >> v2:172.21.15.69:3300/0 conn(0x7fc8b80bc660 0x7fc8b814ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80b8ba0 con 0x7fc8b80b79a0 2023-12-20T06:05:04.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7fc8b4001670 con 0x7fc8b80b79a0 2023-12-20T06:05:04.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 >> v1:172.21.15.40:6789/0 conn(0x7fc8b80b79a0 legacy=0x7fc8b80b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a40039e0 0x7fc8a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 0x7fc8a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8a4004d00 0x7fc8a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80bcab0 con 0x7fc8a40039e0 2023-12-20T06:05:04.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a400b980 con 0x7fc8a4004d00 2023-12-20T06:05:04.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a400bb40 con 0x7fc8b814b290 2023-12-20T06:05:04.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bdd4a640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a40039e0 0x7fc8a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8bd549640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 0x7fc8a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.264+0000 7fc8be54b640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8a4004d00 0x7fc8a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bdd4a640 1 -- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 msgr2=0x7fc8a40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bdd4a640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8b814b290 0x7fc8a40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bdd4a640 1 -- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8a4004d00 msgr2=0x7fc8a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bdd4a640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8a4004d00 0x7fc8a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bdd4a640 1 -- 172.21.15.40:0/1039698350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4003520 con 0x7fc8a40039e0 2023-12-20T06:05:04.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bdd4a640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a40039e0 0x7fc8a4003e00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c290 tx=0x7fc8a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7485d7862c32c0f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4005ad0 con 0x7fc8a40039e0 2023-12-20T06:05:04.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4005c30 con 0x7fc8a40039e0 2023-12-20T06:05:04.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.265+0000 7fc8bcd48640 1 -- 172.21.15.40:0/1039698350 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b402c8d0 con 0x7fc8a40039e0 2023-12-20T06:05:04.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.266+0000 7fc8bffae640 1 -- 172.21.15.40:0/1039698350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a40039e0 msgr2=0x7fc8a4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.266+0000 7fc8bffae640 1 --2- 172.21.15.40:0/1039698350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a40039e0 0x7fc8a4003e00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400c290 tx=0x7fc8a40057f0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.266+0000 7fc8be54b640 1 -- 172.21.15.40:0/1039698350 reap_dead start 2023-12-20T06:05:04.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.266+0000 7fc8bffae640 1 -- 172.21.15.40:0/1039698350 shutdown_connections 2023-12-20T06:05:04.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.266+0000 7fc8bffae640 1 -- 172.21.15.40:0/1039698350 >> 172.21.15.40:0/1039698350 conn(0x7fc8b80c0330 msgr2=0x7fc8b80c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.266+0000 7fc8bffae640 1 -- 172.21.15.40:0/1039698350 shutdown_connections 2023-12-20T06:05:04.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.266+0000 7fc8bffae640 1 -- 172.21.15.40:0/1039698350 wait complete. 2023-12-20T06:05:04.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.267+0000 7fc8bffae640 1 Processor -- start 2023-12-20T06:05:04.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.267+0000 7fc8bffae640 1 -- start start 2023-12-20T06:05:04.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8a40039e0 0x7fc8b814e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b81452f0 0x7fc8b8146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b8148080 0x7fc8b80b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80b6680 con 0x7fc8b8148080 2023-12-20T06:05:04.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b8147680 con 0x7fc8b81452f0 2023-12-20T06:05:04.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b8148530 con 0x7fc8a40039e0 2023-12-20T06:05:04.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b8148080 0x7fc8b80b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b8148080 0x7fc8b80b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55260/0 (socket says 172.21.15.40:55260) 2023-12-20T06:05:04.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 -- 172.21.15.40:0/2536910926 learned_addr learned my addr 172.21.15.40:0/2536910926 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:04.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bdd4a640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8a40039e0 0x7fc8b814e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bd549640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b81452f0 0x7fc8b8146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 -- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8a40039e0 msgr2=0x7fc8b814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fc8a40039e0 0x7fc8b814e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 -- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b81452f0 msgr2=0x7fc8b8146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b81452f0 0x7fc8b8146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 -- 172.21.15.40:0/2536910926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80b5de0 con 0x7fc8b8148080 2023-12-20T06:05:04.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bd549640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8b81452f0 0x7fc8b8146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:05:04.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8be54b640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b8148080 0x7fc8b80b2df0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0011bf0 tx=0x7fc8b000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000e040 con 0x7fc8b8148080 2023-12-20T06:05:04.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000f040 con 0x7fc8b8148080 2023-12-20T06:05:04.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b80b60c0 con 0x7fc8b8148080 2023-12-20T06:05:04.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0015430 con 0x7fc8b8148080 2023-12-20T06:05:04.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b8145e30 con 0x7fc8b8148080 2023-12-20T06:05:04.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.269+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc8b80b9160 con 0x7fc8b8148080 2023-12-20T06:05:04.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.270+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8b0015590 con 0x7fc8b8148080 2023-12-20T06:05:04.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.270+0000 7fc8ae7fc640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc89c06a460 0x7fc89c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8b0089aa0 con 0x7fc8b8148080 2023-12-20T06:05:04.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8ae7fc640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fc89c0702c0 0x7fc89c0726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 --> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc89c072d90 con 0x7fc89c0702c0 2023-12-20T06:05:04.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b0089ef0 con 0x7fc8b8148080 2023-12-20T06:05:04.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8bdd4a640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc89c06a460 0x7fc89c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8bd549640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fc89c0702c0 0x7fc89c0726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8bdd4a640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc89c06a460 0x7fc89c06c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4034000 tx=0x7fc8b4007000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.271+0000 7fc8bd549640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fc89c0702c0 0x7fc89c0726e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.272+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== osd.4 v2:172.21.15.69:6824/89421 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc89c072d90 con 0x7fc89c0702c0 2023-12-20T06:05:04.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.284+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 --> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc8b80b8e80 con 0x7fc89c0702c0 2023-12-20T06:05:04.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8ae7fc640 1 -- 172.21.15.40:0/2536910926 <== osd.4 v2:172.21.15.69:6824/89421 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc8a8009b10 con 0x7fc89c0702c0 2023-12-20T06:05:04.286 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:04.286 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:04.286 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:04.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fc89c0702c0 msgr2=0x7fc89c0726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6824/89421,v1:172.21.15.69:6825/89421] conn(0x7fc89c0702c0 0x7fc89c0726e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc89c06a460 msgr2=0x7fc89c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fc89c06a460 0x7fc89c06c920 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4034000 tx=0x7fc8b4007000 comp rx=0 tx=0).stop 2023-12-20T06:05:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b8148080 msgr2=0x7fc8b80b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 --2- 172.21.15.40:0/2536910926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b8148080 0x7fc8b80b2df0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0011bf0 tx=0x7fc8b000f580 comp rx=0 tx=0).stop 2023-12-20T06:05:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8be54b640 1 -- 172.21.15.40:0/2536910926 reap_dead start 2023-12-20T06:05:04.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 shutdown_connections 2023-12-20T06:05:04.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 >> 172.21.15.40:0/2536910926 conn(0x7fc8b80c0330 msgr2=0x7fc8b80ba980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 shutdown_connections 2023-12-20T06:05:04.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.285+0000 7fc8bffae640 1 -- 172.21.15.40:0/2536910926 wait complete. 2023-12-20T06:05:04.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-20T06:05:04.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.404+0000 7f04d55b9640 1 Processor -- start 2023-12-20T06:05:04.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.404+0000 7f04d55b9640 1 -- start start 2023-12-20T06:05:04.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04d55b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04d00b3900 0x7f04d00bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04d55b9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d00bae20 con 0x7f04d014abd0 2023-12-20T06:05:04.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04d55b9640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d00bf900 con 0x7f04d006a470 2023-12-20T06:05:04.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04d55b9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00c1220 con 0x7f04d00b3900 2023-12-20T06:05:04.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04ce7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04d00b3900 0x7f04d00bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04cf7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f04d014abd0 0x7f04d0155400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52576/0 (socket says 172.21.15.40:52576) 2023-12-20T06:05:04.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04cf7fe640 1 -- 172.21.15.40:0/3865087171 learned_addr learned my addr 172.21.15.40:0/3865087171 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:04.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04ce7fc640 1 -- 172.21.15.40:0/3865087171 >> v1:172.21.15.69:6789/0 conn(0x7f04d006a470 legacy=0x7f04d0148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04ce7fc640 1 -- 172.21.15.40:0/3865087171 >> v1:172.21.15.40:6789/0 conn(0x7f04d014abd0 legacy=0x7f04d0155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.405+0000 7f04cdffb640 1 -- 172.21.15.40:0/3865087171 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035893413 0 0) 0x7f04d00bae20 con 0x7f04d014abd0 2023-12-20T06:05:04.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.406+0000 7f04ce7fc640 1 -- 172.21.15.40:0/3865087171 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d00bfba0 con 0x7f04d00b3900 2023-12-20T06:05:04.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.406+0000 7f04ce7fc640 1 --2- 172.21.15.40:0/3865087171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d00b3900 0x7f04d00bb2b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f04c40097d0 tx=0x7f04c402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e0e305f3316d9e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.406+0000 7f04cdffb640 1 -- 172.21.15.40:0/3865087171 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4030610 con 0x7f04d00b3900 2023-12-20T06:05:04.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.406+0000 7f04cdffb640 1 -- 172.21.15.40:0/3865087171 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4030770 con 0x7f04d00b3900 2023-12-20T06:05:04.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.406+0000 7f04cdffb640 1 -- 172.21.15.40:0/3865087171 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4030b00 con 0x7f04d00b3900 2023-12-20T06:05:04.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.407+0000 7f04d55b9640 1 -- 172.21.15.40:0/3865087171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d00b3900 msgr2=0x7f04d00bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.407+0000 7f04d55b9640 1 --2- 172.21.15.40:0/3865087171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d00b3900 0x7f04d00bb2b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f04c40097d0 tx=0x7f04c402b960 comp rx=0 tx=0).stop 2023-12-20T06:05:04.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.407+0000 7f04d55b9640 1 -- 172.21.15.40:0/3865087171 shutdown_connections 2023-12-20T06:05:04.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.407+0000 7f04d55b9640 1 --2- 172.21.15.40:0/3865087171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d00b3900 0x7f04d00bb2b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.407+0000 7f04d55b9640 1 -- 172.21.15.40:0/3865087171 >> 172.21.15.40:0/3865087171 conn(0x7f04d00c0270 msgr2=0x7f04d00c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.407+0000 7f04d55b9640 1 -- 172.21.15.40:0/3865087171 shutdown_connections 2023-12-20T06:05:04.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.407+0000 7f04d55b9640 1 -- 172.21.15.40:0/3865087171 wait complete. 2023-12-20T06:05:04.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.408+0000 7f04d55b9640 1 Processor -- start 2023-12-20T06:05:04.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.408+0000 7f04d55b9640 1 -- start start 2023-12-20T06:05:04.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04d55b9640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d006a470 0x7f04d00b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04d55b9640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f04d00b3900 0x7f04d00b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04d55b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d014abd0 0x7f04d01e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04d55b9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00a5f90 con 0x7f04d014abd0 2023-12-20T06:05:04.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04d55b9640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00b9820 con 0x7f04d006a470 2023-12-20T06:05:04.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04d55b9640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d014cd80 con 0x7f04d00b3900 2023-12-20T06:05:04.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d014abd0 0x7f04d01e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d014abd0 0x7f04d01e3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55280/0 (socket says 172.21.15.40:55280) 2023-12-20T06:05:04.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 -- 172.21.15.40:0/4055584120 learned_addr learned my addr 172.21.15.40:0/4055584120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:04.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04ce7fc640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f04d00b3900 0x7f04d00b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04ceffd640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d006a470 0x7f04d00b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 -- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f04d00b3900 msgr2=0x7f04d00b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f04d00b3900 0x7f04d00b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 -- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d006a470 msgr2=0x7f04d00b92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d006a470 0x7f04d00b92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04cf7fe640 1 -- 172.21.15.40:0/4055584120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4009400 con 0x7f04d014abd0 2023-12-20T06:05:04.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04ce7fc640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f04d00b3900 0x7f04d00b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:05:04.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.409+0000 7f04ceffd640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d006a470 0x7f04d00b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:05:04.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.410+0000 7f04cf7fe640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d014abd0 0x7f04d01e3900 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c730 tx=0x7f04c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.410+0000 7f04b77fe640 1 -- 172.21.15.40:0/4055584120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c800ce40 con 0x7f04d014abd0 2023-12-20T06:05:04.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.410+0000 7f04b77fe640 1 -- 172.21.15.40:0/4055584120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c800a640 con 0x7f04d014abd0 2023-12-20T06:05:04.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.410+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d014cff0 con 0x7f04d014abd0 2023-12-20T06:05:04.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.410+0000 7f04b77fe640 1 -- 172.21.15.40:0/4055584120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c800aa30 con 0x7f04d014abd0 2023-12-20T06:05:04.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.410+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d014bcc0 con 0x7f04d014abd0 2023-12-20T06:05:04.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.411+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d014beb0 con 0x7f04d014abd0 2023-12-20T06:05:04.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.411+0000 7f04b77fe640 1 -- 172.21.15.40:0/4055584120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f04c800ab90 con 0x7f04d014abd0 2023-12-20T06:05:04.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.412+0000 7f04b77fe640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f04bc06a430 0x7f04bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.412+0000 7f04b77fe640 1 -- 172.21.15.40:0/4055584120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f04c8087cd0 con 0x7f04d014abd0 2023-12-20T06:05:04.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.412+0000 7f04ceffd640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f04bc06a430 0x7f04bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.413+0000 7f04ceffd640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f04bc06a430 0x7f04bc06c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f04c0007fd0 tx=0x7f04c0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.416+0000 7f04b77fe640 1 -- 172.21.15.40:0/4055584120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f04c8053650 con 0x7f04d014abd0 2023-12-20T06:05:04.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.591+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f04d014b060 con 0x7f04bc06a430 2023-12-20T06:05:04.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.592+0000 7f04b77fe640 1 -- 172.21.15.40:0/4055584120 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f04c00013e0 con 0x7f04bc06a430 2023-12-20T06:05:04.592 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 4 to deep-scrub 2023-12-20T06:05:04.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f04bc06a430 msgr2=0x7f04bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f04bc06a430 0x7f04bc06c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f04c0007fd0 tx=0x7f04c0009040 comp rx=0 tx=0).stop 2023-12-20T06:05:04.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d014abd0 msgr2=0x7f04d01e3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d014abd0 0x7f04d01e3900 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f04c800c730 tx=0x7f04c800cbf0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 shutdown_connections 2023-12-20T06:05:04.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f04bc06a430 0x7f04bc06c8f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d014abd0 0x7f04d01e3900 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f04d00b3900 0x7f04d00b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 --2- 172.21.15.40:0/4055584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d006a470 0x7f04d00b92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 >> 172.21.15.40:0/4055584120 conn(0x7f04d00c0270 msgr2=0x7f04d00c0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 shutdown_connections 2023-12-20T06:05:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.594+0000 7f04d55b9640 1 -- 172.21.15.40:0/4055584120 wait complete. 2023-12-20T06:05:04.605 INFO:tasks.ceph:Scrubbing osd.5 2023-12-20T06:05:04.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.716+0000 7f3a87b9f640 1 Processor -- start 2023-12-20T06:05:04.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.716+0000 7f3a87b9f640 1 -- start start 2023-12-20T06:05:04.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a87b9f640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3a800b79a0 0x7f3a800bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a87b9f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a800b64a0 0x7f3a800b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a87b9f640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a800b8ba0 con 0x7f3a8014ad50 2023-12-20T06:05:04.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a87b9f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8006cd70 con 0x7f3a800b64a0 2023-12-20T06:05:04.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a87b9f640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a800b8e80 con 0x7f3a800b79a0 2023-12-20T06:05:04.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8513a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a800b64a0 0x7f3a800b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8513a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a800b64a0 0x7f3a800b68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55286/0 (socket says 172.21.15.40:55286) 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8513a640 1 -- 172.21.15.40:0/3674871852 learned_addr learned my addr 172.21.15.40:0/3674871852 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8593b640 1 --2- 172.21.15.40:0/3674871852 >> v2:172.21.15.69:3300/0 conn(0x7f3a800b79a0 0x7f3a800bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8513a640 1 -- 172.21.15.40:0/3674871852 >> v2:172.21.15.69:3300/0 conn(0x7f3a800b79a0 msgr2=0x7f3a800bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8513a640 1 --2- 172.21.15.40:0/3674871852 >> v2:172.21.15.69:3300/0 conn(0x7f3a800b79a0 0x7f3a800bc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8513a640 1 -- 172.21.15.40:0/3674871852 >> v1:172.21.15.69:6789/0 conn(0x7f3a8014ad50 legacy=0x7f3a8014b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.717+0000 7f3a8513a640 1 -- 172.21.15.40:0/3674871852 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a800b9160 con 0x7f3a800b64a0 2023-12-20T06:05:04.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a8513a640 1 --2- 172.21.15.40:0/3674871852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a800b68f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3a80066590 tx=0x7f3a7002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab5aced9002d862 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a84939640 1 -- 172.21.15.40:0/3674871852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70030860 con 0x7f3a800b64a0 2023-12-20T06:05:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a84939640 1 -- 172.21.15.40:0/3674871852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a700309c0 con 0x7f3a800b64a0 2023-12-20T06:05:04.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a84939640 1 -- 172.21.15.40:0/3674871852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70030d50 con 0x7f3a800b64a0 2023-12-20T06:05:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a87b9f640 1 -- 172.21.15.40:0/3674871852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 msgr2=0x7f3a800b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a87b9f640 1 --2- 172.21.15.40:0/3674871852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a800b68f0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3a80066590 tx=0x7f3a7002b9a0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a87b9f640 1 -- 172.21.15.40:0/3674871852 shutdown_connections 2023-12-20T06:05:04.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a87b9f640 1 --2- 172.21.15.40:0/3674871852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a800b68f0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a87b9f640 1 --2- 172.21.15.40:0/3674871852 >> v2:172.21.15.69:3300/0 conn(0x7f3a800b79a0 0x7f3a800bc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.718+0000 7f3a87b9f640 1 -- 172.21.15.40:0/3674871852 >> 172.21.15.40:0/3674871852 conn(0x7f3a800c0330 msgr2=0x7f3a800c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.719+0000 7f3a87b9f640 1 -- 172.21.15.40:0/3674871852 shutdown_connections 2023-12-20T06:05:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.719+0000 7f3a87b9f640 1 -- 172.21.15.40:0/3674871852 wait complete. 2023-12-20T06:05:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.719+0000 7f3a87b9f640 1 Processor -- start 2023-12-20T06:05:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a87b9f640 1 -- start start 2023-12-20T06:05:04.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a87b9f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a80146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a87b9f640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a800b79a0 0x7f3a801e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a87b9f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a8014ad50 0x7f3a800a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a87b9f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a801470a0 con 0x7f3a800b64a0 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a87b9f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80146e40 con 0x7f3a8014ad50 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a87b9f640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a801dfd20 con 0x7f3a800b79a0 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a8593b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a80146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a8593b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a80146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55292/0 (socket says 172.21.15.40:55292) 2023-12-20T06:05:04.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a8593b640 1 -- 172.21.15.40:0/1527023837 learned_addr learned my addr 172.21.15.40:0/1527023837 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a8513a640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a800b79a0 0x7f3a801e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.720+0000 7f3a8613c640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a8014ad50 0x7f3a800a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8593b640 1 -- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a800b79a0 msgr2=0x7f3a801e01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8593b640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a800b79a0 0x7f3a801e01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8593b640 1 -- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a8014ad50 msgr2=0x7f3a800a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8593b640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a8014ad50 0x7f3a800a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8593b640 1 -- 172.21.15.40:0/1527023837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700094d0 con 0x7f3a800b64a0 2023-12-20T06:05:04.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8513a640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f3a800b79a0 0x7f3a801e01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:05:04.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8613c640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a8014ad50 0x7f3a800a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T06:05:04.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a8593b640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a80146900 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00d830 tx=0x7f3a7c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00b6c0 con 0x7f3a800b64a0 2023-12-20T06:05:04.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c00b820 con 0x7f3a800b64a0 2023-12-20T06:05:04.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a80147d60 con 0x7f3a800b64a0 2023-12-20T06:05:04.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00bbb0 con 0x7f3a800b64a0 2023-12-20T06:05:04.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.721+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a801454e0 con 0x7f3a800b64a0 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.722+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a80144fc0 con 0x7f3a800b64a0 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.722+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3a7c01e460 con 0x7f3a800b64a0 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.723+0000 7f3a767fc640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3a6406a430 0x7f3a6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.723+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3a7c0897f0 con 0x7f3a800b64a0 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.723+0000 7f3a767fc640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7f3a64070290 0x7f3a640726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.723+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 --> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a64072d60 con 0x7f3a64070290 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.723+0000 7f3a8513a640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3a6406a430 0x7f3a6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.723+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a7c089c40 con 0x7f3a800b64a0 2023-12-20T06:05:04.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.723+0000 7f3a8613c640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7f3a64070290 0x7f3a640726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.724+0000 7f3a8513a640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3a6406a430 0x7f3a6406c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a70036000 tx=0x7f3a7003b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.724+0000 7f3a8613c640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7f3a64070290 0x7f3a640726b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.724+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== osd.5 v2:172.21.15.69:6808/89419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3a64072d60 con 0x7f3a64070290 2023-12-20T06:05:04.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.737+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 --> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3a800b7d80 con 0x7f3a64070290 2023-12-20T06:05:04.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a767fc640 1 -- 172.21.15.40:0/1527023837 <== osd.5 v2:172.21.15.69:6808/89419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3a78007aa0 con 0x7f3a64070290 2023-12-20T06:05:04.738 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:04.738 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:04.738 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:04.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7f3a64070290 msgr2=0x7f3a640726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6808/89419,v1:172.21.15.69:6809/89419] conn(0x7f3a64070290 0x7f3a640726b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3a6406a430 msgr2=0x7f3a6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f3a6406a430 0x7f3a6406c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a70036000 tx=0x7f3a7003b040 comp rx=0 tx=0).stop 2023-12-20T06:05:04.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 msgr2=0x7f3a80146900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 --2- 172.21.15.40:0/1527023837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a800b64a0 0x7f3a80146900 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c00d830 tx=0x7f3a7c00dcf0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a8613c640 1 -- 172.21.15.40:0/1527023837 reap_dead start 2023-12-20T06:05:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 shutdown_connections 2023-12-20T06:05:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 >> 172.21.15.40:0/1527023837 conn(0x7f3a800c0330 msgr2=0x7f3a801430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 shutdown_connections 2023-12-20T06:05:04.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.738+0000 7f3a87b9f640 1 -- 172.21.15.40:0/1527023837 wait complete. 2023-12-20T06:05:04.748 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-20T06:05:04.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf54899640 1 Processor -- start 2023-12-20T06:05:04.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf54899640 1 -- start start 2023-12-20T06:05:04.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf54899640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf5006a470 0x7fbf500bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf54899640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf5014abd0 0x7fbf50155400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf54899640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf500bae20 con 0x7fbf500b3900 2023-12-20T06:05:04.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf54899640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf500c1220 con 0x7fbf5006a470 2023-12-20T06:05:04.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf54899640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf500bf900 con 0x7fbf5014abd0 2023-12-20T06:05:04.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf4e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf5006a470 0x7fbf500bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf4e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbf5006a470 0x7fbf500bb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55298/0 (socket says 172.21.15.40:55298) 2023-12-20T06:05:04.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.856+0000 7fbf4e59c640 1 -- 172.21.15.40:0/814680370 learned_addr learned my addr 172.21.15.40:0/814680370 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.857+0000 7fbf4ed9d640 1 --2- 172.21.15.40:0/814680370 >> v2:172.21.15.69:3300/0 conn(0x7fbf5014abd0 0x7fbf50155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.857+0000 7fbf4e59c640 1 -- 172.21.15.40:0/814680370 >> v2:172.21.15.69:3300/0 conn(0x7fbf5014abd0 msgr2=0x7fbf50155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.857+0000 7fbf4e59c640 1 --2- 172.21.15.40:0/814680370 >> v2:172.21.15.69:3300/0 conn(0x7fbf5014abd0 0x7fbf50155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.857+0000 7fbf4e59c640 1 -- 172.21.15.40:0/814680370 >> v1:172.21.15.69:6789/0 conn(0x7fbf500b3900 legacy=0x7fbf50148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.857+0000 7fbf4e59c640 1 -- 172.21.15.40:0/814680370 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5014b080 con 0x7fbf5006a470 2023-12-20T06:05:04.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.857+0000 7fbf4e59c640 1 --2- 172.21.15.40:0/814680370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500bb2b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbf500bcca0 tx=0x7fbf4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b00284962abac48 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf4dd9b640 1 -- 172.21.15.40:0/814680370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40031870 con 0x7fbf5006a470 2023-12-20T06:05:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf4dd9b640 1 -- 172.21.15.40:0/814680370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf400319d0 con 0x7fbf5006a470 2023-12-20T06:05:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf4dd9b640 1 -- 172.21.15.40:0/814680370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40031d60 con 0x7fbf5006a470 2023-12-20T06:05:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 -- 172.21.15.40:0/814680370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 msgr2=0x7fbf500bb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 --2- 172.21.15.40:0/814680370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500bb2b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fbf500bcca0 tx=0x7fbf4002b910 comp rx=0 tx=0).stop 2023-12-20T06:05:04.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 -- 172.21.15.40:0/814680370 shutdown_connections 2023-12-20T06:05:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 --2- 172.21.15.40:0/814680370 >> v2:172.21.15.69:3300/0 conn(0x7fbf5014abd0 0x7fbf50155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 --2- 172.21.15.40:0/814680370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500bb2b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 -- 172.21.15.40:0/814680370 >> 172.21.15.40:0/814680370 conn(0x7fbf500c0270 msgr2=0x7fbf500c0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 -- 172.21.15.40:0/814680370 shutdown_connections 2023-12-20T06:05:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.858+0000 7fbf54899640 1 -- 172.21.15.40:0/814680370 wait complete. 2023-12-20T06:05:04.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.859+0000 7fbf54899640 1 Processor -- start 2023-12-20T06:05:04.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.859+0000 7fbf54899640 1 -- start start 2023-12-20T06:05:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf54899640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf54899640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf500b3900 0x7fbf500b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf54899640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf5014abd0 0x7fbf500b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf54899640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50140d50 con 0x7fbf5006a470 2023-12-20T06:05:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf54899640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf500a5b40 con 0x7fbf5014abd0 2023-12-20T06:05:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf54899640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf501420a0 con 0x7fbf500b3900 2023-12-20T06:05:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500a5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55304/0 (socket says 172.21.15.40:55304) 2023-12-20T06:05:04.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 -- 172.21.15.40:0/4136454989 learned_addr learned my addr 172.21.15.40:0/4136454989 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4ed9d640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf5014abd0 0x7fbf500b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf47fff640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf500b3900 0x7fbf500b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 -- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf500b3900 msgr2=0x7fbf500b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf500b3900 0x7fbf500b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 -- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf5014abd0 msgr2=0x7fbf500b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:04.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf5014abd0 0x7fbf500b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.860+0000 7fbf4e59c640 1 -- 172.21.15.40:0/4136454989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400094d0 con 0x7fbf5006a470 2023-12-20T06:05:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.861+0000 7fbf4e59c640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500a5600 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fbf4002b950 tx=0x7fbf400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.861+0000 7fbf46ffd640 1 -- 172.21.15.40:0/4136454989 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf40031820 con 0x7fbf5006a470 2023-12-20T06:05:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.861+0000 7fbf46ffd640 1 -- 172.21.15.40:0/4136454989 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf400443f0 con 0x7fbf5006a470 2023-12-20T06:05:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.861+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf500ba510 con 0x7fbf5006a470 2023-12-20T06:05:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.861+0000 7fbf46ffd640 1 -- 172.21.15.40:0/4136454989 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf400447a0 con 0x7fbf5006a470 2023-12-20T06:05:04.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.861+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf500b9f50 con 0x7fbf5006a470 2023-12-20T06:05:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.862+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf50141a10 con 0x7fbf5006a470 2023-12-20T06:05:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.862+0000 7fbf46ffd640 1 -- 172.21.15.40:0/4136454989 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf4004d450 con 0x7fbf5006a470 2023-12-20T06:05:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.863+0000 7fbf46ffd640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf3006a430 0x7fbf3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.863+0000 7fbf46ffd640 1 -- 172.21.15.40:0/4136454989 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf4002d040 con 0x7fbf5006a470 2023-12-20T06:05:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.863+0000 7fbf47fff640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf3006a430 0x7fbf3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:04.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.863+0000 7fbf47fff640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf3006a430 0x7fbf3006c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf501e46f0 tx=0x7fbf38007e30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:04.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:04.867+0000 7fbf46ffd640 1 -- 172.21.15.40:0/4136454989 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbf40076640 con 0x7fbf5006a470 2023-12-20T06:05:05.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.041+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf500bfe80 con 0x7fbf3006a430 2023-12-20T06:05:05.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.042+0000 7fbf46ffd640 1 -- 172.21.15.40:0/4136454989 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf38003940 con 0x7fbf3006a430 2023-12-20T06:05:05.042 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 5 to deep-scrub 2023-12-20T06:05:05.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf3006a430 msgr2=0x7fbf3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf3006a430 0x7fbf3006c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbf501e46f0 tx=0x7fbf38007e30 comp rx=0 tx=0).stop 2023-12-20T06:05:05.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 msgr2=0x7fbf500a5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500a5600 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fbf4002b950 tx=0x7fbf400046c0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 shutdown_connections 2023-12-20T06:05:05.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fbf3006a430 0x7fbf3006c8f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf5014abd0 0x7fbf500b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fbf500b3900 0x7fbf500b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 --2- 172.21.15.40:0/4136454989 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbf5006a470 0x7fbf500a5600 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 >> 172.21.15.40:0/4136454989 conn(0x7fbf500c0270 msgr2=0x7fbf50147e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 shutdown_connections 2023-12-20T06:05:05.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.044+0000 7fbf54899640 1 -- 172.21.15.40:0/4136454989 wait complete. 2023-12-20T06:05:05.055 INFO:tasks.ceph:Scrubbing osd.6 2023-12-20T06:05:05.055 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:05.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.166+0000 7f873cea1640 1 Processor -- start 2023-12-20T06:05:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.167+0000 7f873cea1640 1 -- start start 2023-12-20T06:05:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.167+0000 7f873cea1640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f873814aec0 0x7f87380b9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.167+0000 7f873cea1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873814b980 con 0x7f87380bac80 2023-12-20T06:05:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.167+0000 7f873cea1640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873806a420 con 0x7f873814aac0 2023-12-20T06:05:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.167+0000 7f873cea1640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380bba70 con 0x7f873814aec0 2023-12-20T06:05:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.167+0000 7f873659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f87380bac80 0x7f87380bb060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52578/0 (socket says 172.21.15.40:52578) 2023-12-20T06:05:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.167+0000 7f873659c640 1 -- 172.21.15.40:0/2886292898 learned_addr learned my addr 172.21.15.40:0/2886292898 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8736d9d640 1 --2- 172.21.15.40:0/2886292898 >> v2:172.21.15.69:3300/0 conn(0x7f873814aec0 0x7f87380b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74376094 0 0) 0x7f873814b980 con 0x7f87380bac80 2023-12-20T06:05:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8724003520 con 0x7f87380bac80 2023-12-20T06:05:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 <== mon.1 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110277230 0 0) 0x7f873806a420 con 0x7f873814aac0 2023-12-20T06:05:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f873814b980 con 0x7f873814aac0 2023-12-20T06:05:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8736d9d640 1 -- 172.21.15.40:0/2886292898 >> v1:172.21.15.69:6789/0 conn(0x7f873814aac0 legacy=0x7f87380bf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8736d9d640 1 -- 172.21.15.40:0/2886292898 >> v1:172.21.15.40:6789/0 conn(0x7f87380bac80 legacy=0x7f87380bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3897313450 0 0) 0x7f8724003520 con 0x7f87380bac80 2023-12-20T06:05:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.168+0000 7f8736d9d640 1 -- 172.21.15.40:0/2886292898 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87380bc730 con 0x7f873814aec0 2023-12-20T06:05:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f8736d9d640 1 --2- 172.21.15.40:0/2886292898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873814aec0 0x7f87380b9720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8730009d90 tx=0x7f873002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51516e512cfeb06c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728001670 con 0x7f873814aec0 2023-12-20T06:05:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873002c940 con 0x7f873814aec0 2023-12-20T06:05:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f8735d9b640 1 -- 172.21.15.40:0/2886292898 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873002ccd0 con 0x7f873814aec0 2023-12-20T06:05:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f873cea1640 1 -- 172.21.15.40:0/2886292898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873814aec0 msgr2=0x7f87380b9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f873cea1640 1 --2- 172.21.15.40:0/2886292898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873814aec0 0x7f87380b9720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8730009d90 tx=0x7f873002be10 comp rx=0 tx=0).stop 2023-12-20T06:05:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f873cea1640 1 -- 172.21.15.40:0/2886292898 shutdown_connections 2023-12-20T06:05:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f873cea1640 1 --2- 172.21.15.40:0/2886292898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f873814aec0 0x7f87380b9720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f873cea1640 1 -- 172.21.15.40:0/2886292898 >> 172.21.15.40:0/2886292898 conn(0x7f87380c0300 msgr2=0x7f87380c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.169+0000 7f873cea1640 1 -- 172.21.15.40:0/2886292898 shutdown_connections 2023-12-20T06:05:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.170+0000 7f873cea1640 1 -- 172.21.15.40:0/2886292898 wait complete. 2023-12-20T06:05:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 Processor -- start 2023-12-20T06:05:05.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 -- start start 2023-12-20T06:05:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87380bac80 0x7f8738147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873814aac0 0x7f87380b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f873814aec0 0x7f8738149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380b5690 con 0x7f873814aac0 2023-12-20T06:05:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8738149a50 con 0x7f87380bac80 2023-12-20T06:05:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f873cea1640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380a6090 con 0x7f873814aec0 2023-12-20T06:05:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f872ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873814aac0 0x7f87380b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f872ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873814aac0 0x7f87380b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55308/0 (socket says 172.21.15.40:55308) 2023-12-20T06:05:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.171+0000 7f872ffff640 1 -- 172.21.15.40:0/3406924737 learned_addr learned my addr 172.21.15.40:0/3406924737 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f8736d9d640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f873814aec0 0x7f8738149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f873659c640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87380bac80 0x7f8738147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872ffff640 1 -- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f873814aec0 msgr2=0x7f8738149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872ffff640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f873814aec0 0x7f8738149510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872ffff640 1 -- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87380bac80 msgr2=0x7f8738147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872ffff640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87380bac80 0x7f8738147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872ffff640 1 -- 172.21.15.40:0/3406924737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8730009a70 con 0x7f873814aac0 2023-12-20T06:05:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872ffff640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873814aac0 0x7f87380b5150 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f872000c4c0 tx=0x7f872000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87200052d0 con 0x7f873814aac0 2023-12-20T06:05:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720005430 con 0x7f873814aac0 2023-12-20T06:05:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87381477d0 con 0x7f873814aac0 2023-12-20T06:05:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720012870 con 0x7f873814aac0 2023-12-20T06:05:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.172+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87380b3e30 con 0x7f873814aac0 2023-12-20T06:05:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.173+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f873814b6a0 con 0x7f873814aac0 2023-12-20T06:05:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87200129d0 con 0x7f873814aac0 2023-12-20T06:05:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f872effd640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f871806a430 0x7f871806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8720087ff0 con 0x7f873814aac0 2023-12-20T06:05:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f872effd640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f8718070290 0x7f87180726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 --> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8718072d60 con 0x7f8718070290 2023-12-20T06:05:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f872008a6b0 con 0x7f873814aac0 2023-12-20T06:05:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f873659c640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f871806a430 0x7f871806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.174+0000 7f8736d9d640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f8718070290 0x7f87180726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.175+0000 7f873659c640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f871806a430 0x7f871806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8728000f60 tx=0x7f87280016b0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.175+0000 7f8736d9d640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f8718070290 0x7f87180726b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.176+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== osd.6 v2:172.21.15.69:6800/89420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8718072d60 con 0x7f8718070290 2023-12-20T06:05:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.188+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 --> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f873814b3c0 con 0x7f8718070290 2023-12-20T06:05:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f872effd640 1 -- 172.21.15.40:0/3406924737 <== osd.6 v2:172.21.15.69:6800/89420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f873002cab0 con 0x7f8718070290 2023-12-20T06:05:05.189 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:05.189 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:05.189 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:05.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f8718070290 msgr2=0x7f87180726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6800/89420,v1:172.21.15.69:6801/89420] conn(0x7f8718070290 0x7f87180726b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f871806a430 msgr2=0x7f871806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f871806a430 0x7f871806c8f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8728000f60 tx=0x7f87280016b0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873814aac0 msgr2=0x7f87380b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 --2- 172.21.15.40:0/3406924737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f873814aac0 0x7f87380b5150 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f872000c4c0 tx=0x7f872000c980 comp rx=0 tx=0).stop 2023-12-20T06:05:05.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f8736d9d640 1 -- 172.21.15.40:0/3406924737 reap_dead start 2023-12-20T06:05:05.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 shutdown_connections 2023-12-20T06:05:05.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 >> 172.21.15.40:0/3406924737 conn(0x7f87380c0300 msgr2=0x7f87380be920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 shutdown_connections 2023-12-20T06:05:05.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.189+0000 7f873cea1640 1 -- 172.21.15.40:0/3406924737 wait complete. 2023-12-20T06:05:05.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-20T06:05:05.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.307+0000 7fd0bfe0b640 1 Processor -- start 2023-12-20T06:05:05.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.307+0000 7fd0bfe0b640 1 -- start start 2023-12-20T06:05:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bfe0b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b80b7d00 0x7fd0b80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bfe0b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0b81488c0 0x7fd0b8070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bfe0b640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd0b8148ce0 0x7fd0b814be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bfe0b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80b44f0 con 0x7fd0b81488c0 2023-12-20T06:05:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bfe0b640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80b3c80 con 0x7fd0b8148ce0 2023-12-20T06:05:05.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bfe0b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80b80e0 con 0x7fd0b80b7d00 2023-12-20T06:05:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0b81488c0 0x7fd0b8070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0b81488c0 0x7fd0b8070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55324/0 (socket says 172.21.15.40:55324) 2023-12-20T06:05:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 -- 172.21.15.40:0/956299936 learned_addr learned my addr 172.21.15.40:0/956299936 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0be3a8640 1 --2- 172.21.15.40:0/956299936 >> v2:172.21.15.69:3300/0 conn(0x7fd0b8148ce0 0x7fd0b814be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bdba7640 1 --2- 172.21.15.40:0/956299936 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b80b7d00 0x7fd0b80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 -- 172.21.15.40:0/956299936 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b80b7d00 msgr2=0x7fd0b80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:05.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 --2- 172.21.15.40:0/956299936 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b80b7d00 0x7fd0b80b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 -- 172.21.15.40:0/956299936 >> v2:172.21.15.69:3300/0 conn(0x7fd0b8148ce0 msgr2=0x7fd0b814be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 --2- 172.21.15.40:0/956299936 >> v2:172.21.15.69:3300/0 conn(0x7fd0b8148ce0 0x7fd0b814be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.308+0000 7fd0bd3a6640 1 -- 172.21.15.40:0/956299936 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80b5640 con 0x7fd0b81488c0 2023-12-20T06:05:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.309+0000 7fd0bd3a6640 1 --2- 172.21.15.40:0/956299936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81488c0 0x7fd0b8070d60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd0b806e910 tx=0x7fd0a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8800b5f5b02843 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.309+0000 7fd0bcba5640 1 -- 172.21.15.40:0/956299936 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8031870 con 0x7fd0b81488c0 2023-12-20T06:05:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.309+0000 7fd0bcba5640 1 -- 172.21.15.40:0/956299936 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a80319d0 con 0x7fd0b81488c0 2023-12-20T06:05:05.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.309+0000 7fd0bcba5640 1 -- 172.21.15.40:0/956299936 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8031d60 con 0x7fd0b81488c0 2023-12-20T06:05:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/956299936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81488c0 msgr2=0x7fd0b8070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/956299936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81488c0 0x7fd0b8070d60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd0b806e910 tx=0x7fd0a802b910 comp rx=0 tx=0).stop 2023-12-20T06:05:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/956299936 shutdown_connections 2023-12-20T06:05:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/956299936 >> v2:172.21.15.69:3300/0 conn(0x7fd0b8148ce0 0x7fd0b814be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/956299936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b81488c0 0x7fd0b8070d60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/956299936 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b80b7d00 0x7fd0b80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/956299936 >> 172.21.15.40:0/956299936 conn(0x7fd0b80bc220 msgr2=0x7fd0b80bc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/956299936 shutdown_connections 2023-12-20T06:05:05.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.310+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/956299936 wait complete. 2023-12-20T06:05:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 Processor -- start 2023-12-20T06:05:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 -- start start 2023-12-20T06:05:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0b80b7d00 0x7fd0b8070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b81488c0 0x7fd0b806f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b8148ce0 0x7fd0b806fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b8070ba0 con 0x7fd0b8148ce0 2023-12-20T06:05:05.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b814bb50 con 0x7fd0b80b7d00 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0bfe0b640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b814bdf0 con 0x7fd0b81488c0 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.311+0000 7fd0be3a8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b8148ce0 0x7fd0b806fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b8148ce0 0x7fd0b806fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55340/0 (socket says 172.21.15.40:55340) 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 -- 172.21.15.40:0/2028751667 learned_addr learned my addr 172.21.15.40:0/2028751667 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0bdba7640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0b80b7d00 0x7fd0b8070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0bd3a6640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b81488c0 0x7fd0b806f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 -- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b81488c0 msgr2=0x7fd0b806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b81488c0 0x7fd0b806f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 -- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0b80b7d00 msgr2=0x7fd0b8070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0b80b7d00 0x7fd0b8070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 -- 172.21.15.40:0/2028751667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80094d0 con 0x7fd0b8148ce0 2023-12-20T06:05:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0be3a8640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b8148ce0 0x7fd0b806fa70 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0007e30 tx=0x7fd0b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0ae7fc640 1 -- 172.21.15.40:0/2028751667 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0014620 con 0x7fd0b8148ce0 2023-12-20T06:05:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0ae7fc640 1 -- 172.21.15.40:0/2028751667 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b000ee90 con 0x7fd0b8148ce0 2023-12-20T06:05:05.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b814a6b0 con 0x7fd0b8148ce0 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0ae7fc640 1 -- 172.21.15.40:0/2028751667 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00149c0 con 0x7fd0b8148ce0 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.312+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b814c140 con 0x7fd0b8148ce0 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.313+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b814c5b0 con 0x7fd0b8148ce0 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.314+0000 7fd0ae7fc640 1 -- 172.21.15.40:0/2028751667 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd0b0014b20 con 0x7fd0b8148ce0 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.314+0000 7fd0ae7fc640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd09c06a430 0x7fd09c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.314+0000 7fd0ae7fc640 1 -- 172.21.15.40:0/2028751667 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd0b0088e10 con 0x7fd0b8148ce0 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.314+0000 7fd0bdba7640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd09c06a430 0x7fd09c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.315+0000 7fd0bdba7640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd09c06a430 0x7fd09c06c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40079a0 tx=0x7fd0b4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.318+0000 7fd0ae7fc640 1 -- 172.21.15.40:0/2028751667 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd0b814c5b0 con 0x7fd0b8148ce0 2023-12-20T06:05:05.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.494+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0b80b5c00 con 0x7fd09c06a430 2023-12-20T06:05:05.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.495+0000 7fd0ae7fc640 1 -- 172.21.15.40:0/2028751667 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd0b40108d0 con 0x7fd09c06a430 2023-12-20T06:05:05.496 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 6 to deep-scrub 2023-12-20T06:05:05.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd09c06a430 msgr2=0x7fd09c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd09c06a430 0x7fd09c06c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40079a0 tx=0x7fd0b4008040 comp rx=0 tx=0).stop 2023-12-20T06:05:05.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b8148ce0 msgr2=0x7fd0b806fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b8148ce0 0x7fd0b806fa70 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0007e30 tx=0x7fd0b000e4b0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 shutdown_connections 2023-12-20T06:05:05.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7fd09c06a430 0x7fd09c06c8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0b8148ce0 0x7fd0b806fa70 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7fd0b81488c0 0x7fd0b806f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 --2- 172.21.15.40:0/2028751667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0b80b7d00 0x7fd0b8070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 >> 172.21.15.40:0/2028751667 conn(0x7fd0b80bc220 msgr2=0x7fd0b8147180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 shutdown_connections 2023-12-20T06:05:05.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.497+0000 7fd0bfe0b640 1 -- 172.21.15.40:0/2028751667 wait complete. 2023-12-20T06:05:05.508 INFO:tasks.ceph:Scrubbing osd.7 2023-12-20T06:05:05.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-20T06:05:05.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.619+0000 7f633462c640 1 Processor -- start 2023-12-20T06:05:05.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.619+0000 7f633462c640 1 -- start start 2023-12-20T06:05:05.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.619+0000 7f633462c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f632c0b79a0 0x7f632c0bc660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.619+0000 7f633462c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c14b460 0x7f632c0b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.619+0000 7f633462c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632c0b8ba0 con 0x7f632c0b64a0 2023-12-20T06:05:05.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.619+0000 7f633462c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c06cd70 con 0x7f632c0b79a0 2023-12-20T06:05:05.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.619+0000 7f633462c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0b8e80 con 0x7f632c14b460 2023-12-20T06:05:05.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f63323c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f632c0b79a0 0x7f632c0bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f6331bc7640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f632c0b64a0 0x7f632c14ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43614/0 (socket says 172.21.15.40:43614) 2023-12-20T06:05:05.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f6331bc7640 1 -- 172.21.15.40:0/2872465846 learned_addr learned my addr 172.21.15.40:0/2872465846 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:05.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f6332bc9640 1 --2- 172.21.15.40:0/2872465846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c14b460 0x7f632c0b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f63323c8640 1 -- 172.21.15.40:0/2872465846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c14b460 msgr2=0x7f632c0b68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:05.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f63323c8640 1 --2- 172.21.15.40:0/2872465846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c14b460 0x7f632c0b68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f63323c8640 1 -- 172.21.15.40:0/2872465846 >> v1:172.21.15.40:6789/0 conn(0x7f632c0b64a0 legacy=0x7f632c14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f63323c8640 1 -- 172.21.15.40:0/2872465846 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0b9160 con 0x7f632c0b79a0 2023-12-20T06:05:05.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.620+0000 7f63313c6640 1 -- 172.21.15.40:0/2872465846 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723395586 0 0) 0x7f632c0b8ba0 con 0x7f632c0b64a0 2023-12-20T06:05:05.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f63323c8640 1 --2- 172.21.15.40:0/2872465846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c0b79a0 0x7f632c0bc660 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f63280097a0 tx=0x7f632802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754a2505586244a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f63313c6640 1 -- 172.21.15.40:0/2872465846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328030610 con 0x7f632c0b79a0 2023-12-20T06:05:05.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f63313c6640 1 -- 172.21.15.40:0/2872465846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6328030770 con 0x7f632c0b79a0 2023-12-20T06:05:05.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f63313c6640 1 -- 172.21.15.40:0/2872465846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328030b00 con 0x7f632c0b79a0 2023-12-20T06:05:05.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 -- 172.21.15.40:0/2872465846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c0b79a0 msgr2=0x7f632c0bc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 --2- 172.21.15.40:0/2872465846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c0b79a0 0x7f632c0bc660 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f63280097a0 tx=0x7f632802b960 comp rx=0 tx=0).stop 2023-12-20T06:05:05.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 -- 172.21.15.40:0/2872465846 shutdown_connections 2023-12-20T06:05:05.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 --2- 172.21.15.40:0/2872465846 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c14b460 0x7f632c0b68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 --2- 172.21.15.40:0/2872465846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c0b79a0 0x7f632c0bc660 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 -- 172.21.15.40:0/2872465846 >> 172.21.15.40:0/2872465846 conn(0x7f632c0c0330 msgr2=0x7f632c0c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 -- 172.21.15.40:0/2872465846 shutdown_connections 2023-12-20T06:05:05.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.621+0000 7f633462c640 1 -- 172.21.15.40:0/2872465846 wait complete. 2023-12-20T06:05:05.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.622+0000 7f633462c640 1 Processor -- start 2023-12-20T06:05:05.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f633462c640 1 -- start start 2023-12-20T06:05:05.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f633462c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c0b64a0 0x7f632c1df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f633462c640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c0b79a0 0x7f632c0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f633462c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c14b460 0x7f632c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f633462c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c14c560 con 0x7f632c14b460 2023-12-20T06:05:05.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f633462c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c14df20 con 0x7f632c0b64a0 2023-12-20T06:05:05.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f633462c640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632c14e200 con 0x7f632c0b79a0 2023-12-20T06:05:05.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f6332bc9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c14b460 0x7f632c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f6332bc9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c14b460 0x7f632c0ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45838/0 (socket says 172.21.15.40:45838) 2023-12-20T06:05:05.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f6332bc9640 1 -- 172.21.15.40:0/3804957584 learned_addr learned my addr 172.21.15.40:0/3804957584 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:05.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f6331bc7640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c0b79a0 0x7f632c0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.623+0000 7f63323c8640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c0b64a0 0x7f632c1df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6332bc9640 1 -- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c0b79a0 msgr2=0x7f632c0b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6332bc9640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f632c0b79a0 0x7f632c0b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6332bc9640 1 -- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c0b64a0 msgr2=0x7f632c1df9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6332bc9640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c0b64a0 0x7f632c1df9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6332bc9640 1 -- 172.21.15.40:0/3804957584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6328009400 con 0x7f632c14b460 2023-12-20T06:05:05.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6332bc9640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c14b460 0x7f632c0ae880 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f632400efc0 tx=0x7f632400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324009ba0 con 0x7f632c14b460 2023-12-20T06:05:05.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632400f040 con 0x7f632c14b460 2023-12-20T06:05:05.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240146c0 con 0x7f632c14b460 2023-12-20T06:05:05.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c14ec30 con 0x7f632c14b460 2023-12-20T06:05:05.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.624+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c14e720 con 0x7f632c14b460 2023-12-20T06:05:05.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.625+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f632c14ddb0 con 0x7f632c14b460 2023-12-20T06:05:05.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.625+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6324014820 con 0x7f632c14b460 2023-12-20T06:05:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f6322ffd640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f631006a430 0x7f631006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f63240891b0 con 0x7f632c14b460 2023-12-20T06:05:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f6322ffd640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f6310070290 0x7f63100726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 --> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6310072d60 con 0x7f6310070290 2023-12-20T06:05:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f632408b870 con 0x7f632c14b460 2023-12-20T06:05:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f63323c8640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f631006a430 0x7f631006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f6331bc7640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f6310070290 0x7f63100726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.626+0000 7f63323c8640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f631006a430 0x7f631006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6328036000 tx=0x7f6328008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.627+0000 7f6331bc7640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f6310070290 0x7f63100726b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.627+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== osd.7 v2:172.21.15.69:6816/89432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6310072d60 con 0x7f6310070290 2023-12-20T06:05:05.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.640+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 --> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f632c0b7d80 con 0x7f6310070290 2023-12-20T06:05:05.640 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.640+0000 7f6322ffd640 1 -- 172.21.15.40:0/3804957584 <== osd.7 v2:172.21.15.69:6816/89432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f631c0018b0 con 0x7f6310070290 2023-12-20T06:05:05.641 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-12-20T06:05:05.641 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-20T06:05:05.641 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-12-20T06:05:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f6310070290 msgr2=0x7f63100726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.642 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6816/89432,v1:172.21.15.69:6817/89432] conn(0x7f6310070290 0x7f63100726b0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f631006a430 msgr2=0x7f631006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f631006a430 0x7f631006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6328036000 tx=0x7f6328008030 comp rx=0 tx=0).stop 2023-12-20T06:05:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c14b460 msgr2=0x7f632c0ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 --2- 172.21.15.40:0/3804957584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f632c14b460 0x7f632c0ae880 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f632400efc0 tx=0x7f632400c490 comp rx=0 tx=0).stop 2023-12-20T06:05:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f6332bc9640 1 -- 172.21.15.40:0/3804957584 reap_dead start 2023-12-20T06:05:05.643 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 shutdown_connections 2023-12-20T06:05:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 >> 172.21.15.40:0/3804957584 conn(0x7f632c0c0330 msgr2=0x7f632c149260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 shutdown_connections 2023-12-20T06:05:05.644 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.641+0000 7f633462c640 1 -- 172.21.15.40:0/3804957584 wait complete. 2023-12-20T06:05:05.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-20T06:05:05.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.758+0000 7f74374f3640 1 Processor -- start 2023-12-20T06:05:05.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.758+0000 7f74374f3640 1 -- start start 2023-12-20T06:05:05.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f74374f3640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f74300b6860 0x7f74300710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f74374f3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7430071630 0x7f7430142780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f74374f3640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7430070670 con 0x7f7430142cc0 2023-12-20T06:05:05.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f74374f3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743006a910 con 0x7f7430071630 2023-12-20T06:05:05.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f74374f3640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743006fd40 con 0x7f74300b6860 2023-12-20T06:05:05.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f7434a8e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7430071630 0x7f7430142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f7434a8e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7430071630 0x7f7430142780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45844/0 (socket says 172.21.15.40:45844) 2023-12-20T06:05:05.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f7434a8e640 1 -- 172.21.15.40:0/817962505 learned_addr learned my addr 172.21.15.40:0/817962505 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f7434a8e640 1 -- 172.21.15.40:0/817962505 >> v2:172.21.15.69:3300/0 conn(0x7f74300b6860 msgr2=0x7f74300710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f7434a8e640 1 --2- 172.21.15.40:0/817962505 >> v2:172.21.15.69:3300/0 conn(0x7f74300b6860 0x7f74300710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f7434a8e640 1 -- 172.21.15.40:0/817962505 >> v1:172.21.15.69:6789/0 conn(0x7f7430142cc0 legacy=0x7f7430148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.759+0000 7f7434a8e640 1 -- 172.21.15.40:0/817962505 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7430070020 con 0x7f7430071630 2023-12-20T06:05:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.760+0000 7f7434a8e640 1 --2- 172.21.15.40:0/817962505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f7430142780 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f74300baa70 tx=0x7f742402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2066c883f67fcc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.760+0000 7f742ffff640 1 -- 172.21.15.40:0/817962505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424031870 con 0x7f7430071630 2023-12-20T06:05:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.760+0000 7f742ffff640 1 -- 172.21.15.40:0/817962505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74240319d0 con 0x7f7430071630 2023-12-20T06:05:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.760+0000 7f742ffff640 1 -- 172.21.15.40:0/817962505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7424031d60 con 0x7f7430071630 2023-12-20T06:05:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 -- 172.21.15.40:0/817962505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 msgr2=0x7f7430142780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 --2- 172.21.15.40:0/817962505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f7430142780 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f74300baa70 tx=0x7f742402b910 comp rx=0 tx=0).stop 2023-12-20T06:05:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 -- 172.21.15.40:0/817962505 shutdown_connections 2023-12-20T06:05:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 --2- 172.21.15.40:0/817962505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f7430142780 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 --2- 172.21.15.40:0/817962505 >> v2:172.21.15.69:3300/0 conn(0x7f74300b6860 0x7f74300710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 -- 172.21.15.40:0/817962505 >> 172.21.15.40:0/817962505 conn(0x7f74300bcf60 msgr2=0x7f74300bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 -- 172.21.15.40:0/817962505 shutdown_connections 2023-12-20T06:05:05.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.761+0000 7f74374f3640 1 -- 172.21.15.40:0/817962505 wait complete. 2023-12-20T06:05:05.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.762+0000 7f74374f3640 1 Processor -- start 2023-12-20T06:05:05.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.762+0000 7f74374f3640 1 -- start start 2023-12-20T06:05:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f74374f3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f74301414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f74374f3640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74300b6860 0x7f743013f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f74374f3640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7430142cc0 0x7f743013feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f74374f3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7430141a10 con 0x7f7430071630 2023-12-20T06:05:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f74374f3640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7430143f50 con 0x7f7430142cc0 2023-12-20T06:05:05.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f74374f3640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74301e00d0 con 0x7f74300b6860 2023-12-20T06:05:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f74301414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f74301414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45848/0 (socket says 172.21.15.40:45848) 2023-12-20T06:05:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 -- 172.21.15.40:0/3484873842 learned_addr learned my addr 172.21.15.40:0/3484873842 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f7434a8e640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74300b6860 0x7f743013f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 -- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74300b6860 msgr2=0x7f743013f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74300b6860 0x7f743013f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f7435a90640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7430142cc0 0x7f743013feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 -- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7430142cc0 msgr2=0x7f743013feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7430142cc0 0x7f743013feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 -- 172.21.15.40:0/3484873842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240094d0 con 0x7f7430071630 2023-12-20T06:05:05.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f743528f640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f74301414d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f742800b4a0 tx=0x7f742800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f742dffb640 1 -- 172.21.15.40:0/3484873842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428010610 con 0x7f7430071630 2023-12-20T06:05:05.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f742dffb640 1 -- 172.21.15.40:0/3484873842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428010770 con 0x7f7430071630 2023-12-20T06:05:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74301e03b0 con 0x7f7430071630 2023-12-20T06:05:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.763+0000 7f742dffb640 1 -- 172.21.15.40:0/3484873842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428010b20 con 0x7f7430071630 2023-12-20T06:05:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.764+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74301e0970 con 0x7f7430071630 2023-12-20T06:05:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.765+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743004e840 con 0x7f7430071630 2023-12-20T06:05:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.765+0000 7f742dffb640 1 -- 172.21.15.40:0/3484873842 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7428010c80 con 0x7f7430071630 2023-12-20T06:05:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.765+0000 7f742dffb640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f741c06a460 0x7f741c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:05.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.766+0000 7f742dffb640 1 -- 172.21.15.40:0/3484873842 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7428088230 con 0x7f7430071630 2023-12-20T06:05:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.766+0000 7f7434a8e640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f741c06a460 0x7f741c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.766+0000 7f7434a8e640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f741c06a460 0x7f741c06c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7424036000 tx=0x7f742403c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:05.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.770+0000 7f742dffb640 1 -- 172.21.15.40:0/3484873842 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7428053b20 con 0x7f7430071630 2023-12-20T06:05:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.945+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f74300b6c40 con 0x7f741c06a460 2023-12-20T06:05:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.946+0000 7f742dffb640 1 -- 172.21.15.40:0/3484873842 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7424031d10 con 0x7f741c06a460 2023-12-20T06:05:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 7 to deep-scrub 2023-12-20T06:05:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f741c06a460 msgr2=0x7f741c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f741c06a460 0x7f741c06c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7424036000 tx=0x7f742403c040 comp rx=0 tx=0).stop 2023-12-20T06:05:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 msgr2=0x7f74301414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f74301414d0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f742800b4a0 tx=0x7f742800b960 comp rx=0 tx=0).stop 2023-12-20T06:05:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 shutdown_connections 2023-12-20T06:05:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f741c06a460 0x7f741c06c920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7430142cc0 0x7f743013feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f74300b6860 0x7f743013f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 --2- 172.21.15.40:0/3484873842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7430071630 0x7f74301414d0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 >> 172.21.15.40:0/3484873842 conn(0x7f74300bcf60 msgr2=0x7f743013adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 shutdown_connections 2023-12-20T06:05:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:05.947+0000 7f74374f3640 1 -- 172.21.15.40:0/3484873842 wait complete. 2023-12-20T06:05:05.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T06:05:06.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.065+0000 7f4612bab640 1 Processor -- start 2023-12-20T06:05:06.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.065+0000 7f4612bab640 1 -- start start 2023-12-20T06:05:06.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4612bab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c144da0 0x7f460c06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4612bab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f460c070960 0x7f460c1552f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4612bab640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460c0b88a0 con 0x7f460c071960 2023-12-20T06:05:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4612bab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460c06df60 con 0x7f460c070960 2023-12-20T06:05:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4612bab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c070170 con 0x7f460c144da0 2023-12-20T06:05:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4611148640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f460c070960 0x7f460c1552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4611148640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f460c070960 0x7f460c1552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45862/0 (socket says 172.21.15.40:45862) 2023-12-20T06:05:06.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4611148640 1 -- 172.21.15.40:0/836469964 learned_addr learned my addr 172.21.15.40:0/836469964 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4610947640 1 --2- 172.21.15.40:0/836469964 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c144da0 0x7f460c06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4611148640 1 -- 172.21.15.40:0/836469964 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c144da0 msgr2=0x7f460c06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4611148640 1 --2- 172.21.15.40:0/836469964 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c144da0 0x7f460c06fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4611148640 1 -- 172.21.15.40:0/836469964 >> v1:172.21.15.69:6789/0 conn(0x7f460c071960 legacy=0x7f460c06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.066+0000 7f4611148640 1 -- 172.21.15.40:0/836469964 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460c145180 con 0x7f460c070960 2023-12-20T06:05:06.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.067+0000 7f4611148640 1 --2- 172.21.15.40:0/836469964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c070960 0x7f460c1552f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009850 tx=0x7f45f402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50747602da0efefe server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.067+0000 7f460b7fe640 1 -- 172.21.15.40:0/836469964 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f402f810 con 0x7f460c070960 2023-12-20T06:05:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.067+0000 7f460b7fe640 1 -- 172.21.15.40:0/836469964 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f402f970 con 0x7f460c070960 2023-12-20T06:05:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.067+0000 7f460b7fe640 1 -- 172.21.15.40:0/836469964 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f402fd00 con 0x7f460c070960 2023-12-20T06:05:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 -- 172.21.15.40:0/836469964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c070960 msgr2=0x7f460c1552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 --2- 172.21.15.40:0/836469964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c070960 0x7f460c1552f0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009850 tx=0x7f45f402b9f0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 -- 172.21.15.40:0/836469964 shutdown_connections 2023-12-20T06:05:06.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 --2- 172.21.15.40:0/836469964 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c070960 0x7f460c1552f0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 --2- 172.21.15.40:0/836469964 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c144da0 0x7f460c06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 -- 172.21.15.40:0/836469964 >> 172.21.15.40:0/836469964 conn(0x7f460c0b99b0 msgr2=0x7f460c0b9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 -- 172.21.15.40:0/836469964 shutdown_connections 2023-12-20T06:05:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.068+0000 7f4612bab640 1 -- 172.21.15.40:0/836469964 wait complete. 2023-12-20T06:05:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.069+0000 7f4612bab640 1 Processor -- start 2023-12-20T06:05:06.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.069+0000 7f4612bab640 1 -- start start 2023-12-20T06:05:06.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c070960 0x7f460c14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:06.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c071960 0x7f460c0bc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:06.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f460c144da0 0x7f460c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:06.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c0bc5d0 con 0x7f460c071960 2023-12-20T06:05:06.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460c13f040 con 0x7f460c144da0 2023-12-20T06:05:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460c14e320 con 0x7f460c070960 2023-12-20T06:05:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c071960 0x7f460c0bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4610947640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c070960 0x7f460c14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c071960 0x7f460c0bc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45866/0 (socket says 172.21.15.40:45866) 2023-12-20T06:05:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 -- 172.21.15.40:0/308114946 learned_addr learned my addr 172.21.15.40:0/308114946 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4611148640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f460c144da0 0x7f460c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:06.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 -- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c070960 msgr2=0x7f460c14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c070960 0x7f460c14d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 -- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f460c144da0 msgr2=0x7f460c14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f460c144da0 0x7f460c14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 -- 172.21.15.40:0/308114946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40094b0 con 0x7f460c071960 2023-12-20T06:05:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f460bfff640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c071960 0x7f460c0bc090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00c7a0 tx=0x7f45fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f46097fa640 1 -- 172.21.15.40:0/308114946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc003b70 con 0x7f460c071960 2023-12-20T06:05:06.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f46097fa640 1 -- 172.21.15.40:0/308114946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45fc003cd0 con 0x7f460c071960 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460c13f290 con 0x7f460c071960 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f46097fa640 1 -- 172.21.15.40:0/308114946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00aa90 con 0x7f460c071960 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.070+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460c0bc940 con 0x7f460c071960 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.072+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460c14e820 con 0x7f460c071960 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.072+0000 7f46097fa640 1 -- 172.21.15.40:0/308114946 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f45fc00abf0 con 0x7f460c071960 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.072+0000 7f46097fa640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f45ec06a430 0x7f45ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.072+0000 7f46097fa640 1 -- 172.21.15.40:0/308114946 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f45fc0882d0 con 0x7f460c071960 2023-12-20T06:05:06.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.073+0000 7f4610947640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f45ec06a430 0x7f45ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:06.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.073+0000 7f4610947640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f45ec06a430 0x7f45ec06c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f46040079a0 tx=0x7f4604008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:06.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.077+0000 7f46097fa640 1 -- 172.21.15.40:0/308114946 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f460c14e820 con 0x7f460c071960 2023-12-20T06:05:06.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.249+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f460c0b8dd0 con 0x7f45ec06a430 2023-12-20T06:05:06.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.251+0000 7f46097fa640 1 -- 172.21.15.40:0/308114946 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50572 (secure 0 0 0) 0x7f46040108d0 con 0x7f45ec06a430 2023-12-20T06:05:06.253 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:05:06.254 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T06:05:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f45ec06a430 msgr2=0x7f45ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:06.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f45ec06a430 0x7f45ec06c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f46040079a0 tx=0x7f4604008040 comp rx=0 tx=0).stop 2023-12-20T06:05:06.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c071960 msgr2=0x7f460c0bc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:06.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c071960 0x7f460c0bc090 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00c7a0 tx=0x7f45fc00cc60 comp rx=0 tx=0).stop 2023-12-20T06:05:06.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 shutdown_connections 2023-12-20T06:05:06.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f45ec06a430 0x7f45ec06c8f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f460c144da0 0x7f460c14bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f460c071960 0x7f460c0bc090 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 --2- 172.21.15.40:0/308114946 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f460c070960 0x7f460c14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:06.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 >> 172.21.15.40:0/308114946 conn(0x7f460c0b99b0 msgr2=0x7f460c1427a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:06.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 shutdown_connections 2023-12-20T06:05:06.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:06.253+0000 7f4612bab640 1 -- 172.21.15.40:0/308114946 wait complete. 2023-12-20T06:05:06.264 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":3082,"stamp":"2023-12-20T06:05:06.068973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":7516872,"kb_used_data":4232,"kb_used_omap":528,"kb_used_meta":7512047,"kb_avail":747457848,"statfs":{"total":773094113280,"available":765396836352,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540840,"internal_metadata":7692336984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":100,"apply_latency_ms":100,"commit_latency_ns":100000000,"apply_latency_ns":100000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-529797120,"num_objects":-1351,"num_object_clones":0,"num_object_copies":-2702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1351,"num_whiteouts":0,"num_read":-64437,"num_read_kb":-54193444,"num_write":-2072272,"num_write_kb":-60103348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.675138"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T06:04:57.993136+0000","last_change":"2023-12-20T04:23:15.831465+0000","last_active":"2023-12-20T06:04:57.993136+0000","last_peered":"2023-12-20T06:04:57.993136+0000","last_clean":"2023-12-20T06:04:57.993136+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T06:04:57.993136+0000","last_undegraded":"2023-12-20T06:04:57.993136+0000","last_fullsized":"2023-12-20T06:04:57.993136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:23:14.585040+0000","last_clean_scrub_stamp":"2023-12-20T04:23:14.585040+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:18:30.961488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576070,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376396,"kb_used_data":964,"kb_used_omap":7,"kb_used_meta":375416,"kb_avail":93995444,"statfs":{"total":96636764160,"available":96251334656,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7431,"internal_metadata":384426745},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.48299999999999998,"15min":0.46700000000000003},"min":{"1min":0.247,"5min":0.23999999999999999,"15min":0.22600000000000001},"max":{"1min":4.907,"5min":4.907,"15min":4.907},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28199999999999997,"15min":0.27000000000000002},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":2.012},"last":0.45200000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.46999999999999997,"15min":0.50600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59599999999999997,"5min":0.69999999999999996,"15min":9.5289999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.436,"5min":0.48899999999999999,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.68000000000000005,"5min":0.749,"15min":8.484},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52600000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":4.5300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":3.2490000000000001,"5min":3.2490000000000001,"15min":3.2490000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.30599999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":2.3220000000000001},"last":0.505},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.29999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.85399999999999998},"last":0.54900000000000004}]},{"osd":4,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.502,"15min":0.502},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":2.0699999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":0.75,"5min":0.75900000000000001,"15min":2.3530000000000002},"last":0.38900000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.56000000000000005,"15min":0.56699999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.28699999999999998},"max":{"1min":0.76800000000000002,"5min":0.82699999999999996,"15min":4.5620000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.248},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":2.0899999999999999},"last":0.377}]},{"osd":6,"last update":"Wed Dec 20 06:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58699999999999997,"15min":0.59199999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28399999999999997},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":2.0470000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.58599999999999997,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.32500000000000001},"max":{"1min":0.68100000000000005,"5min":0.80600000000000005,"15min":0.91900000000000004},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834576073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1417480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1417088,"kb_avail":92954360,"statfs":{"total":96636764160,"available":95185264640,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1451098112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.47799999999999998,"15min":0.56299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.496,"5min":2.6779999999999999,"15min":10.500999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.47199999999999998,"15min":0.52300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":3.6699999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84999999999999998,"5min":2.6509999999999998,"15min":4.399},"last":0.441},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.47999999999999998,"15min":0.63200000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.72699999999999998,"15min":12.664},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.57399999999999995,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27000000000000002},"max":{"1min":1.0860000000000001,"5min":8.3829999999999991,"15min":10.188000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.624},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78700000000000003,"5min":7.202,"15min":7.202},"last":0.56899999999999995}]},{"osd":3,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.318},"max":{"1min":0.88100000000000001,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.439,"5min":0.55900000000000005,"15min":0.624},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.61199999999999999,"5min":3.5539999999999998,"15min":10.236000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52300000000000002,"15min":0.60099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65000000000000002,"5min":2.621,"15min":15.074},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.55300000000000005,"15min":0.63400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":2.383,"15min":20.684999999999999},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51200000000000001,"15min":0.58199999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.308},"max":{"1min":0.56699999999999995,"5min":0.80900000000000005,"15min":10.15},"last":0.629},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.58899999999999997,"15min":0.64500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":2.5830000000000002,"15min":7.9400000000000004},"last":0.66600000000000004}]},{"osd":7,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.59099999999999997,"15min":0.621},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":2.5550000000000002,"15min":7.0839999999999996},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.57599999999999996,"15min":0.64100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63,"5min":0.97299999999999998,"15min":10.212999999999999},"last":0.71299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834576072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":709000,"kb_used_data":384,"kb_used_omap":30,"kb_used_meta":708577,"kb_avail":93662840,"statfs":{"total":96636764160,"available":95910748160,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":725583410},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":0.627,"5min":0.69499999999999995,"15min":0.69599999999999995},"last":0.372},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.52800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":8.2260000000000009},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.57099999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.69099999999999995,"5min":0.72499999999999998,"15min":13.317},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":14.054},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.54000000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":12.787000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1890000000000001,"5min":3.9239999999999999,"15min":8.4290000000000003},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.63300000000000001,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":9.1329999999999991,"15min":18.420999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78400000000000003,"15min":0.70999999999999996},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.67500000000000004,"5min":21.369,"15min":21.369},"last":0.46000000000000002}]},{"osd":4,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46500000000000002,"15min":0.51000000000000001},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58999999999999997,"5min":0.73899999999999999,"15min":3.0630000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.50600000000000001,"15min":0.66800000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57499999999999996,"5min":0.77900000000000003,"15min":24.158999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.51600000000000001,"15min":0.59099999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67900000000000005,"5min":0.75700000000000001,"15min":13.279999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.622,"5min":0.79200000000000004,"15min":3.0299999999999998},"last":0.33200000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55800000000000005,"15min":0.621},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.317},"max":{"1min":0.64900000000000002,"5min":0.84999999999999998,"15min":8.2690000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57499999999999996,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":8.9930000000000003},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834576071,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":694472,"kb_used_data":384,"kb_used_omap":10,"kb_used_meta":694069,"kb_avail":93677368,"statfs":{"total":96636764160,"available":95925624832,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10854,"internal_metadata":710727066},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.67300000000000004,"5min":3.9449999999999998,"15min":7.6150000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68200000000000005,"5min":0.751,"15min":6.4199999999999999},"last":0.504}]},{"osd":1,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.51800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":6.7370000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.601,"5min":6.5609999999999999,"15min":7.649},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.505,"15min":0.54100000000000004},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.751,"5min":1.141,"15min":8.7309999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.317},"max":{"1min":1.6639999999999999,"5min":6.1369999999999996,"15min":9.9740000000000002},"last":0.442}]},{"osd":3,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48899999999999999,"15min":0.66000000000000003},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.28199999999999997},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":39.670999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54400000000000004,"15min":0.76500000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":54.856999999999999},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24299999999999999},"max":{"1min":0.69499999999999995,"5min":4.0069999999999997,"15min":7.7060000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.51500000000000001,"15min":0.67300000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.84799999999999998,"15min":39.640000000000001},"last":0.34799999999999998}]},{"osd":6,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71099999999999997,"5min":0.88300000000000001,"15min":4.694},"last":0.373},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.59299999999999997,"15min":0.61499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":3.9780000000000002,"15min":7.6779999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.54300000000000004,"15min":0.70599999999999996},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.91700000000000004,"15min":39.417000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.53200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834576070,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":762440,"kb_used_data":384,"kb_used_omap":13,"kb_used_meta":762034,"kb_avail":93609400,"statfs":{"total":96636764160,"available":95856025600,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13388,"internal_metadata":780323764},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":4.8609999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":14.263999999999999},"last":0.32600000000000001}]},{"osd":1,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34000000000000002,"15min":0.42599999999999999},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":15.218999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":25.405999999999999},"last":0.29699999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.44800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.223},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":14.377000000000001},"last":0.372},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.437},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":5.0700000000000003},"last":0.51200000000000001}]},{"osd":4,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.61899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":14.335000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73499999999999999,"5min":0.86199999999999999,"15min":3.7160000000000002},"last":0.44}]},{"osd":5,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.64200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":15.253},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.89900000000000002,"15min":3.5339999999999998},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":3.633},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71299999999999997,"5min":0.94899999999999995,"15min":3.298},"last":0.56699999999999995}]},{"osd":7,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":5.2460000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":14.307},"last":0.57999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834576073,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1389768,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1389376,"kb_avail":92982072,"statfs":{"total":96636764160,"available":95213641728,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1422721024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.45000000000000001,"5min":7.6399999999999997,"15min":7.6399999999999997},"last":0.255},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.441,"15min":0.39000000000000001},"min":{"1min":0.22900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61199999999999999,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.40899999999999997}]},{"osd":1,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.44},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54500000000000004,"5min":1.2989999999999999,"15min":7.4870000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":1.1140000000000001,"5min":4.1559999999999997,"15min":4.1559999999999997},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.437,"15min":0.41999999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23300000000000001},"max":{"1min":0.80800000000000005,"5min":5.1820000000000004,"15min":5.5970000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.50800000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.247},"max":{"1min":0.59099999999999997,"5min":13.347,"15min":13.347},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77500000000000002,"5min":0.86399999999999999,"15min":5.2859999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57899999999999996,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":3.7229999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":6.798},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.83899999999999997,"5min":1.284,"15min":5.5650000000000004},"last":0.39200000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.86699999999999999,"5min":1.3149999999999999,"15min":5.6200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.091,"5min":1.575,"15min":6.7489999999999997},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.375},"max":{"1min":0.89700000000000002,"5min":1.3400000000000001,"15min":5.6459999999999999},"last":0.45300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834576072,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":781128,"kb_used_data":384,"kb_used_omap":466,"kb_used_meta":780269,"kb_avail":93590712,"statfs":{"total":96636764160,"available":95836889088,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":477985,"internal_metadata":798995679},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.40899999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20599999999999999},"max":{"1min":1.488,"5min":1.488,"15min":9.3049999999999997},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.55500000000000005,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.22600000000000001,"15min":0.19400000000000001},"max":{"1min":1.0980000000000001,"5min":13.952,"15min":13.952},"last":0.27400000000000002}]},{"osd":2,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.109,"5min":2.4710000000000001,"15min":6.1189999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.24199999999999999},"max":{"1min":1.532,"5min":8.7420000000000009,"15min":9.9429999999999996},"last":0.29399999999999998}]},{"osd":3,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71799999999999997,"15min":0.56499999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93300000000000005,"5min":19.202000000000002,"15min":19.202000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.179,"5min":8.3520000000000003,"15min":8.3520000000000003},"last":0.38300000000000001}]},{"osd":4,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.626,"15min":0.66800000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.5640000000000001,"5min":3.6030000000000002,"15min":12.558},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68000000000000005},"min":{"1min":0.313,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.86099999999999999,"5min":3.073,"15min":5.7329999999999997},"last":0.47999999999999998}]},{"osd":5,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2030000000000001,"5min":8.2720000000000002,"15min":8.6340000000000003},"last":0.502},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28199999999999997},"max":{"1min":1.587,"5min":1.587,"15min":10.545999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.69099999999999995},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.879,"5min":3.0369999999999999,"15min":5.1829999999999998},"last":0.442},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":8.391,"15min":11.904999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":3.0960000000000001,"15min":4.5789999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.42999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834576074,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1386188,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":1385216,"kb_avail":92985652,"statfs":{"total":96636764160,"available":95217307648,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1418461184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.43099999999999999},"min":{"1min":0.22,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":1.6319999999999999,"5min":2.0070000000000001,"15min":11.935},"last":0.375},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.39000000000000001,"15min":0.44600000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":2.823,"5min":2.823,"15min":13.151999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38900000000000001,"15min":0.46300000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.5700000000000001,"5min":2.0369999999999999,"15min":7.641},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":3.7149999999999999},"last":0.39700000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":2.3660000000000001,"5min":8.2579999999999991,"15min":8.2579999999999991},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.5369999999999999,"5min":2.0670000000000002,"15min":5.827},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.57699999999999996,"15min":0.68700000000000006},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.66200000000000003,"5min":3.3730000000000002,"15min":13.061},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35799999999999998},"max":{"1min":2.4550000000000001,"5min":7.1710000000000003,"15min":8.9459999999999997},"last":0.57599999999999996}]},{"osd":5,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.28899999999999998},"max":{"1min":1.6120000000000001,"5min":1.9359999999999999,"15min":4.2329999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.58599999999999997,"15min":0.67700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":1.321,"15min":16.009},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66800000000000004,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.39400000000000002,"15min":0.33300000000000002},"max":{"1min":2.403,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.626},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.376},"max":{"1min":1.5900000000000001,"5min":1.978,"15min":3.5499999999999998},"last":0.69599999999999995}]},{"osd":7,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.68100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":1.2989999999999999,"15min":12.731},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36499999999999999},"max":{"1min":2.4289999999999998,"5min":6.0289999999999999,"15min":6.0289999999999999},"last":0.55000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T06:05:06.271 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-20T04:23:14.585040+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=20, tm_hour=4, tm_min=23, tm_sec=14, tm_wday=2, tm_yday=354, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=20, tm_hour=6, tm_min=5, tm_sec=1, tm_wday=2, tm_yday=354, tm_isdst=0) 2023-12-20T06:05:06.271 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-20T06:05:26.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T06:05:26.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.390+0000 7ff277116640 1 Processor -- start 2023-12-20T06:05:26.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.390+0000 7ff277116640 1 -- start start 2023-12-20T06:05:26.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.391+0000 7ff277116640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2700bcdd0 0x7ff2700b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.391+0000 7ff277116640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700bc6b0 con 0x7ff2700b64c0 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.391+0000 7ff277116640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2700b6900 con 0x7ff270144ea0 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.391+0000 7ff277116640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2700a59f0 con 0x7ff2700bcdd0 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.391+0000 7ff274eb2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2700bcdd0 0x7ff2700b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.391+0000 7ff274eb2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2700bcdd0 0x7ff2700b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57844/0 (socket says 172.21.15.40:57844) 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.391+0000 7ff274eb2640 1 -- 172.21.15.40:0/2247905064 learned_addr learned my addr 172.21.15.40:0/2247905064 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.392+0000 7ff274eb2640 1 -- 172.21.15.40:0/2247905064 >> v1:172.21.15.69:6789/0 conn(0x7ff270144ea0 legacy=0x7ff270155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.392+0000 7ff274eb2640 1 -- 172.21.15.40:0/2247905064 >> v1:172.21.15.40:6789/0 conn(0x7ff2700b64c0 legacy=0x7ff270144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.392+0000 7ff274eb2640 1 -- 172.21.15.40:0/2247905064 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2700bc0a0 con 0x7ff2700bcdd0 2023-12-20T06:05:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.392+0000 7ff274eb2640 1 --2- 172.21.15.40:0/2247905064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700bcdd0 0x7ff2700b5f80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f29d19c0882a34 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff26f7fe640 1 -- 172.21.15.40:0/2247905064 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26402d870 con 0x7ff2700bcdd0 2023-12-20T06:05:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff26f7fe640 1 -- 172.21.15.40:0/2247905064 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26402d9d0 con 0x7ff2700bcdd0 2023-12-20T06:05:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff26f7fe640 1 -- 172.21.15.40:0/2247905064 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26402dd60 con 0x7ff2700bcdd0 2023-12-20T06:05:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff277116640 1 -- 172.21.15.40:0/2247905064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700bcdd0 msgr2=0x7ff2700b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff277116640 1 --2- 172.21.15.40:0/2247905064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700bcdd0 0x7ff2700b5f80 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ff264009870 tx=0x7ff26402bab0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff277116640 1 -- 172.21.15.40:0/2247905064 shutdown_connections 2023-12-20T06:05:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff277116640 1 --2- 172.21.15.40:0/2247905064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700bcdd0 0x7ff2700b5f80 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff277116640 1 -- 172.21.15.40:0/2247905064 >> 172.21.15.40:0/2247905064 conn(0x7ff270071e60 msgr2=0x7ff2700c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff277116640 1 -- 172.21.15.40:0/2247905064 shutdown_connections 2023-12-20T06:05:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.393+0000 7ff277116640 1 -- 172.21.15.40:0/2247905064 wait complete. 2023-12-20T06:05:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.394+0000 7ff277116640 1 Processor -- start 2023-12-20T06:05:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.394+0000 7ff277116640 1 -- start start 2023-12-20T06:05:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff277116640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700b64c0 0x7ff27013e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff277116640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2700bcdd0 0x7ff2701e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff277116640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff270144ea0 0x7ff270148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff277116640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27013e980 con 0x7ff2700b64c0 2023-12-20T06:05:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff277116640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270145620 con 0x7ff2700bcdd0 2023-12-20T06:05:26.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff277116640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27014b550 con 0x7ff270144ea0 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff274eb2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700b64c0 0x7ff27013e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff274eb2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700b64c0 0x7ff27013e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57846/0 (socket says 172.21.15.40:57846) 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.395+0000 7ff274eb2640 1 -- 172.21.15.40:0/1270265709 learned_addr learned my addr 172.21.15.40:0/1270265709 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff26ffff640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2700bcdd0 0x7ff2701e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff2756b3640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff270144ea0 0x7ff270148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff274eb2640 1 -- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff270144ea0 msgr2=0x7ff270148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff274eb2640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff270144ea0 0x7ff270148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff274eb2640 1 -- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2700bcdd0 msgr2=0x7ff2701e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff274eb2640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2700bcdd0 0x7ff2701e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff274eb2640 1 -- 172.21.15.40:0/1270265709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640094d0 con 0x7ff2700b64c0 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff274eb2640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700b64c0 0x7ff27013e440 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff264009990 tx=0x7ff264004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff26d7fa640 1 -- 172.21.15.40:0/1270265709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26403c040 con 0x7ff2700b64c0 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff26d7fa640 1 -- 172.21.15.40:0/1270265709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff264037c60 con 0x7ff2700b64c0 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff270147f40 con 0x7ff2700b64c0 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff26d7fa640 1 -- 172.21.15.40:0/1270265709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26402de40 con 0x7ff2700b64c0 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.396+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff270145ba0 con 0x7ff2700b64c0 2023-12-20T06:05:26.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.397+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2701480d0 con 0x7ff2700b64c0 2023-12-20T06:05:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.398+0000 7ff26d7fa640 1 -- 172.21.15.40:0/1270265709 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff26404b430 con 0x7ff2700b64c0 2023-12-20T06:05:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.398+0000 7ff26d7fa640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff25406a430 0x7ff25406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.398+0000 7ff26d7fa640 1 -- 172.21.15.40:0/1270265709 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff264032070 con 0x7ff2700b64c0 2023-12-20T06:05:26.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.399+0000 7ff26ffff640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff25406a430 0x7ff25406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.399+0000 7ff26ffff640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff25406a430 0x7ff25406c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff2700ba590 tx=0x7ff25c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:26.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.403+0000 7ff26d7fa640 1 -- 172.21.15.40:0/1270265709 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff264075b90 con 0x7ff2700b64c0 2023-12-20T06:05:26.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.575+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 --> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2700b5500 con 0x7ff25406a430 2023-12-20T06:05:26.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.578+0000 7ff26d7fa640 1 -- 172.21.15.40:0/1270265709 <== mgr.4114 v2:172.21.15.69:6832/88850 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50455 (secure 0 0 0) 0x7ff25c0014a0 con 0x7ff25406a430 2023-12-20T06:05:26.579 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:05:26.579 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-12-20T06:05:26.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff25406a430 msgr2=0x7ff25406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff25406a430 0x7ff25406c8f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff2700ba590 tx=0x7ff25c009040 comp rx=0 tx=0).stop 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700b64c0 msgr2=0x7ff27013e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700b64c0 0x7ff27013e440 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff264009990 tx=0x7ff264004730 comp rx=0 tx=0).stop 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 shutdown_connections 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff25406a430 0x7ff25406c8f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff270144ea0 0x7ff270148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2700bcdd0 0x7ff2701e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.581 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 --2- 172.21.15.40:0/1270265709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2700b64c0 0x7ff27013e440 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.579+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 >> 172.21.15.40:0/1270265709 conn(0x7ff270071e60 msgr2=0x7ff2700b5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.580+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 shutdown_connections 2023-12-20T06:05:26.582 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.580+0000 7ff277116640 1 -- 172.21.15.40:0/1270265709 wait complete. 2023-12-20T06:05:26.591 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":3092,"stamp":"2023-12-20T06:05:26.072658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":7516872,"kb_used_data":4232,"kb_used_omap":528,"kb_used_meta":7512047,"kb_avail":747457848,"statfs":{"total":773094113280,"available":765396836352,"internally_reserved":0,"allocated":4333568,"data_stored":2396024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":540840,"internal_metadata":7692336984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002134"},"pg_stats":[{"pgid":"1.0","version":"34'119","reported_seq":240,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-20T06:05:08.892323+0000","last_change":"2023-12-20T06:05:08.892423+0000","last_active":"2023-12-20T06:05:08.892323+0000","last_peered":"2023-12-20T06:05:08.892323+0000","last_clean":"2023-12-20T06:05:08.892323+0000","last_became_active":"2023-12-20T04:23:15.831157+0000","last_became_peered":"2023-12-20T04:23:15.831157+0000","last_unstale":"2023-12-20T06:05:08.892323+0000","last_undegraded":"2023-12-20T06:05:08.892323+0000","last_fullsized":"2023-12-20T06:05:08.892323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2023-12-20T06:05:08.892300+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2023-12-20T06:05:08.892300+0000","last_clean_scrub_stamp":"2023-12-20T06:05:08.892300+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:17.252342+0000","scrub_duration":0.039004617999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576074,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376396,"kb_used_data":964,"kb_used_omap":7,"kb_used_meta":375416,"kb_avail":93995444,"statfs":{"total":96636764160,"available":96251334656,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7431,"internal_metadata":384426745},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.53200000000000003,"15min":0.48599999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":5.5570000000000004,"5min":5.5570000000000004,"15min":5.5570000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.495},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.262,"5min":1.9259999999999999,"15min":2.012},"last":0.48099999999999998}]},{"osd":1,"last update":"Wed Dec 20 06:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.26000000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":4.306,"5min":4.306,"15min":9.5289999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":2.6970000000000001,"5min":0.93200000000000005,"15min":0.66900000000000004},"min":{"1min":0.28000000000000003,"5min":0.254,"15min":0.254},"max":{"1min":46.286999999999999,"5min":46.286999999999999,"15min":46.286999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Wed Dec 20 06:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.29099999999999998,"5min":0.253,"15min":0.253},"max":{"1min":1.2010000000000001,"5min":1.7869999999999999,"15min":4.5300000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.60399999999999998,"15min":0.54900000000000004},"min":{"1min":0.39100000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":8.2089999999999996,"5min":8.2089999999999996,"15min":8.2089999999999996},"last":0.57299999999999995}]},{"osd":3,"last update":"Wed Dec 20 06:05:10 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.626,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":9.8810000000000002,"5min":9.8810000000000002,"15min":9.8810000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.628,"15min":0.58899999999999997},"min":{"1min":0.36099999999999999,"5min":0.33000000000000002,"15min":0.29999999999999999},"max":{"1min":3.867,"5min":3.867,"15min":3.867},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed Dec 20 06:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.56999999999999995,"15min":0.52500000000000002},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":5.0209999999999999,"5min":5.0209999999999999,"15min":5.0209999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.34100000000000003,"5min":0.27300000000000002,"15min":0.26200000000000001},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.41999999999999998}]},{"osd":5,"last update":"Wed Dec 20 06:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.63,"15min":0.59099999999999997},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.307},"max":{"1min":9.4329999999999998,"5min":9.4329999999999998,"15min":9.4329999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.63300000000000001,"15min":0.59599999999999997},"min":{"1min":0.377,"5min":0.32900000000000001,"15min":0.248},"max":{"1min":7.9560000000000004,"5min":7.9560000000000004,"15min":7.9560000000000004},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Dec 20 06:05:10 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.61799999999999999,"15min":0.60299999999999998},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.28399999999999997},"max":{"1min":4.2850000000000001,"5min":4.2850000000000001,"15min":4.2850000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.60799999999999998,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.375,"15min":0.32500000000000001},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.58499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834576077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1417480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1417088,"kb_avail":92954360,"statfs":{"total":96636764160,"available":95185264640,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1451098112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.47799999999999998,"15min":0.56299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.496,"5min":2.6779999999999999,"15min":10.500999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.47199999999999998,"15min":0.52300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":3.6699999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.51300000000000001,"15min":0.54800000000000004},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.84999999999999998,"5min":2.6509999999999998,"15min":4.399},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.47999999999999998,"15min":0.63200000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.72699999999999998,"15min":12.664},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.57399999999999995,"15min":0.59299999999999997},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.27000000000000002},"max":{"1min":1.0860000000000001,"5min":8.3829999999999991,"15min":10.188000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.58599999999999997,"15min":0.624},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78700000000000003,"5min":7.202,"15min":7.202},"last":0.54700000000000004}]},{"osd":3,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.58899999999999997,"15min":0.57799999999999996},"min":{"1min":0.32700000000000001,"5min":0.31900000000000001,"15min":0.318},"max":{"1min":0.88100000000000001,"5min":8.0329999999999995,"15min":8.0329999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.55900000000000005,"15min":0.624},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.27000000000000002},"max":{"1min":0.61199999999999999,"5min":3.5539999999999998,"15min":10.236000000000001},"last":0.50800000000000001}]},{"osd":4,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.52300000000000002,"15min":0.60099999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.65000000000000002,"5min":2.621,"15min":15.074},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.55300000000000005,"15min":0.63400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.71999999999999997,"5min":2.383,"15min":20.684999999999999},"last":0.39900000000000002}]},{"osd":5,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.51200000000000001,"15min":0.58199999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.308},"max":{"1min":0.56699999999999995,"5min":0.80900000000000005,"15min":10.15},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.58899999999999997,"15min":0.64500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.61899999999999999,"5min":2.5830000000000002,"15min":7.9400000000000004},"last":0.36599999999999999}]},{"osd":7,"last update":"Wed Dec 20 06:04:30 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.59099999999999997,"15min":0.621},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":2.5550000000000002,"15min":7.0839999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.57599999999999996,"15min":0.64100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63,"5min":0.97299999999999998,"15min":10.212999999999999},"last":0.375}]}]},{"osd":5,"up_from":13,"seq":55834576076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":709000,"kb_used_data":384,"kb_used_omap":30,"kb_used_meta":708577,"kb_avail":93662840,"statfs":{"total":96636764160,"available":95910748160,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31182,"internal_metadata":725583410},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45400000000000001,"15min":0.45800000000000002},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.20999999999999999},"max":{"1min":0.627,"5min":0.69499999999999995,"15min":0.69599999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.52800000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":0.80500000000000005,"15min":8.2260000000000009},"last":0.60499999999999998}]},{"osd":1,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.57099999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.27200000000000002},"max":{"1min":0.69099999999999995,"5min":0.72499999999999998,"15min":13.317},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47699999999999998,"15min":0.55300000000000005},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.30499999999999999},"max":{"1min":0.59999999999999998,"5min":0.73999999999999999,"15min":14.054},"last":0.621}]},{"osd":2,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47399999999999998,"15min":0.54000000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.25},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":12.787000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.1890000000000001,"5min":3.9239999999999999,"15min":8.4290000000000003},"last":0.66900000000000004}]},{"osd":3,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.63300000000000001,"15min":0.67000000000000004},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":9.1329999999999991,"15min":18.420999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78400000000000003,"15min":0.70999999999999996},"min":{"1min":0.35499999999999998,"5min":0.34499999999999997,"15min":0.31900000000000001},"max":{"1min":0.67500000000000004,"5min":21.369,"15min":21.369},"last":0.59299999999999997}]},{"osd":4,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.46500000000000002,"15min":0.51000000000000001},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58999999999999997,"5min":0.73899999999999999,"15min":3.0630000000000002},"last":0.378},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.50600000000000001,"15min":0.66800000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57499999999999996,"5min":0.77900000000000003,"15min":24.158999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.51600000000000001,"15min":0.59099999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.67900000000000005,"5min":0.75700000000000001,"15min":13.279999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.53800000000000003,"15min":0.57399999999999995},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.622,"5min":0.79200000000000004,"15min":3.0299999999999998},"last":0.33200000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55800000000000005,"15min":0.621},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.317},"max":{"1min":0.64900000000000002,"5min":0.84999999999999998,"15min":8.2690000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.57499999999999996,"15min":0.63500000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":8.9930000000000003},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834576075,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":694472,"kb_used_data":384,"kb_used_omap":10,"kb_used_meta":694069,"kb_avail":93677368,"statfs":{"total":96636764160,"available":95925624832,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10854,"internal_metadata":710727066},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.48599999999999999,"15min":0.503},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.67300000000000004,"5min":3.9449999999999998,"15min":7.6150000000000002},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.45700000000000002,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68200000000000005,"5min":0.751,"15min":6.4199999999999999},"last":0.624}]},{"osd":1,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.47399999999999998,"15min":0.51800000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":6.7370000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.601,"5min":6.5609999999999999,"15min":7.649},"last":0.61099999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.505,"15min":0.54100000000000004},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.751,"5min":1.141,"15min":8.7309999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.317},"max":{"1min":1.6639999999999999,"5min":6.1369999999999996,"15min":9.9740000000000002},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.48899999999999999,"15min":0.66000000000000003},"min":{"1min":0.30099999999999999,"5min":0.29899999999999999,"15min":0.28199999999999997},"max":{"1min":0.72399999999999998,"5min":0.753,"15min":39.670999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.54400000000000004,"15min":0.76500000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29399999999999998},"max":{"1min":0.77300000000000002,"5min":0.77500000000000002,"15min":54.856999999999999},"last":0.59499999999999997}]},{"osd":5,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.52900000000000003,"15min":0.55000000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.24299999999999999},"max":{"1min":0.69499999999999995,"5min":4.0069999999999997,"15min":7.7060000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.51500000000000001,"15min":0.67300000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.68000000000000005,"5min":0.84799999999999998,"15min":39.640000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.52500000000000002,"15min":0.56499999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71099999999999997,"5min":0.88300000000000001,"15min":4.694},"last":0.435},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.59299999999999997,"15min":0.61499999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.27500000000000002},"max":{"1min":0.73599999999999999,"5min":3.9780000000000002,"15min":7.6779999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Wed Dec 20 06:04:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.54300000000000004,"15min":0.70599999999999996},"min":{"1min":0.34999999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.72299999999999998,"5min":0.91700000000000004,"15min":39.417000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78100000000000003,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834576074,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":762440,"kb_used_data":384,"kb_used_omap":13,"kb_used_meta":762034,"kb_avail":93609400,"statfs":{"total":96636764160,"available":95856025600,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13388,"internal_metadata":780323764},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20499999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":4.8609999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":14.263999999999999},"last":0.58299999999999996}]},{"osd":1,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.34000000000000002,"15min":0.42599999999999999},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.20499999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":15.218999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.38300000000000001,"15min":0.50800000000000001},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":25.405999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38300000000000001,"15min":0.44800000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.223},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":14.377000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.40500000000000003,"15min":0.437},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":5.0700000000000003},"last":0.65500000000000003}]},{"osd":4,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.61899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.747,"5min":0.94299999999999995,"15min":14.335000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73499999999999999,"5min":0.86199999999999999,"15min":3.7160000000000002},"last":0.67100000000000004}]},{"osd":5,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.64200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84099999999999997,"5min":0.91200000000000003,"15min":15.253},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85699999999999998,"5min":0.89900000000000002,"15min":3.5339999999999998},"last":0.89500000000000002}]},{"osd":6,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":3.633},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.60999999999999999},"min":{"1min":0.41299999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71299999999999997,"5min":0.94899999999999995,"15min":3.298},"last":0.753}]},{"osd":7,"last update":"Wed Dec 20 06:04:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60599999999999998,"15min":0.63700000000000001},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":5.2460000000000004},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.66500000000000004},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.38},"max":{"1min":0.85399999999999998,"5min":0.96999999999999997,"15min":14.307},"last":0.83699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834576077,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1389768,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":1389376,"kb_avail":92982072,"statfs":{"total":96636764160,"available":95213641728,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1422721024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.48499999999999999,"15min":0.41899999999999998},"min":{"1min":0.249,"5min":0.22,"15min":0.20999999999999999},"max":{"1min":0.45000000000000001,"5min":7.6399999999999997,"15min":7.6399999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.441,"15min":0.39000000000000001},"min":{"1min":0.22900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.61199999999999999,"5min":8.0850000000000009,"15min":8.0850000000000009},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.44},"min":{"1min":0.30299999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54500000000000004,"5min":1.2989999999999999,"15min":7.4870000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.434,"5min":0.42599999999999999,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.23999999999999999,"15min":0.217},"max":{"1min":1.1140000000000001,"5min":4.1559999999999997,"15min":4.1559999999999997},"last":0.71099999999999997}]},{"osd":3,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.437,"15min":0.41999999999999998},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23300000000000001},"max":{"1min":0.80800000000000005,"5min":5.1820000000000004,"15min":5.5970000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.57499999999999996,"15min":0.50800000000000001},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.247},"max":{"1min":0.59099999999999997,"5min":13.347,"15min":13.347},"last":0.69699999999999995}]},{"osd":4,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56799999999999995,"15min":0.60899999999999999},"min":{"1min":0.39900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77500000000000002,"5min":0.86399999999999999,"15min":5.2859999999999996},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57899999999999996,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":3.7229999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.623},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.29699999999999999},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":6.798},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57699999999999996,"15min":0.60199999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.83899999999999997,"5min":1.284,"15min":5.5650000000000004},"last":0.878}]},{"osd":6,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.61499999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.33200000000000002},"max":{"1min":0.86699999999999999,"5min":1.3149999999999999,"15min":5.6200000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.76300000000000001,"5min":7.5800000000000001,"15min":7.5800000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64700000000000002},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.091,"5min":1.575,"15min":6.7489999999999997},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61199999999999999,"15min":0.64300000000000002},"min":{"1min":0.44500000000000001,"5min":0.434,"15min":0.375},"max":{"1min":0.89700000000000002,"5min":1.3400000000000001,"15min":5.6459999999999999},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834576076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":781128,"kb_used_data":384,"kb_used_omap":466,"kb_used_meta":780269,"kb_avail":93590712,"statfs":{"total":96636764160,"available":95836889088,"internally_reserved":0,"allocated":393216,"data_stored":151911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":477985,"internal_metadata":798995679},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35799999999999998,"15min":0.40899999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20599999999999999},"max":{"1min":1.488,"5min":1.488,"15min":9.3049999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.55500000000000005,"15min":0.47699999999999998},"min":{"1min":0.25600000000000001,"5min":0.22600000000000001,"15min":0.19400000000000001},"max":{"1min":1.0980000000000001,"5min":13.952,"15min":13.952},"last":0.44500000000000001}]},{"osd":2,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41099999999999998,"15min":0.42899999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.109,"5min":2.4710000000000001,"15min":6.1189999999999998},"last":0.37},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51800000000000002,"15min":0.47699999999999998},"min":{"1min":0.27600000000000002,"5min":0.247,"15min":0.24199999999999999},"max":{"1min":1.532,"5min":8.7420000000000009,"15min":9.9429999999999996},"last":0.39200000000000002}]},{"osd":3,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.71799999999999997,"15min":0.56499999999999995},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.93300000000000005,"5min":19.202000000000002,"15min":19.202000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":1.179,"5min":8.3520000000000003,"15min":8.3520000000000003},"last":0.34899999999999998}]},{"osd":4,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.626,"15min":0.66800000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":1.5640000000000001,"5min":3.6030000000000002,"15min":12.558},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.63200000000000001,"15min":0.68000000000000005},"min":{"1min":0.313,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.86099999999999999,"5min":3.073,"15min":5.7329999999999997},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.2030000000000001,"5min":8.2720000000000002,"15min":8.6340000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.629,"15min":0.67100000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.28199999999999997},"max":{"1min":1.587,"5min":1.587,"15min":10.545999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.65000000000000002,"15min":0.69099999999999995},"min":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.879,"5min":3.0369999999999999,"15min":5.1829999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.24,"5min":8.391,"15min":11.904999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed Dec 20 06:04:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66700000000000004,"15min":0.68500000000000005},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":3.0960000000000001,"15min":4.5789999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.73599999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.224,"5min":8.3200000000000003,"15min":8.3200000000000003},"last":0.754}]}]},{"osd":0,"up_from":13,"seq":55834576078,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1386188,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":1385216,"kb_avail":92985652,"statfs":{"total":96636764160,"available":95217307648,"internally_reserved":0,"allocated":987136,"data_stored":742279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1418461184},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35599999999999998,"15min":0.43099999999999999},"min":{"1min":0.22,"5min":0.214,"15min":0.19400000000000001},"max":{"1min":1.6319999999999999,"5min":2.0070000000000001,"15min":11.935},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.39000000000000001,"15min":0.44600000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.19500000000000001},"max":{"1min":2.823,"5min":2.823,"15min":13.151999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.38900000000000001,"15min":0.46300000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.5700000000000001,"5min":2.0369999999999999,"15min":7.641},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.39600000000000002,"15min":0.41299999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":3.7149999999999999},"last":0.495}]},{"osd":3,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.48299999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.222,"15min":0.222},"max":{"1min":2.3660000000000001,"5min":8.2579999999999991,"15min":8.2579999999999991},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.45300000000000001,"15min":0.45200000000000001},"min":{"1min":0.27700000000000002,"5min":0.247,"15min":0.247},"max":{"1min":1.5369999999999999,"5min":2.0670000000000002,"15min":5.827},"last":0.47499999999999998}]},{"osd":4,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.57699999999999996,"15min":0.68700000000000006},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":0.66200000000000003,"5min":3.3730000000000002,"15min":13.061},"last":0.745},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35799999999999998},"max":{"1min":2.4550000000000001,"5min":7.1710000000000003,"15min":8.9459999999999997},"last":0.66800000000000004}]},{"osd":5,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.28899999999999998},"max":{"1min":1.6120000000000001,"5min":1.9359999999999999,"15min":4.2329999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.58599999999999997,"15min":0.67700000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70099999999999996,"5min":1.321,"15min":16.009},"last":0.81000000000000005}]},{"osd":6,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66800000000000004,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.39400000000000002,"15min":0.33300000000000002},"max":{"1min":2.403,"5min":6.6070000000000002,"15min":6.6070000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.376},"max":{"1min":1.5900000000000001,"5min":1.978,"15min":3.5499999999999998},"last":0.64900000000000002}]},{"osd":7,"last update":"Wed Dec 20 06:04:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.68100000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":1.2989999999999999,"15min":12.731},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68300000000000005,"15min":0.63400000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.36499999999999999},"max":{"1min":2.4289999999999998,"5min":6.0289999999999999,"15min":6.0289999999999999},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-20T06:05:26.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-20T06:05:26.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.697+0000 7ff074963640 1 Processor -- start 2023-12-20T06:05:26.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.697+0000 7ff074963640 1 -- start start 2023-12-20T06:05:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.698+0000 7ff074963640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff07006a950 0x7ff0700be350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.698+0000 7ff074963640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0700bfa50 con 0x7ff0700bb140 2023-12-20T06:05:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.698+0000 7ff074963640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07006b040 con 0x7ff0700bf510 2023-12-20T06:05:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.698+0000 7ff074963640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0700bbda0 con 0x7ff07006a950 2023-12-20T06:05:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.698+0000 7ff06ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff07006a950 0x7ff0700be350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.698+0000 7ff06e59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff0700bb140 0x7ff0700bee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58492/0 (socket says 172.21.15.40:58492) 2023-12-20T06:05:26.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.698+0000 7ff06e59c640 1 -- 172.21.15.40:0/993417144 learned_addr learned my addr 172.21.15.40:0/993417144 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:26.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06ed9d640 1 -- 172.21.15.40:0/993417144 >> v1:172.21.15.69:6789/0 conn(0x7ff0700bf510 legacy=0x7ff0701534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06ed9d640 1 -- 172.21.15.40:0/993417144 >> v1:172.21.15.40:6789/0 conn(0x7ff0700bb140 legacy=0x7ff0700bee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06ed9d640 1 -- 172.21.15.40:0/993417144 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0700bb520 con 0x7ff07006a950 2023-12-20T06:05:26.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06d59a640 1 -- 172.21.15.40:0/993417144 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030048494 0 0) 0x7ff0700bfa50 con 0x7ff0700bb140 2023-12-20T06:05:26.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06ed9d640 1 --2- 172.21.15.40:0/993417144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07006a950 0x7ff0700be350 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff068009d90 tx=0x7ff06802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca4a33f87210de3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06d59a640 1 -- 172.21.15.40:0/993417144 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06802cd00 con 0x7ff07006a950 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06d59a640 1 -- 172.21.15.40:0/993417144 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06802ce60 con 0x7ff07006a950 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.699+0000 7ff06d59a640 1 -- 172.21.15.40:0/993417144 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff068034660 con 0x7ff07006a950 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.700+0000 7ff074963640 1 -- 172.21.15.40:0/993417144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07006a950 msgr2=0x7ff0700be350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.700+0000 7ff074963640 1 --2- 172.21.15.40:0/993417144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07006a950 0x7ff0700be350 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff068009d90 tx=0x7ff06802bf50 comp rx=0 tx=0).stop 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.700+0000 7ff074963640 1 -- 172.21.15.40:0/993417144 shutdown_connections 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.700+0000 7ff074963640 1 --2- 172.21.15.40:0/993417144 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff07006a950 0x7ff0700be350 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.700+0000 7ff074963640 1 -- 172.21.15.40:0/993417144 >> 172.21.15.40:0/993417144 conn(0x7ff0700bcfd0 msgr2=0x7ff0700bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:26.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.700+0000 7ff074963640 1 -- 172.21.15.40:0/993417144 shutdown_connections 2023-12-20T06:05:26.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.700+0000 7ff074963640 1 -- 172.21.15.40:0/993417144 wait complete. 2023-12-20T06:05:26.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.701+0000 7ff074963640 1 Processor -- start 2023-12-20T06:05:26.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.701+0000 7ff074963640 1 -- start start 2023-12-20T06:05:26.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff074963640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff07006a950 0x7ff0701463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff074963640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0700bb140 0x7ff070144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff074963640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0700bf510 0x7ff07014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff074963640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff070146900 con 0x7ff0700bf510 2023-12-20T06:05:26.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff074963640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701e0bd0 con 0x7ff07006a950 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff074963640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0701dfbe0 con 0x7ff0700bb140 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0700bf510 0x7ff07014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0700bf510 0x7ff07014e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57864/0 (socket says 172.21.15.40:57864) 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 -- 172.21.15.40:0/1876900414 learned_addr learned my addr 172.21.15.40:0/1876900414 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06e59c640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff07006a950 0x7ff0701463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06dd9b640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0700bb140 0x7ff070144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 -- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0700bb140 msgr2=0x7ff070144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0700bb140 0x7ff070144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 -- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff07006a950 msgr2=0x7ff0701463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff07006a950 0x7ff0701463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06ed9d640 1 -- 172.21.15.40:0/1876900414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068009a70 con 0x7ff0700bf510 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.702+0000 7ff06e59c640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff07006a950 0x7ff0701463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.703+0000 7ff06ed9d640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0700bf510 0x7ff07014e400 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff068037040 tx=0x7ff068004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.703+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06803e670 con 0x7ff0700bf510 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.703+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06803e7f0 con 0x7ff0700bf510 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.703+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0701e0740 con 0x7ff0700bf510 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.703+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06803eba0 con 0x7ff0700bf510 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.703+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0701e00f0 con 0x7ff0700bf510 2023-12-20T06:05:26.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.704+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0701e08d0 con 0x7ff0700bf510 2023-12-20T06:05:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.704+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff06803b040 con 0x7ff0700bf510 2023-12-20T06:05:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.705+0000 7ff066ffd640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff05006a430 0x7ff05006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.705+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff0680aaa10 con 0x7ff0700bf510 2023-12-20T06:05:26.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.705+0000 7ff06e59c640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff05006a430 0x7ff05006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.705+0000 7ff06e59c640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff05006a430 0x7ff05006c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff060000f60 tx=0x7ff060007c50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:26.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.709+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff068076390 con 0x7ff0700bf510 2023-12-20T06:05:26.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.884+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff0700740a0 con 0x7ff0700bf510 2023-12-20T06:05:26.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.888+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff068076390 con 0x7ff0700bf510 2023-12-20T06:05:26.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.889+0000 7ff066ffd640 1 -- 172.21.15.40:0/1876900414 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff0680799b0 con 0x7ff0700bf510 2023-12-20T06:05:26.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff05006a430 msgr2=0x7ff05006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff05006a430 0x7ff05006c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff060000f60 tx=0x7ff060007c50 comp rx=0 tx=0).stop 2023-12-20T06:05:26.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0700bf510 msgr2=0x7ff07014e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0700bf510 0x7ff07014e400 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff068037040 tx=0x7ff068004a40 comp rx=0 tx=0).stop 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 shutdown_connections 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7ff05006a430 0x7ff05006c8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0700bf510 0x7ff07014e400 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7ff0700bb140 0x7ff070144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 --2- 172.21.15.40:0/1876900414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff07006a950 0x7ff0701463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 >> 172.21.15.40:0/1876900414 conn(0x7ff0700bcfd0 msgr2=0x7ff0700a4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 shutdown_connections 2023-12-20T06:05:26.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:26.891+0000 7ff074963640 1 -- 172.21.15.40:0/1876900414 wait complete. 2023-12-20T06:05:26.903 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T06:05:26.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T06:05:27.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.009+0000 7f7f0e0a0640 1 Processor -- start 2023-12-20T06:05:27.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.009+0000 7f7f0e0a0640 1 -- start start 2023-12-20T06:05:27.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f0e0a0640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7f080bcdd0 0x7f7f080b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f0e0a0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f080bc6b0 con 0x7f7f080b64c0 2023-12-20T06:05:27.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f0e0a0640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f080b6900 con 0x7f7f08144ea0 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f0e0a0640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f080a59f0 con 0x7f7f080bcdd0 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f06ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7f080b64c0 0x7f7f08144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58496/0 (socket says 172.21.15.40:58496) 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f06ffd640 1 -- 172.21.15.40:0/2632912195 learned_addr learned my addr 172.21.15.40:0/2632912195 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f077fe640 1 --2- 172.21.15.40:0/2632912195 >> v2:172.21.15.69:3300/0 conn(0x7f7f080bcdd0 0x7f7f080b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900310114 0 0) 0x7f7f080bc6b0 con 0x7f7f080b64c0 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef0003520 con 0x7f7f080b64c0 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3975582779 0 0) 0x7f7ef0003520 con 0x7f7f080b64c0 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 >> v2:172.21.15.69:3300/0 conn(0x7f7f080bcdd0 msgr2=0x7f7f080b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:27.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 --2- 172.21.15.40:0/2632912195 >> v2:172.21.15.69:3300/0 conn(0x7f7f080bcdd0 0x7f7f080b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 >> v1:172.21.15.69:6789/0 conn(0x7f7f08144ea0 legacy=0x7f7f08155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:27.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080bc0a0 con 0x7f7f080b64c0 2023-12-20T06:05:27.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 547396713 0 0) 0x7f7efc001670 con 0x7f7f080b64c0 2023-12-20T06:05:27.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.010+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 >> v1:172.21.15.40:6789/0 conn(0x7f7f080b64c0 legacy=0x7f7f08144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:27.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f067fc640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0003970 0x7f7ef0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f067fc640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ef00047c0 0x7f7ef0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f067fc640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef0005180 0x7f7ef000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080a59f0 con 0x7f7ef0005180 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef000c030 con 0x7f7ef00047c0 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef000c1f0 con 0x7f7ef0003970 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f07fff640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef0005180 0x7f7ef000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f077fe640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0003970 0x7f7ef0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f06ffd640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ef00047c0 0x7f7ef0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f07fff640 1 -- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0003970 msgr2=0x7f7ef0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f07fff640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0003970 0x7f7ef0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f07fff640 1 -- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ef00047c0 msgr2=0x7f7ef0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f07fff640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ef00047c0 0x7f7ef0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.011+0000 7f7f07fff640 1 -- 172.21.15.40:0/2632912195 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0003520 con 0x7f7ef0005180 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f07fff640 1 -- 172.21.15.40:0/2632912195 reap_dead start 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f07fff640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef0005180 0x7f7ef000b980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7f00001e50 tx=0x7f7ef00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115e623e518eb509 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00003b70 con 0x7f7ef0005180 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7f00003cf0 con 0x7f7ef0005180 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f067fc640 1 -- 172.21.15.40:0/2632912195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00005330 con 0x7f7ef0005180 2023-12-20T06:05:27.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/2632912195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef0005180 msgr2=0x7f7ef000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef0005180 0x7f7ef000b980 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7f00001e50 tx=0x7f7ef00057f0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/2632912195 shutdown_connections 2023-12-20T06:05:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/2632912195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef0005180 0x7f7ef000b980 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/2632912195 >> 172.21.15.40:0/2632912195 conn(0x7f7f08071e60 msgr2=0x7f7f080c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/2632912195 shutdown_connections 2023-12-20T06:05:27.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.012+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/2632912195 wait complete. 2023-12-20T06:05:27.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.013+0000 7f7f0e0a0640 1 Processor -- start 2023-12-20T06:05:27.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f0e0a0640 1 -- start start 2023-12-20T06:05:27.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f0e0a0640 1 --2- >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0005180 0x7f7f0809b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f0e0a0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0809a5a0 0x7f7f081dfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f0e0a0640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f081dffa0 0x7f7f081405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f0e0a0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f08099ee0 con 0x7f7f0809a5a0 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f0e0a0640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0809a130 con 0x7f7f081dffa0 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f0e0a0640 1 -- --> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081e0420 con 0x7f7ef0005180 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f06ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0809a5a0 0x7f7f081dfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f06ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0809a5a0 0x7f7f081dfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57882/0 (socket says 172.21.15.40:57882) 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.014+0000 7f7f06ffd640 1 -- 172.21.15.40:0/4086653897 learned_addr learned my addr 172.21.15.40:0/4086653897 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-12-20T06:05:27.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f07fff640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f081dffa0 0x7f7f081405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f077fe640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0005180 0x7f7f0809b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f06ffd640 1 -- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0005180 msgr2=0x7f7f0809b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f06ffd640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0005180 0x7f7f0809b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f06ffd640 1 -- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f081dffa0 msgr2=0x7f7f081405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f06ffd640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f081dffa0 0x7f7f081405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f06ffd640 1 -- 172.21.15.40:0/4086653897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0809aa00 con 0x7f7f0809a5a0 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f06ffd640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0809a5a0 0x7f7f081dfa60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7efc007310 tx=0x7f7efc007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7eeffff640 1 -- 172.21.15.40:0/4086653897 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc001670 con 0x7f7f0809a5a0 2023-12-20T06:05:27.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7eeffff640 1 -- 172.21.15.40:0/4086653897 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7efc00f960 con 0x7f7f0809a5a0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0809bc70 con 0x7f7f0809a5a0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7eeffff640 1 -- 172.21.15.40:0/4086653897 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00fd30 con 0x7f7f0809a5a0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.015+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f081480c0 con 0x7f7f0809a5a0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.016+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0804e840 con 0x7f7f0809a5a0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.017+0000 7f7eeffff640 1 -- 172.21.15.40:0/4086653897 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7efc01d460 con 0x7f7f0809a5a0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.017+0000 7f7eeffff640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7ef406a430 0x7f7ef406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.017+0000 7f7eeffff640 1 -- 172.21.15.40:0/4086653897 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7efc0885f0 con 0x7f7f0809a5a0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.017+0000 7f7f077fe640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7ef406a430 0x7f7ef406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T06:05:27.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.018+0000 7f7f077fe640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7ef406a430 0x7f7ef406c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009b40 tx=0x7f7ef8009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T06:05:27.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.021+0000 7f7eeffff640 1 -- 172.21.15.40:0/4086653897 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7efc053e50 con 0x7f7f0809a5a0 2023-12-20T06:05:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.236+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f0814a890 con 0x7f7f0809a5a0 2023-12-20T06:05:27.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.237+0000 7f7eeffff640 1 -- 172.21.15.40:0/4086653897 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2769 (secure 0 0 0) 0x7f7efc057470 con 0x7f7f0809a5a0 2023-12-20T06:05:27.238 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-12-20T06:05:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4622,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1306717467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1306717467},{"type":"v1","addr":"172.21.15.40:6835","nonce":1306717467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4625,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1583424120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1583424120},{"type":"v1","addr":"172.21.15.69:6835","nonce":1583424120}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":6741,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/809842504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":809842504},{"type":"v1","addr":"172.21.15.40:6834","nonce":809842504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2023-12-20T06:05:27.238 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 15 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.238+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7ef406a430 msgr2=0x7f7ef406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.238+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7ef406a430 0x7f7ef406c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009b40 tx=0x7f7ef8009190 comp rx=0 tx=0).stop 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.238+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0809a5a0 msgr2=0x7f7f081dfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.238+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0809a5a0 0x7f7f081dfa60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7efc007310 tx=0x7f7efc007710 comp rx=0 tx=0).stop 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 shutdown_connections 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:6832/88850,v1:172.21.15.69:6833/88850] conn(0x7f7ef406a430 0x7f7ef406c8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f081dffa0 0x7f7f081405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f0809a5a0 0x7f7f081dfa60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 --2- 172.21.15.40:0/4086653897 >> [v2:172.21.15.69:3301/0,v1:172.21.15.69:6790/0] conn(0x7f7ef0005180 0x7f7f0809b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T06:05:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 >> 172.21.15.40:0/4086653897 conn(0x7f7f08071e60 msgr2=0x7f7f080b7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T06:05:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 shutdown_connections 2023-12-20T06:05:27.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-12-20T06:05:27.239+0000 7f7f0e0a0640 1 -- 172.21.15.40:0/4086653897 wait complete. 2023-12-20T06:05:27.250 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-20T06:05:27.251 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-20T06:05:27.251 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T06:05:27.251 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.260 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T06:05:27.260 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T06:05:27.260 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.310 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T06:05:27.311 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T06:05:27.311 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.323 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T06:05:27.323 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-20T06:05:27.323 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-20T06:05:27.323 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.423 INFO:tasks.ceph.osd.0:Stopped 2023-12-20T06:05:27.423 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-20T06:05:27.423 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.503 INFO:tasks.ceph.osd.1:Stopped 2023-12-20T06:05:27.503 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-20T06:05:27.504 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.589 INFO:tasks.ceph.osd.2:Stopped 2023-12-20T06:05:27.590 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-20T06:05:27.590 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.650 INFO:tasks.ceph.osd.3:Stopped 2023-12-20T06:05:27.651 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-20T06:05:27.651 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.721 INFO:tasks.ceph.osd.4:Stopped 2023-12-20T06:05:27.722 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-20T06:05:27.722 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.782 INFO:tasks.ceph.osd.5:Stopped 2023-12-20T06:05:27.782 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-20T06:05:27.783 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.869 INFO:tasks.ceph.osd.6:Stopped 2023-12-20T06:05:27.869 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-20T06:05:27.869 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.917 INFO:tasks.ceph.osd.7:Stopped 2023-12-20T06:05:27.917 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-20T06:05:27.918 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-20T06:05:27.918 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.941 INFO:tasks.ceph.mgr.y:Stopped 2023-12-20T06:05:27.941 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-20T06:05:27.941 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.967 INFO:tasks.ceph.mgr.x:Stopped 2023-12-20T06:05:27.967 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-20T06:05:27.968 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-20T06:05:27.968 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:27.997 INFO:tasks.ceph.mon.a:Stopped 2023-12-20T06:05:27.997 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-20T06:05:27.998 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:28.019 INFO:tasks.ceph.mon.b:Stopped 2023-12-20T06:05:28.020 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-20T06:05:28.020 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T06:05:28.072 INFO:tasks.ceph.mon.c:Stopped 2023-12-20T06:05:28.072 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-20T06:05:28.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-20T06:05:28.156 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T06:05:28.156 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-20T06:05:28.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T06:05:28.423 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-20T06:05:28.584 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T06:05:28.584 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-20T06:05:28.667 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T06:05:28.667 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-20T06:05:28.764 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T06:05:28.765 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-20T06:05:29.072 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T06:05:29.072 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-20T06:05:29.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T06:05:29.203 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-20T06:05:29.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T06:05:29.323 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-20T06:05:29.466 INFO:tasks.ceph:Archiving mon data... 2023-12-20T06:05:29.467 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/data/mon.a.tgz 2023-12-20T06:05:29.468 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-12-20T06:05:29.485 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.AB336JaVL0 2023-12-20T06:05:29.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.AB336JaVL0 2023-12-20T06:05:29.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.AB336JaVL0 2023-12-20T06:05:29.735 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.AB336JaVL0 is 290KB 2023-12-20T06:05:29.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:29.804 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:29.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:29.847 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.AB336JaVL0 2023-12-20T06:05:29.865 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/data/mon.b.tgz 2023-12-20T06:05:29.865 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-12-20T06:05:29.888 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.26tKn59uQb 2023-12-20T06:05:29.889 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.26tKn59uQb 2023-12-20T06:05:30.016 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.26tKn59uQb 2023-12-20T06:05:30.135 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.26tKn59uQb is 291KB 2023-12-20T06:05:30.201 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.26tKn59uQb 2023-12-20T06:05:30.222 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/data/mon.c.tgz 2023-12-20T06:05:30.222 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-12-20T06:05:30.275 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.4eOi4nxH2q 2023-12-20T06:05:30.275 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4eOi4nxH2q 2023-12-20T06:05:30.389 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.4eOi4nxH2q 2023-12-20T06:05:30.473 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.4eOi4nxH2q is 291KB 2023-12-20T06:05:30.568 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.4eOi4nxH2q 2023-12-20T06:05:30.582 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-20T06:05:30.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-20T06:05:30.585 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-20T06:05:30.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-20T06:05:30.728 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-20T06:05:30.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-20T06:05:30.731 DEBUG:teuthology.orchestra.run.smithi069:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-20T06:05:30.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-20T06:05:30.759 INFO:teuthology.orchestra.run.smithi069.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-20T06:05:30.764 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-20T06:05:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-20T06:05:30.866 INFO:tasks.ceph:Archiving crash dumps... 2023-12-20T06:05:30.867 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi040/crash 2023-12-20T06:05:30.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-20T06:05:30.900 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi069/crash 2023-12-20T06:05:30.901 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-20T06:05:30.928 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi081/crash 2023-12-20T06:05:30.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-20T06:05:31.039 INFO:tasks.ceph:Shutting down logrotate 2023-12-20T06:05:31.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:31.041 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:31.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:31.171 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:31.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:31.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-20T06:05:31.363 INFO:tasks.ceph:Compressing logs... 2023-12-20T06:05:31.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T06:05:31.366 DEBUG:teuthology.orchestra.run.smithi069:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T06:05:31.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T06:09:29.341 INFO:tasks.ceph:Archiving logs... 2023-12-20T06:09:29.346 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi040/log 2023-12-20T06:09:29.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-20T06:11:57.148 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi069/log 2023-12-20T06:11:57.150 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-20T06:12:56.857 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi081/log 2023-12-20T06:12:56.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-20T06:12:57.891 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-20T06:12:57.924 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-20T06:12:57.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-20T06:12:57.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-20T06:12:57.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-20T06:12:58.111 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-20T06:12:58.120 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-20T06:12:58.120 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T06:12:58.122 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T06:12:58.125 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T06:12:58.137 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2023-12-20T06:12:58.139 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2023-12-20T06:12:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2023-12-20T06:12:58.195 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T06:12:58.195 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-12-20T06:12:58.195 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 21 +410us[ +414us] +/- 83ms 2023-12-20T06:12:58.196 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -177us[ -173us] +/- 59ms 2023-12-20T06:12:58.196 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -94us[ -91us] +/- 66ms 2023-12-20T06:12:58.196 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T06:12:58.212 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T06:12:58.212 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-12-20T06:12:58.212 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 22 +381us[ +387us] +/- 83ms 2023-12-20T06:12:58.212 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 7 377 20 -162us[ -155us] +/- 59ms 2023-12-20T06:12:58.212 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 15 -98us[ -98us] +/- 66ms 2023-12-20T06:12:58.212 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T06:12:58.239 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T06:12:58.239 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-12-20T06:12:58.239 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 19 +406us[ +406us] +/- 83ms 2023-12-20T06:12:58.239 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv02.front.sepia.ceph.com 3 6 377 20 -169us[ -159us] +/- 59ms 2023-12-20T06:12:58.239 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -69us[ -69us] +/- 66ms 2023-12-20T06:12:58.239 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T06:12:58.240 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-20T06:12:58.249 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-20T06:12:58.250 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-20T06:12:58.276 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-20T06:12:58.478 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-20T06:12:58.648 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-20T06:12:59.046 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T06:12:59.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T06:12:59.088 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T06:12:59.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T06:12:59.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T06:12:59.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T06:12:59.233 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-20T06:12:59.242 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-20T06:12:59.271 INFO:teuthology.task.internal:Duration was 7373.145720 seconds 2023-12-20T06:12:59.271 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-20T06:12:59.303 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-20T06:12:59.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-20T06:12:59.306 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-20T06:12:59.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-20T06:12:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T06:12:59.401 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T06:12:59.508 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T06:12:59.886 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-20T06:12:59.887 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2023-12-20T06:12:59.887 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-20T06:12:59.913 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2023-12-20T06:12:59.913 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-20T06:12:59.947 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-12-20T06:12:59.947 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-20T06:13:00.028 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-20T06:13:00.028 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T06:13:00.031 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T06:13:00.033 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T06:13:00.115 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-20T06:13:00.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-20T06:13:00.118 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-20T06:13:00.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-20T06:13:00.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-20T06:13:00.415 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-20T06:13:00.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-20T06:13:00.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-20T06:13:00.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-20T06:13:00.608 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-20T06:13:00.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-20T06:13:00.620 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-20T06:13:00.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-20T06:13:00.652 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2023-12-20T06:13:00.656 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2023-12-20T06:13:00.753 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-12-20T06:13:00.806 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-20T06:13:00.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T06:13:00.820 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-20T06:13:00.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T06:13:00.835 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-20T06:13:00.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T06:13:00.892 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-20T06:13:00.901 INFO:teuthology.task.internal:Transferring archived files... 2023-12-20T06:13:00.902 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi040 2023-12-20T06:13:00.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-20T06:13:00.947 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi069 2023-12-20T06:13:00.947 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-20T06:13:00.983 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369/remote/smithi081 2023-12-20T06:13:00.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-20T06:13:01.092 INFO:teuthology.task.internal:Removing archive directory... 2023-12-20T06:13:01.093 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-20T06:13:01.095 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-20T06:13:01.098 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-20T06:13:01.152 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-20T06:13:01.162 INFO:teuthology.task.internal:Not uploading archives. 2023-12-20T06:13:01.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-20T06:13:01.186 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-20T06:13:01.186 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-20T06:13:01.189 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-20T06:13:01.191 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-20T06:13:01.202 INFO:teuthology.orchestra.run.smithi040.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 20 06:13 /home/ubuntu/cephtest 2023-12-20T06:13:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 20 06:13 /home/ubuntu/cephtest 2023-12-20T06:13:01.250 INFO:teuthology.orchestra.run.smithi081.stdout: 525016 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 20 06:13 /home/ubuntu/cephtest 2023-12-20T06:13:01.254 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-20T06:13:01.263 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-20T06:13:01.329 INFO:teuthology.nuke:Checking targets against current locks 2023-12-20T06:13:01.353 DEBUG:teuthology.nuke:shortname: smithi040 2023-12-20T06:13:01.354 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T06:13:01.377 DEBUG:teuthology.nuke:shortname: smithi069 2023-12-20T06:13:01.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T06:13:01.382 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:23.381605', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNMeyIaMbRTMJ/GOxgiXdQ9nS8ivj0WJC5O0HokCYz/avMeFbOBU37TcnRVsjcMkgTHNoqC8RWrzDsAH3EJoA4I='} 2023-12-20T06:13:01.402 DEBUG:teuthology.nuke:shortname: smithi081 2023-12-20T06:13:01.402 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T06:13:01.407 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:23.378506', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfb32TMLEklnuYQ6QWhl8UY/5pb5s9SeuUuTQakJjn0vUVGNZ/AZWTyj47fOiAJTRrkSU3v+0RH9aXN5UEx5Q0='} 2023-12-20T06:13:01.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:23.379989', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEL68mI9LdfPnXdSy7nEiEfcpEWspR7LoJ2s8SWIBoE6lEtm0Zeh/r/Id0IS/P72TNlz9VheDqrCSO2eS7FsHaY='} 2023-12-20T06:13:01.435 INFO:teuthology.orchestra.console.smithi040:Power off 2023-12-20T06:13:01.435 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T06:13:01.458 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-12-20T06:13:01.458 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:01.476 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-20T06:13:01.476 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T06:13:01.486 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-12-20T06:13:01.499 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-20T06:13:01.499 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:01.511 INFO:teuthology.orchestra.console.smithi081:Power off 2023-12-20T06:13:01.512 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T06:13:01.520 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-20T06:13:01.532 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-12-20T06:13:01.532 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:01.555 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-20T06:13:05.487 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:05.521 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:05.556 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:05.596 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-12-20T06:13:05.629 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-20T06:13:05.664 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-20T06:13:09.598 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:09.630 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:09.665 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:09.709 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-12-20T06:13:09.738 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-20T06:13:09.774 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-12-20T06:13:13.711 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:13.739 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:13.775 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T06:13:13.821 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-12-20T06:13:13.847 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-20T06:13:13.883 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-12-20T06:13:13.922 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-12-20T06:13:13.947 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-20T06:13:13.985 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-12-20T06:13:14.090 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 93572f31db899adbd1540d7954ab247e32731c84 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} duration: 7373.145720005035 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=aa81309892c94e6b92444dc2607a16e1 status: fail success: false 2023-12-20T06:13:14.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T06:13:14.171 INFO:teuthology.run:FAIL